2024-09-10T07:48:40.553 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T07:48:40.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T07:48:40.667 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888 branch: wip-rishabh-testing-20240909.165402-squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/iogen}} email: null first_in_suite: false job_id: '7898888' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFgK+5oe+DltkGybrwqrQsboZE8uLG8W1dw93mB3FLndSF/jHaTAEI/KiA39DC65FqiqZJi/kiFeGE8nkhui4vY= smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGGS8xV+OY9JFaNqnwRSnn4SmXfGTw64QutkySmWHRu1CDrCo+DWatfwwS6zAcybtMqNrgeX05AOxVB6IHotQnA= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF1VJHYTroJkF1NooJQeIaoE6KH5BFwXE+FzZGzVQd6Q/EhaAyc4qOW8aB1HGuOpFv/ZLOmY21nfflzd7+w2l7c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/iogen.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T07:48:40.668 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T07:48:40.668 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T07:48:40.668 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T07:48:40.670 INFO:teuthology.task.internal:Checking packages... 2024-09-10T07:48:40.690 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T07:48:40.690 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T07:48:40.690 INFO:teuthology.packaging:ref: None 2024-09-10T07:48:40.690 INFO:teuthology.packaging:tag: None 2024-09-10T07:48:40.690 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T07:48:40.690 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:48:40.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T07:48:40.835 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T07:48:40.837 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T07:48:40.844 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T07:48:40.844 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T07:48:40.849 INFO:teuthology.task.internal:Saving configuration 2024-09-10T07:48:40.869 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T07:48:40.875 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T07:48:40.892 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 07:43:35.021073', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFgK+5oe+DltkGybrwqrQsboZE8uLG8W1dw93mB3FLndSF/jHaTAEI/KiA39DC65FqiqZJi/kiFeGE8nkhui4vY='} 2024-09-10T07:48:40.911 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 07:43:35.013694', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGGS8xV+OY9JFaNqnwRSnn4SmXfGTw64QutkySmWHRu1CDrCo+DWatfwwS6zAcybtMqNrgeX05AOxVB6IHotQnA='} 2024-09-10T07:48:40.928 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 07:43:35.017127', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF1VJHYTroJkF1NooJQeIaoE6KH5BFwXE+FzZGzVQd6Q/EhaAyc4qOW8aB1HGuOpFv/ZLOmY21nfflzd7+w2l7c='} 2024-09-10T07:48:40.928 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T07:48:40.935 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T07:48:40.935 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T07:48:40.935 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T07:48:40.935 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T07:48:41.150 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe0e4fafbe0>, signals=[15]) 2024-09-10T07:48:41.150 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T07:48:41.155 INFO:teuthology.task.internal:Opening connections... 2024-09-10T07:48:41.155 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2024-09-10T07:48:41.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:48:41.236 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T07:48:41.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:48:41.311 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-09-10T07:48:41.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:48:41.387 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T07:48:41.394 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-09-10T07:48:41.412 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-09-10T07:48:41.412 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-09-10T07:48:41.469 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-09-10T07:48:41.469 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-09-10T07:48:41.469 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-09-10T07:48:41.470 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-09-10T07:48:41.470 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-09-10T07:48:41.470 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-09-10T07:48:41.470 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T07:48:41.470 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-09-10T07:48:41.470 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-09-10T07:48:41.470 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T07:48:41.470 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-09-10T07:48:41.470 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T07:48:41.470 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T07:48:41.470 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T07:48:41.471 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-09-10T07:48:41.486 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-09-10T07:48:41.505 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-09-10T07:48:41.505 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-09-10T07:48:41.562 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-09-10T07:48:41.562 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-09-10T07:48:41.562 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-09-10T07:48:41.562 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-09-10T07:48:41.562 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-09-10T07:48:41.562 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-09-10T07:48:41.562 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T07:48:41.563 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-09-10T07:48:41.563 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-09-10T07:48:41.563 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T07:48:41.563 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-09-10T07:48:41.563 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T07:48:41.563 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T07:48:41.563 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T07:48:41.563 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-09-10T07:48:41.578 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-09-10T07:48:41.596 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-09-10T07:48:41.597 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-09-10T07:48:41.654 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-09-10T07:48:41.654 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-09-10T07:48:41.654 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-09-10T07:48:41.654 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-09-10T07:48:41.654 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-09-10T07:48:41.655 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-09-10T07:48:41.655 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T07:48:41.655 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-09-10T07:48:41.655 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-09-10T07:48:41.655 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T07:48:41.655 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-09-10T07:48:41.655 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T07:48:41.655 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T07:48:41.655 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T07:48:41.655 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-09-10T07:48:41.670 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T07:48:41.680 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T07:48:41.761 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T07:48:41.761 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2024-09-10T07:48:41.763 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-09-10T07:48:41.766 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-09-10T07:48:41.783 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T07:48:41.788 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T07:48:41.788 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2024-09-10T07:48:41.820 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-09-10T07:48:41.823 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-09-10T07:48:41.888 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T07:48:41.963 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T07:48:41.977 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-10T07:48:41.978 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T07:48:41.978 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T07:48:41.978 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T07:48:41.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:48:41.995 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-09-10T07:48:42.052 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-503.el9.x86_64 2024-09-10T07:48:42.052 INFO:teuthology.task.kernel:Running kernel on smithi022: 5.14.0-503.el9.x86_64 2024-09-10T07:48:42.052 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum install -y kernel 2024-09-10T07:48:46.068 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.2 MB 00:02 2024-09-10T07:48:50.003 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 7.4 MB/s | 20 MB 00:02 2024-09-10T07:48:54.328 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-10T07:48:55.987 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-10T07:48:56.783 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-10T07:49:02.406 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-10T07:49:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T07:49:04.512 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T07:49:04.611 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-09-10T07:49:04.622 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-09-10T07:49:04.622 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-09-10T07:49:04.622 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-09-10T07:49:04.622 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-09-10T07:49:04.622 INFO:teuthology.orchestra.run.smithi022.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T07:49:04.622 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-09-10T07:49:04.622 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T07:49:04.622 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T07:49:04.622 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T07:49:04.622 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:49:04.622 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-09-10T07:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-09-10T07:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:Install 4 Packages 2024-09-10T07:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 79 M 2024-09-10T07:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 126 M 2024-09-10T07:49:04.623 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-09-10T07:49:04.765 INFO:teuthology.orchestra.run.smithi022.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 237 kB/s | 23 kB 00:00 2024-09-10T07:49:08.590 INFO:teuthology.orchestra.run.smithi022.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:03 2024-09-10T07:49:11.915 INFO:teuthology.orchestra.run.smithi022.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.0 MB/s | 29 MB 00:07 2024-09-10T07:49:13.698 INFO:teuthology.orchestra.run.smithi022.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 3.8 MB/s | 35 MB 00:09 2024-09-10T07:49:13.698 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-10T07:49:13.698 INFO:teuthology.orchestra.run.smithi022.stdout:Total 8.7 MB/s | 79 MB 00:09 2024-09-10T07:49:14.407 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-09-10T07:49:14.812 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-09-10T07:49:14.812 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-09-10T07:49:15.786 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-09-10T07:49:15.787 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-09-10T07:49:18.400 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-09-10T07:49:19.050 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T07:49:19.132 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T07:49:21.948 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T07:49:22.078 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T07:49:27.208 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T07:49:27.270 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T07:49:32.418 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T07:50:11.147 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T07:50:11.189 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T07:50:11.499 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T07:50:11.499 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T07:50:11.499 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T07:50:11.499 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T07:50:12.408 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T07:50:12.408 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:50:12.408 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-09-10T07:50:12.408 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T07:50:12.409 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T07:50:12.409 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T07:50:12.409 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T07:50:12.409 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:50:12.409 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-09-10T07:50:12.763 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T07:50:12.860 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T07:50:12.861 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T07:50:12.861 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T07:50:12.861 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T07:50:12.861 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T07:50:12.861 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T07:50:12.861 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T07:50:12.861 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T07:50:12.922 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T07:50:12.922 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T07:50:12.922 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -qi grub2-tools 2024-09-10T07:50:12.954 INFO:teuthology.orchestra.run.smithi022.stdout:Name : grub2-tools 2024-09-10T07:50:12.954 INFO:teuthology.orchestra.run.smithi022.stdout:Epoch : 1 2024-09-10T07:50:12.954 INFO:teuthology.orchestra.run.smithi022.stdout:Version : 2.06 2024-09-10T07:50:12.954 INFO:teuthology.orchestra.run.smithi022.stdout:Release : 82.el9 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: x86_64 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:Group : Unspecified 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:Size : 8274670 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:License : GPLv3+ 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:Packager : builder@centos.org 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:Vendor : CentOS 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:Summary : Support tools for GRUB. 2024-09-10T07:50:12.955 INFO:teuthology.orchestra.run.smithi022.stdout:Description : 2024-09-10T07:50:12.956 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:50:12.956 INFO:teuthology.orchestra.run.smithi022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T07:50:12.956 INFO:teuthology.orchestra.run.smithi022.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T07:50:12.956 INFO:teuthology.orchestra.run.smithi022.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T07:50:12.956 INFO:teuthology.orchestra.run.smithi022.stdout:hardware devices. 2024-09-10T07:50:12.956 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:50:12.956 INFO:teuthology.orchestra.run.smithi022.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T07:50:12.957 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T07:50:12.957 INFO:teuthology.task.kernel:Updating grub on smithi022 to boot 5.14.0-505.el9.x86_64 2024-09-10T07:50:12.957 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T07:50:13.575 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2024-09-10T07:50:14.850 INFO:teuthology.orchestra.run.smithi022.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T07:50:14.881 INFO:teuthology.orchestra.run.smithi022.stderr:done 2024-09-10T07:50:14.883 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2024-09-10T07:50:14.898 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.XIS69Cji6H 2024-09-10T07:50:14.899 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XIS69Cji6H 2024-09-10T07:50:14.964 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.XIS69Cji6H 2024-09-10T07:50:15.101 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.XIS69Cji6H is 6KB 2024-09-10T07:50:15.150 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.XIS69Cji6H 2024-09-10T07:50:15.165 DEBUG:teuthology.orchestra.run.smithi022:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T07:50:15.227 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T07:50:15.227 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T07:50:15.227 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T07:50:15.228 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T07:50:15.229 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T07:50:15.386 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2024-09-10T07:50:45.389 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T07:50:45.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-10T07:50:45.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:51:03.741 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-09-10T07:51:12.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-10T07:51:12.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:52:12.746 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T07:52:24.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-10T07:52:24.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:52:25.014 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-09-10T07:52:25.361 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-10T07:52:25.361 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T07:52:25.362 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-09-10T07:52:25.379 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-505.el9.x86_64 2024-09-10T07:52:25.379 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T07:52:25.379 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T07:52:25.379 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T07:52:26.381 DEBUG:teuthology.parallel:result is None 2024-09-10T07:52:26.381 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T07:52:26.388 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T07:52:26.388 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T07:52:26.391 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T07:52:26.394 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T07:52:26.413 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T07:52:26.419 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T07:52:26.426 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T07:52:26.426 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T07:52:26.450 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T07:52:26.453 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T07:52:26.750 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T07:52:26.756 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T07:52:26.756 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T07:52:26.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:52:26.773 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T07:52:26.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:52:26.791 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T07:52:26.793 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T07:52:26.815 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T07:52:26.849 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:52:26.869 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:52:26.888 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:52:26.898 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:52:26.905 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:52:26.915 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T07:52:26.917 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T07:52:26.923 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T07:52:26.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T07:52:26.926 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T07:52:26.928 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T07:52:26.957 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T07:52:26.966 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T07:52:26.966 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T07:52:26.998 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T07:52:27.000 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T07:52:27.017 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:52:27.089 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:52:27.158 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:52:27.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:52:27.245 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T07:52:27.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T07:52:27.311 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:52:27.353 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:52:27.404 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:52:27.488 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:52:27.530 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T07:52:27.530 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T07:52:27.597 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:52:27.639 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T07:52:27.697 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:52:27.783 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T07:52:27.826 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-10T07:52:27.827 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T07:52:27.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2024-09-10T07:52:27.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-09-10T07:52:27.902 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-09-10T07:52:27.937 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T07:52:27.947 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T07:52:27.971 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T07:52:28.480 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T07:52:28.488 INFO:teuthology.task.internal:Starting timer... 2024-09-10T07:52:28.488 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T07:52:28.534 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T07:52:28.541 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-10T07:52:28.541 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2024-09-10T07:52:28.597 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2024-09-10T07:52:28.599 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-09-10T07:52:28.671 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-09-10T07:52:28.673 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-09-10T07:52:28.741 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-09-10T07:52:28.743 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T07:52:28.743 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2024-09-10T07:52:28.772 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2024-09-10T07:52:28.772 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-09-10T07:52:28.804 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-09-10T07:52:28.805 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-09-10T07:52:28.829 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-09-10T07:52:28.829 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2024-09-10T07:52:28.829 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T07:52:28.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:52:28.858 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T07:52:28.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:52:28.888 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T07:52:28.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T07:52:28.918 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T07:52:28.918 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2024-09-10T07:52:28.952 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-09-10T07:52:28.987 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-09-10T07:52:29.032 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T07:52:29.041 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T07:52:29.052 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T07:52:29.053 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi100.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T07:56:25.945 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-09-10T07:56:25.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-10T07:56:25.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:56:26.028 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-09-10T07:56:26.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-10T07:56:26.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T07:56:26.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:56:26.188 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-10T07:56:26.270 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-10T07:56:26.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-10T07:56:26.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T07:56:26.347 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-10T07:56:26.430 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-10T07:56:26.431 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T07:56:26.441 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T07:56:26.441 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T07:56:26.442 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T07:56:26.445 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T07:56:26.445 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T07:56:26.447 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T07:56:26.448 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T07:56:26.477 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T07:56:26.479 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T07:56:26.494 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T07:56:26.496 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T07:56:26.501 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T07:56:26.516 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T07:56:26.522 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-09-10T07:56:26.523 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2024-09-10T07:56:26.534 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-09-10T07:56:26.535 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2024-09-10T07:56:26.543 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-09-10T07:56:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T07:56:26.551 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T07:56:26.554 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-09-10T07:56:26.563 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T07:56:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T07:56:26.568 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T07:56:26.583 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T07:56:26.620 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-10T07:56:26.623 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-09-10T07:56:26.624 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T07:56:26.624 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-10T07:56:26.624 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:56:26.624 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:56:26.624 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:56:26.624 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:56:26.626 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T07:56:26.626 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-09-10T07:56:26.626 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:56:26.626 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:56:26.626 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:56:26.627 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:56:26.644 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-09-10T07:56:26.648 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T07:56:26.648 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-09-10T07:56:26.648 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:56:26.648 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:56:26.648 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:56:26.648 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T07:56:26.649 INFO:teuthology.run_tasks:Running task install... 2024-09-10T07:56:26.656 DEBUG:teuthology.task.install:project ceph 2024-09-10T07:56:26.656 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T07:56:26.657 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T07:56:26.657 INFO:teuthology.task.install:Using flavor: default 2024-09-10T07:56:26.662 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T07:56:26.662 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T07:56:26.663 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T07:56:26.663 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:56:26.666 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T07:56:26.666 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:56:26.667 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T07:56:26.667 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:56:26.818 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T07:56:26.818 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T07:56:26.822 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T07:56:26.822 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T07:56:26.832 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T07:56:26.832 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T07:56:26.930 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T07:56:26.931 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T07:56:26.931 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T07:56:26.933 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T07:56:26.934 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-10T07:56:26.934 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T07:56:26.941 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T07:56:26.941 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T07:56:26.941 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T07:56:26.959 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T07:56:26.959 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T07:56:26.960 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T07:56:26.961 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T07:56:26.967 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T07:56:26.968 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T07:56:27.027 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T07:56:27.028 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T07:56:27.033 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T07:56:27.103 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T07:56:27.107 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T07:56:27.108 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T07:56:27.167 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-09-10T07:56:27.169 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-09-10T07:56:27.172 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-09-10T07:56:27.174 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-09-10T07:56:27.175 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2024-09-10T07:56:27.175 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2024-09-10T07:56:27.395 INFO:teuthology.orchestra.run.smithi153.stdout:45 files removed 2024-09-10T07:56:27.397 INFO:teuthology.orchestra.run.smithi100.stdout:45 files removed 2024-09-10T07:56:27.415 INFO:teuthology.orchestra.run.smithi022.stdout:45 files removed 2024-09-10T07:56:27.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T07:56:27.424 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T07:56:27.442 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T07:56:27.969 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-10T07:56:27.983 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 294 kB/s | 84 kB 00:00 2024-09-10T07:56:28.005 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-10T07:56:28.244 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-10T07:56:28.259 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 50 kB/s | 12 kB 00:00 2024-09-10T07:56:28.280 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-10T07:56:28.512 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-10T07:56:28.518 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-10T07:56:28.556 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-10T07:56:29.097 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-10T07:56:30.201 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.2 MB 00:01 2024-09-10T07:56:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-09-10T07:56:32.219 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-10T07:56:33.188 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-10T07:56:34.682 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-10T07:56:37.455 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-10T07:56:37.704 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-10T07:56:38.990 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 19 kB 00:00 2024-09-10T07:56:39.337 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 19 kB 00:00 2024-09-10T07:56:39.860 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-10T07:56:40.458 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-10T07:56:40.866 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.5 MB 00:02 2024-09-10T07:56:42.608 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-10T07:56:43.495 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-10T07:56:45.291 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-10T07:56:45.989 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-10T07:56:47.578 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:56:47.579 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:56:47.593 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T07:56:47.594 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T07:56:47.595 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T07:56:47.596 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T07:56:47.598 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T07:56:47.601 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T07:56:47.602 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T07:56:47.665 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-10T07:56:47.686 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-10T07:56:47.686 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-10T07:56:47.686 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-10T07:56:47.686 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-10T07:56:47.686 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T07:56:47.686 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T07:56:47.686 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T07:56:47.686 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T07:56:47.686 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T07:56:47.686 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T07:56:47.687 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T07:56:47.687 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T07:56:47.687 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T07:56:47.687 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T07:56:47.687 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T07:56:47.687 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T07:56:47.687 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T07:56:47.687 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T07:56:47.687 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T07:56:47.687 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T07:56:47.687 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T07:56:47.687 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T07:56:47.688 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T07:56:47.689 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T07:56:47.690 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T07:56:47.691 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T07:56:47.692 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T07:56:47.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T07:56:47.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T07:56:47.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T07:56:47.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T07:56:47.697 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T07:56:47.698 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T07:56:47.698 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T07:56:47.698 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T07:56:47.698 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T07:56:47.698 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-09-10T07:56:47.698 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T07:56:47.698 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:56:47.698 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-10T07:56:47.698 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-10T07:56:47.698 INFO:teuthology.orchestra.run.smithi100.stdout:Install 148 Packages 2024-09-10T07:56:47.698 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 8 Packages 2024-09-10T07:56:47.698 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:56:47.699 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 226 M 2024-09-10T07:56:47.699 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-10T07:56:48.276 INFO:teuthology.orchestra.run.smithi100.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 49 kB/s | 6.5 kB 00:00 2024-09-10T07:56:48.283 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:56:48.284 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:56:48.295 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T07:56:48.296 INFO:teuthology.orchestra.run.smithi153.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T07:56:48.297 INFO:teuthology.orchestra.run.smithi153.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T07:56:48.298 INFO:teuthology.orchestra.run.smithi153.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T07:56:48.299 INFO:teuthology.orchestra.run.smithi153.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T07:56:48.301 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T07:56:48.302 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T07:56:48.365 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-10T07:56:48.389 INFO:teuthology.orchestra.run.smithi153.stdout:====================================================================================== 2024-09-10T07:56:48.389 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-10T07:56:48.389 INFO:teuthology.orchestra.run.smithi153.stdout:====================================================================================== 2024-09-10T07:56:48.389 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-10T07:56:48.389 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T07:56:48.389 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T07:56:48.389 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T07:56:48.389 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T07:56:48.389 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T07:56:48.390 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T07:56:48.391 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T07:56:48.392 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T07:56:48.393 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T07:56:48.394 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T07:56:48.395 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T07:56:48.396 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T07:56:48.397 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T07:56:48.398 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T07:56:48.399 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T07:56:48.400 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T07:56:48.401 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-09-10T07:56:48.401 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T07:56:48.401 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:56:48.401 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-10T07:56:48.401 INFO:teuthology.orchestra.run.smithi153.stdout:====================================================================================== 2024-09-10T07:56:48.401 INFO:teuthology.orchestra.run.smithi153.stdout:Install 148 Packages 2024-09-10T07:56:48.401 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 8 Packages 2024-09-10T07:56:48.401 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:56:48.401 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 226 M 2024-09-10T07:56:48.402 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-10T07:56:48.551 INFO:teuthology.orchestra.run.smithi100.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 3.2 MB/s | 897 kB 00:00 2024-09-10T07:56:48.634 INFO:teuthology.orchestra.run.smithi100.stdout:(3/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-10T07:56:48.659 INFO:teuthology.orchestra.run.smithi100.stdout:(4/156): ceph-immutable-object-cache-19.1.1-305 1.3 MB/s | 145 kB 00:00 2024-09-10T07:56:48.776 INFO:teuthology.orchestra.run.smithi100.stdout:(5/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 17 MB/s | 2.4 MB 00:00 2024-09-10T07:56:48.910 INFO:teuthology.orchestra.run.smithi100.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 6.1 MB/s | 1.5 MB 00:00 2024-09-10T07:56:49.035 INFO:teuthology.orchestra.run.smithi100.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-10T07:56:49.185 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-10T07:56:49.261 INFO:teuthology.orchestra.run.smithi100.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 19 MB/s | 21 MB 00:01 2024-09-10T07:56:49.307 INFO:teuthology.orchestra.run.smithi153.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-10T07:56:49.311 INFO:teuthology.orchestra.run.smithi100.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 506 kB/s | 25 kB 00:00 2024-09-10T07:56:49.595 INFO:teuthology.orchestra.run.smithi100.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 19 MB/s | 11 MB 00:00 2024-09-10T07:56:49.653 INFO:teuthology.orchestra.run.smithi100.stdout:(11/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 3.8 MB/s | 228 kB 00:00 2024-09-10T07:56:49.737 INFO:teuthology.orchestra.run.smithi100.stdout:(12/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 325 kB/s | 27 kB 00:00 2024-09-10T07:56:49.821 INFO:teuthology.orchestra.run.smithi100.stdout:(13/156): libcephfs-devel-19.1.1-305.g1cf819b7. 380 kB/s | 32 kB 00:00 2024-09-10T07:56:49.890 INFO:teuthology.orchestra.run.smithi153.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 1.5 MB/s | 897 kB 00:00 2024-09-10T07:56:49.921 INFO:teuthology.orchestra.run.smithi100.stdout:(14/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 7.3 MB/s | 751 kB 00:00 2024-09-10T07:56:50.021 INFO:teuthology.orchestra.run.smithi100.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 1.6 MB/s | 164 kB 00:00 2024-09-10T07:56:50.049 INFO:teuthology.orchestra.run.smithi153.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 917 kB/s | 145 kB 00:00 2024-09-10T07:56:50.096 INFO:teuthology.orchestra.run.smithi100.stdout:(16/156): librados-devel-19.1.1-305.g1cf819b7.e 1.7 MB/s | 127 kB 00:00 2024-09-10T07:56:50.430 INFO:teuthology.orchestra.run.smithi100.stdout:(17/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 17 MB 00:01 2024-09-10T07:56:50.730 INFO:teuthology.orchestra.run.smithi100.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 799 kB/s | 506 kB 00:00 2024-09-10T07:56:50.757 INFO:teuthology.orchestra.run.smithi153.stdout:(4/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 3.4 MB/s | 2.4 MB 00:00 2024-09-10T07:56:50.805 INFO:teuthology.orchestra.run.smithi100.stdout:(19/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-10T07:56:50.872 INFO:teuthology.orchestra.run.smithi100.stdout:(20/156): python3-ceph-argparse-19.1.1-305.g1cf 318 kB/s | 45 kB 00:00 2024-09-10T07:56:50.898 INFO:teuthology.orchestra.run.smithi100.stdout:(21/156): python3-ceph-common-19.1.1-305.g1cf81 1.4 MB/s | 136 kB 00:00 2024-09-10T07:56:50.990 INFO:teuthology.orchestra.run.smithi100.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 3.4 MB/s | 320 kB 00:00 2024-09-10T07:56:51.124 INFO:teuthology.orchestra.run.smithi153.stdout:(5/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 2.8 MB/s | 5.4 MB 00:01 2024-09-10T07:56:51.166 INFO:teuthology.orchestra.run.smithi153.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 3.7 MB/s | 1.5 MB 00:00 2024-09-10T07:56:51.490 INFO:teuthology.orchestra.run.smithi100.stdout:(23/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 22 MB/s | 49 MB 00:02 2024-09-10T07:56:51.500 INFO:teuthology.orchestra.run.smithi153.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-10T07:56:51.507 INFO:teuthology.orchestra.run.smithi100.stdout:(24/156): python3-cephfs-19.1.1-305.g1cf819b7.e 254 kB/s | 161 kB 00:00 2024-09-10T07:56:51.532 INFO:teuthology.orchestra.run.smithi100.stdout:(25/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 554 kB/s | 301 kB 00:00 2024-09-10T07:56:51.557 INFO:teuthology.orchestra.run.smithi100.stdout:(26/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.5 MB/s | 99 kB 00:00 2024-09-10T07:56:51.604 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:56:51.605 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T07:56:51.617 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T07:56:51.618 INFO:teuthology.orchestra.run.smithi022.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T07:56:51.619 INFO:teuthology.orchestra.run.smithi022.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T07:56:51.620 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T07:56:51.621 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T07:56:51.624 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T07:56:51.625 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T07:56:51.641 INFO:teuthology.orchestra.run.smithi100.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 2.0 MB/s | 170 kB 00:00 2024-09-10T07:56:51.666 INFO:teuthology.orchestra.run.smithi100.stdout:(28/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 535 kB/s | 85 kB 00:00 2024-09-10T07:56:51.693 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-09-10T07:56:51.706 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-10T07:56:51.707 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-09-10T07:56:51.707 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-10T07:56:51.707 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-09-10T07:56:51.707 INFO:teuthology.orchestra.run.smithi022.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T07:56:51.707 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T07:56:51.707 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T07:56:51.707 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T07:56:51.707 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T07:56:51.707 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T07:56:51.707 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T07:56:51.707 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T07:56:51.708 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T07:56:51.708 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T07:56:51.708 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T07:56:51.708 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T07:56:51.708 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T07:56:51.708 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T07:56:51.708 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T07:56:51.708 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T07:56:51.708 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T07:56:51.708 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T07:56:51.708 INFO:teuthology.orchestra.run.smithi022.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T07:56:51.708 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T07:56:51.709 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T07:56:51.709 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T07:56:51.709 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T07:56:51.709 INFO:teuthology.orchestra.run.smithi022.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T07:56:51.709 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T07:56:51.709 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T07:56:51.709 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T07:56:51.709 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T07:56:51.709 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T07:56:51.709 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T07:56:51.709 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T07:56:51.710 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T07:56:51.710 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T07:56:51.710 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T07:56:51.710 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T07:56:51.710 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T07:56:51.710 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T07:56:51.710 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2024-09-10T07:56:51.710 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T07:56:51.710 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T07:56:51.710 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T07:56:51.710 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T07:56:51.711 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T07:56:51.711 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T07:56:51.711 INFO:teuthology.orchestra.run.smithi022.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T07:56:51.711 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T07:56:51.711 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-09-10T07:56:51.711 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T07:56:51.711 INFO:teuthology.orchestra.run.smithi022.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T07:56:51.711 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T07:56:51.711 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T07:56:51.711 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T07:56:51.711 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T07:56:51.711 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T07:56:51.712 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T07:56:51.712 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T07:56:51.712 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T07:56:51.712 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T07:56:51.712 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T07:56:51.712 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T07:56:51.712 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T07:56:51.712 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T07:56:51.712 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T07:56:51.712 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T07:56:51.712 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T07:56:51.712 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T07:56:51.713 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T07:56:51.713 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T07:56:51.713 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T07:56:51.713 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T07:56:51.713 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T07:56:51.713 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T07:56:51.713 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T07:56:51.713 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T07:56:51.713 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T07:56:51.713 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T07:56:51.713 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T07:56:51.714 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T07:56:51.715 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T07:56:51.716 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T07:56:51.716 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T07:56:51.716 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T07:56:51.716 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T07:56:51.716 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T07:56:51.716 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T07:56:51.716 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T07:56:51.716 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T07:56:51.716 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T07:56:51.716 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T07:56:51.716 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T07:56:51.716 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T07:56:51.717 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T07:56:51.717 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T07:56:51.717 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T07:56:51.717 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T07:56:51.717 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T07:56:51.717 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T07:56:51.717 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T07:56:51.717 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T07:56:51.717 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T07:56:51.717 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T07:56:51.717 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T07:56:51.718 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T07:56:51.719 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T07:56:51.719 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T07:56:51.719 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T07:56:51.719 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T07:56:51.719 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T07:56:51.719 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T07:56:51.719 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T07:56:51.719 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T07:56:51.719 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T07:56:51.719 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T07:56:51.719 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T07:56:51.719 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T07:56:51.720 INFO:teuthology.orchestra.run.smithi022.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T07:56:51.720 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T07:56:51.720 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T07:56:51.720 INFO:teuthology.orchestra.run.smithi022.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T07:56:51.720 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T07:56:51.720 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T07:56:51.720 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2024-09-10T07:56:51.720 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T07:56:51.720 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:56:51.720 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-09-10T07:56:51.720 INFO:teuthology.orchestra.run.smithi022.stdout:====================================================================================== 2024-09-10T07:56:51.720 INFO:teuthology.orchestra.run.smithi022.stdout:Install 148 Packages 2024-09-10T07:56:51.721 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 8 Packages 2024-09-10T07:56:51.721 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:56:51.721 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 226 M 2024-09-10T07:56:51.721 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-09-10T07:56:51.725 INFO:teuthology.orchestra.run.smithi100.stdout:(29/156): ceph-grafana-dashboards-19.1.1-305.g1 381 kB/s | 32 kB 00:00 2024-09-10T07:56:51.825 INFO:teuthology.orchestra.run.smithi100.stdout:(30/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-10T07:56:51.851 INFO:teuthology.orchestra.run.smithi100.stdout:(31/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 797 kB/s | 146 kB 00:00 2024-09-10T07:56:52.168 INFO:teuthology.orchestra.run.smithi100.stdout:(32/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 8.1 MB/s | 3.6 MB 00:00 2024-09-10T07:56:52.218 INFO:teuthology.orchestra.run.smithi100.stdout:(33/156): ceph-mgr-modules-core-19.1.1-305.g1cf 679 kB/s | 249 kB 00:00 2024-09-10T07:56:52.243 INFO:teuthology.orchestra.run.smithi100.stdout:(34/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 657 kB/s | 49 kB 00:00 2024-09-10T07:56:52.268 INFO:teuthology.orchestra.run.smithi100.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 328 kB/s | 16 kB 00:00 2024-09-10T07:56:52.293 INFO:teuthology.orchestra.run.smithi100.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 5.6 MB/s | 285 kB 00:00 2024-09-10T07:56:52.377 INFO:teuthology.orchestra.run.smithi022.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-10T07:56:52.383 INFO:teuthology.orchestra.run.smithi153.stdout:(8/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 6.6 MB/s | 21 MB 00:03 2024-09-10T07:56:52.402 INFO:teuthology.orchestra.run.smithi100.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-10T07:56:52.427 INFO:teuthology.orchestra.run.smithi100.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 137 kB/s | 18 kB 00:00 2024-09-10T07:56:52.442 INFO:teuthology.orchestra.run.smithi153.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 433 kB/s | 25 kB 00:00 2024-09-10T07:56:52.503 INFO:teuthology.orchestra.run.smithi100.stdout:(39/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 3.2 MB/s | 766 kB 00:00 2024-09-10T07:56:52.559 INFO:teuthology.orchestra.run.smithi153.stdout:(10/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 10 MB/s | 11 MB 00:01 2024-09-10T07:56:52.569 INFO:teuthology.orchestra.run.smithi022.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 4.6 MB/s | 897 kB 00:00 2024-09-10T07:56:52.636 INFO:teuthology.orchestra.run.smithi022.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 2.1 MB/s | 145 kB 00:00 2024-09-10T07:56:52.734 INFO:teuthology.orchestra.run.smithi153.stdout:(11/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 17 MB 00:01 2024-09-10T07:56:52.767 INFO:teuthology.orchestra.run.smithi153.stdout:(12/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 1.1 MB/s | 228 kB 00:00 2024-09-10T07:56:52.818 INFO:teuthology.orchestra.run.smithi153.stdout:(13/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 325 kB/s | 27 kB 00:00 2024-09-10T07:56:52.836 INFO:teuthology.orchestra.run.smithi022.stdout:(4/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 12 MB/s | 2.4 MB 00:00 2024-09-10T07:56:52.851 INFO:teuthology.orchestra.run.smithi153.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 379 kB/s | 32 kB 00:00 2024-09-10T07:56:52.952 INFO:teuthology.orchestra.run.smithi153.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 1.6 MB/s | 164 kB 00:00 2024-09-10T07:56:52.985 INFO:teuthology.orchestra.run.smithi153.stdout:(16/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 4.4 MB/s | 751 kB 00:00 2024-09-10T07:56:53.003 INFO:teuthology.orchestra.run.smithi022.stdout:(5/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 9.1 MB/s | 1.5 MB 00:00 2024-09-10T07:56:53.035 INFO:teuthology.orchestra.run.smithi153.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 1.5 MB/s | 127 kB 00:00 2024-09-10T07:56:53.069 INFO:teuthology.orchestra.run.smithi153.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 5.9 MB/s | 506 kB 00:00 2024-09-10T07:56:53.070 INFO:teuthology.orchestra.run.smithi100.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 120 kB/s | 80 kB 00:00 2024-09-10T07:56:53.169 INFO:teuthology.orchestra.run.smithi153.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 452 kB/s | 45 kB 00:00 2024-09-10T07:56:53.220 INFO:teuthology.orchestra.run.smithi153.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.6 MB/s | 136 kB 00:00 2024-09-10T07:56:53.244 INFO:teuthology.orchestra.run.smithi100.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 258 kB/s | 191 kB 00:00 2024-09-10T07:56:53.278 INFO:teuthology.orchestra.run.smithi153.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 2.7 MB/s | 161 kB 00:00 2024-09-10T07:56:53.328 INFO:teuthology.orchestra.run.smithi100.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 890 kB/s | 801 kB 00:00 2024-09-10T07:56:53.337 INFO:teuthology.orchestra.run.smithi022.stdout:(6/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 19 MB/s | 21 MB 00:01 2024-09-10T07:56:53.337 INFO:teuthology.orchestra.run.smithi153.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 5.3 MB/s | 320 kB 00:00 2024-09-10T07:56:53.431 INFO:teuthology.orchestra.run.smithi022.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-10T07:56:53.438 INFO:teuthology.orchestra.run.smithi153.stdout:(23/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 2.9 MB/s | 301 kB 00:00 2024-09-10T07:56:53.538 INFO:teuthology.orchestra.run.smithi153.stdout:(24/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 995 kB/s | 99 kB 00:00 2024-09-10T07:56:53.646 INFO:teuthology.orchestra.run.smithi153.stdout:(25/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 786 kB/s | 85 kB 00:00 2024-09-10T07:56:53.780 INFO:teuthology.orchestra.run.smithi153.stdout:(26/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 7.2 MB/s | 5.3 MB 00:00 2024-09-10T07:56:53.837 INFO:teuthology.orchestra.run.smithi100.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 330 kB/s | 253 kB 00:00 2024-09-10T07:56:53.872 INFO:teuthology.orchestra.run.smithi153.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 1.8 MB/s | 170 kB 00:00 2024-09-10T07:56:53.947 INFO:teuthology.orchestra.run.smithi153.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 424 kB/s | 32 kB 00:00 2024-09-10T07:56:53.987 INFO:teuthology.orchestra.run.smithi100.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-09-10T07:56:54.039 INFO:teuthology.orchestra.run.smithi153.stdout:(29/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.6 MB/s | 146 kB 00:00 2024-09-10T07:56:54.106 INFO:teuthology.orchestra.run.smithi153.stdout:(30/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 6.7 MB/s | 3.1 MB 00:00 2024-09-10T07:56:54.196 INFO:teuthology.orchestra.run.smithi100.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-10T07:56:54.198 INFO:teuthology.orchestra.run.smithi022.stdout:(8/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9. 14 MB/s | 11 MB 00:00 2024-09-10T07:56:54.273 INFO:teuthology.orchestra.run.smithi022.stdout:(9/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 2.7 MB/s | 5.4 MB 00:02 2024-09-10T07:56:54.298 INFO:teuthology.orchestra.run.smithi022.stdout:(10/156): ceph-selinux-19.1.1-305.g1cf819b7.el9 251 kB/s | 25 kB 00:00 2024-09-10T07:56:54.398 INFO:teuthology.orchestra.run.smithi153.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 9.9 MB/s | 3.6 MB 00:00 2024-09-10T07:56:54.457 INFO:teuthology.orchestra.run.smithi153.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 4.2 MB/s | 249 kB 00:00 2024-09-10T07:56:54.499 INFO:teuthology.orchestra.run.smithi022.stdout:(11/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 15 MB/s | 17 MB 00:01 2024-09-10T07:56:54.507 INFO:teuthology.orchestra.run.smithi153.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 987 kB/s | 49 kB 00:00 2024-09-10T07:56:54.524 INFO:teuthology.orchestra.run.smithi022.stdout:(12/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 1.0 MB/s | 228 kB 00:00 2024-09-10T07:56:54.549 INFO:teuthology.orchestra.run.smithi022.stdout:(13/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 541 kB/s | 27 kB 00:00 2024-09-10T07:56:54.554 INFO:teuthology.orchestra.run.smithi100.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 189 kB/s | 135 kB 00:00 2024-09-10T07:56:54.574 INFO:teuthology.orchestra.run.smithi022.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 634 kB/s | 32 kB 00:00 2024-09-10T07:56:54.599 INFO:teuthology.orchestra.run.smithi153.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 15 MB/s | 7.4 MB 00:00 2024-09-10T07:56:54.616 INFO:teuthology.orchestra.run.smithi153.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 152 kB/s | 16 kB 00:00 2024-09-10T07:56:54.633 INFO:teuthology.orchestra.run.smithi022.stdout:(15/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-10T07:56:54.658 INFO:teuthology.orchestra.run.smithi153.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 4.8 MB/s | 285 kB 00:00 2024-09-10T07:56:54.658 INFO:teuthology.orchestra.run.smithi022.stdout:(16/156): libcephsqlite-19.1.1-305.g1cf819b7.el 1.9 MB/s | 164 kB 00:00 2024-09-10T07:56:54.671 INFO:teuthology.orchestra.run.smithi100.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 183 kB/s | 125 kB 00:00 2024-09-10T07:56:54.684 INFO:teuthology.orchestra.run.smithi022.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 2.5 MB/s | 127 kB 00:00 2024-09-10T07:56:54.708 INFO:teuthology.orchestra.run.smithi153.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 8.1 MB/s | 766 kB 00:00 2024-09-10T07:56:54.725 INFO:teuthology.orchestra.run.smithi022.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 7.4 MB/s | 506 kB 00:00 2024-09-10T07:56:54.733 INFO:teuthology.orchestra.run.smithi153.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 242 kB/s | 18 kB 00:00 2024-09-10T07:56:54.776 INFO:teuthology.orchestra.run.smithi022.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 907 kB/s | 45 kB 00:00 2024-09-10T07:56:54.842 INFO:teuthology.orchestra.run.smithi153.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 599 kB/s | 80 kB 00:00 2024-09-10T07:56:54.843 INFO:teuthology.orchestra.run.smithi022.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.0 MB/s | 136 kB 00:00 2024-09-10T07:56:54.863 INFO:teuthology.orchestra.run.smithi100.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-10T07:56:54.909 INFO:teuthology.orchestra.run.smithi153.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-10T07:56:54.922 INFO:teuthology.orchestra.run.smithi100.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-10T07:56:54.934 INFO:teuthology.orchestra.run.smithi153.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-10T07:56:54.943 INFO:teuthology.orchestra.run.smithi022.stdout:(21/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 21 MB/s | 5.3 MB 00:00 2024-09-10T07:56:54.955 INFO:teuthology.orchestra.run.smithi100.stdout:(50/156): python3-urllib3-1.26.5-6.el9.noarch.r 283 kB/s | 215 kB 00:00 2024-09-10T07:56:54.968 INFO:teuthology.orchestra.run.smithi153.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-10T07:56:54.968 INFO:teuthology.orchestra.run.smithi022.stdout:(22/156): python3-cephfs-19.1.1-305.g1cf819b7.e 1.3 MB/s | 161 kB 00:00 2024-09-10T07:56:54.980 INFO:teuthology.orchestra.run.smithi100.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-10T07:56:54.993 INFO:teuthology.orchestra.run.smithi022.stdout:(23/156): python3-rados-19.1.1-305.g1cf819b7.el 6.3 MB/s | 320 kB 00:00 2024-09-10T07:56:55.018 INFO:teuthology.orchestra.run.smithi153.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-10T07:56:55.019 INFO:teuthology.orchestra.run.smithi022.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 5.8 MB/s | 301 kB 00:00 2024-09-10T07:56:55.023 INFO:teuthology.orchestra.run.smithi100.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-10T07:56:55.044 INFO:teuthology.orchestra.run.smithi022.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T07:56:55.048 INFO:teuthology.orchestra.run.smithi100.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-10T07:56:55.069 INFO:teuthology.orchestra.run.smithi022.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-10T07:56:55.077 INFO:teuthology.orchestra.run.smithi153.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-09-10T07:56:55.102 INFO:teuthology.orchestra.run.smithi153.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-10T07:56:55.106 INFO:teuthology.orchestra.run.smithi100.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-09-10T07:56:55.128 INFO:teuthology.orchestra.run.smithi022.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-10T07:56:55.144 INFO:teuthology.orchestra.run.smithi153.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-10T07:56:55.165 INFO:teuthology.orchestra.run.smithi100.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-09-10T07:56:55.169 INFO:teuthology.orchestra.run.smithi153.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-10T07:56:55.186 INFO:teuthology.orchestra.run.smithi022.stdout:(28/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 22 MB/s | 3.1 MB 00:00 2024-09-10T07:56:55.212 INFO:teuthology.orchestra.run.smithi022.stdout:(29/156): ceph-grafana-dashboards-19.1.1-305.g1 381 kB/s | 32 kB 00:00 2024-09-10T07:56:55.215 INFO:teuthology.orchestra.run.smithi100.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-10T07:56:55.237 INFO:teuthology.orchestra.run.smithi022.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.9 MB/s | 146 kB 00:00 2024-09-10T07:56:55.241 INFO:teuthology.orchestra.run.smithi100.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-10T07:56:55.266 INFO:teuthology.orchestra.run.smithi100.stdout:(58/156): flex-2.6.4-9.el9.x86_64.rpm 1.0 MB/s | 313 kB 00:00 2024-09-10T07:56:55.291 INFO:teuthology.orchestra.run.smithi100.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-10T07:56:55.325 INFO:teuthology.orchestra.run.smithi100.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-10T07:56:55.367 INFO:teuthology.orchestra.run.smithi100.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-10T07:56:55.394 INFO:teuthology.orchestra.run.smithi100.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 689 kB/s | 47 kB 00:00 2024-09-10T07:56:55.419 INFO:teuthology.orchestra.run.smithi100.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 3.7 MB/s | 581 kB 00:00 2024-09-10T07:56:55.428 INFO:teuthology.orchestra.run.smithi153.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-10T07:56:55.444 INFO:teuthology.orchestra.run.smithi100.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 292 kB 00:00 2024-09-10T07:56:55.462 INFO:teuthology.orchestra.run.smithi022.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 14 MB/s | 3.6 MB 00:00 2024-09-10T07:56:55.469 INFO:teuthology.orchestra.run.smithi100.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-10T07:56:55.486 INFO:teuthology.orchestra.run.smithi153.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-10T07:56:55.495 INFO:teuthology.orchestra.run.smithi100.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-10T07:56:55.520 INFO:teuthology.orchestra.run.smithi153.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-10T07:56:55.529 INFO:teuthology.orchestra.run.smithi022.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 3.7 MB/s | 249 kB 00:00 2024-09-10T07:56:55.545 INFO:teuthology.orchestra.run.smithi153.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 369 kB/s | 22 kB 00:00 2024-09-10T07:56:55.587 INFO:teuthology.orchestra.run.smithi153.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 784 kB/s | 33 kB 00:00 2024-09-10T07:56:55.604 INFO:teuthology.orchestra.run.smithi100.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-10T07:56:55.621 INFO:teuthology.orchestra.run.smithi022.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 19 MB/s | 7.4 MB 00:00 2024-09-10T07:56:55.638 INFO:teuthology.orchestra.run.smithi153.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-10T07:56:55.645 INFO:teuthology.orchestra.run.smithi100.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-10T07:56:55.646 INFO:teuthology.orchestra.run.smithi022.stdout:(34/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 422 kB/s | 49 kB 00:00 2024-09-10T07:56:55.672 INFO:teuthology.orchestra.run.smithi022.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 327 kB/s | 16 kB 00:00 2024-09-10T07:56:55.680 INFO:teuthology.orchestra.run.smithi153.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-10T07:56:55.687 INFO:teuthology.orchestra.run.smithi100.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-10T07:56:55.697 INFO:teuthology.orchestra.run.smithi022.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 5.5 MB/s | 285 kB 00:00 2024-09-10T07:56:55.713 INFO:teuthology.orchestra.run.smithi100.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-10T07:56:55.722 INFO:teuthology.orchestra.run.smithi153.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 267 kB/s | 11 kB 00:00 2024-09-10T07:56:55.739 INFO:teuthology.orchestra.run.smithi022.stdout:(37/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 11 MB/s | 766 kB 00:00 2024-09-10T07:56:55.764 INFO:teuthology.orchestra.run.smithi022.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 273 kB/s | 18 kB 00:00 2024-09-10T07:56:55.788 INFO:teuthology.orchestra.run.smithi100.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-10T07:56:55.822 INFO:teuthology.orchestra.run.smithi100.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-10T07:56:55.847 INFO:teuthology.orchestra.run.smithi100.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T07:56:55.908 INFO:teuthology.orchestra.run.smithi100.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-10T07:56:55.931 INFO:teuthology.orchestra.run.smithi022.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 416 kB/s | 80 kB 00:00 2024-09-10T07:56:55.981 INFO:teuthology.orchestra.run.smithi100.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-10T07:56:56.006 INFO:teuthology.orchestra.run.smithi100.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-10T07:56:56.032 INFO:teuthology.orchestra.run.smithi022.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-10T07:56:56.057 INFO:teuthology.orchestra.run.smithi022.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-10T07:56:56.090 INFO:teuthology.orchestra.run.smithi100.stdout:(77/156): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-09-10T07:56:56.091 INFO:teuthology.orchestra.run.smithi022.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-10T07:56:56.115 INFO:teuthology.orchestra.run.smithi100.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 235 kB/s | 26 kB 00:00 2024-09-10T07:56:56.140 INFO:teuthology.orchestra.run.smithi100.stdout:(79/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-10T07:56:56.141 INFO:teuthology.orchestra.run.smithi022.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-10T07:56:56.164 INFO:teuthology.orchestra.run.smithi153.stdout:(56/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 13 MB/s | 49 MB 00:03 2024-09-10T07:56:56.165 INFO:teuthology.orchestra.run.smithi100.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 254 kB/s | 19 kB 00:00 2024-09-10T07:56:56.189 INFO:teuthology.orchestra.run.smithi153.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 343 kB/s | 160 kB 00:00 2024-09-10T07:56:56.191 INFO:teuthology.orchestra.run.smithi100.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-10T07:56:56.200 INFO:teuthology.orchestra.run.smithi022.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-10T07:56:56.216 INFO:teuthology.orchestra.run.smithi100.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-10T07:56:56.233 INFO:teuthology.orchestra.run.smithi022.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-09-10T07:56:56.250 INFO:teuthology.orchestra.run.smithi100.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-10T07:56:56.259 INFO:teuthology.orchestra.run.smithi022.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-10T07:56:56.264 INFO:teuthology.orchestra.run.smithi153.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 453 kB/s | 45 kB 00:00 2024-09-10T07:56:56.275 INFO:teuthology.orchestra.run.smithi100.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-10T07:56:56.350 INFO:teuthology.orchestra.run.smithi100.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-10T07:56:56.375 INFO:teuthology.orchestra.run.smithi022.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.5 MB/s | 215 kB 00:00 2024-09-10T07:56:56.376 INFO:teuthology.orchestra.run.smithi100.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 421 kB/s | 42 kB 00:00 2024-09-10T07:56:56.401 INFO:teuthology.orchestra.run.smithi100.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 512 kB/s | 77 kB 00:00 2024-09-10T07:56:56.414 INFO:teuthology.orchestra.run.smithi153.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 662 kB 00:00 2024-09-10T07:56:56.426 INFO:teuthology.orchestra.run.smithi100.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-10T07:56:56.451 INFO:teuthology.orchestra.run.smithi100.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-10T07:56:56.473 INFO:teuthology.orchestra.run.smithi153.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 2.7 MB/s | 581 kB 00:00 2024-09-10T07:56:56.476 INFO:teuthology.orchestra.run.smithi100.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-10T07:56:56.490 INFO:teuthology.orchestra.run.smithi153.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-10T07:56:56.493 INFO:teuthology.orchestra.run.smithi100.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 759 kB/s | 51 kB 00:00 2024-09-10T07:56:56.511 INFO:teuthology.orchestra.run.smithi100.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 915 kB/s | 54 kB 00:00 2024-09-10T07:56:56.515 INFO:teuthology.orchestra.run.smithi153.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-10T07:56:56.544 INFO:teuthology.orchestra.run.smithi100.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-10T07:56:56.561 INFO:teuthology.orchestra.run.smithi100.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 880 kB/s | 44 kB 00:00 2024-09-10T07:56:56.603 INFO:teuthology.orchestra.run.smithi100.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-10T07:56:56.607 INFO:teuthology.orchestra.run.smithi153.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-10T07:56:56.620 INFO:teuthology.orchestra.run.smithi100.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-10T07:56:56.632 INFO:teuthology.orchestra.run.smithi153.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-10T07:56:56.649 INFO:teuthology.orchestra.run.smithi153.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 920 kB/s | 38 kB 00:00 2024-09-10T07:56:56.653 INFO:teuthology.orchestra.run.smithi100.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-10T07:56:56.679 INFO:teuthology.orchestra.run.smithi100.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-10T07:56:56.704 INFO:teuthology.orchestra.run.smithi100.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T07:56:56.708 INFO:teuthology.orchestra.run.smithi153.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.7 MB/s | 3.0 MB 00:01 2024-09-10T07:56:56.737 INFO:teuthology.orchestra.run.smithi100.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T07:56:56.763 INFO:teuthology.orchestra.run.smithi100.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-10T07:56:56.922 INFO:teuthology.orchestra.run.smithi100.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-10T07:56:56.947 INFO:teuthology.orchestra.run.smithi100.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 214 kB/s | 45 kB 00:00 2024-09-10T07:56:56.981 INFO:teuthology.orchestra.run.smithi100.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 103 kB/s | 22 kB 00:00 2024-09-10T07:56:57.023 INFO:teuthology.orchestra.run.smithi100.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-10T07:56:57.053 INFO:teuthology.orchestra.run.smithi100.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 839 kB/s | 19 kB 00:00 2024-09-10T07:56:57.081 INFO:teuthology.orchestra.run.smithi100.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.1 MB/s | 309 kB 00:00 2024-09-10T07:56:57.107 INFO:teuthology.orchestra.run.smithi100.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T07:56:57.132 INFO:teuthology.orchestra.run.smithi100.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T07:56:57.166 INFO:teuthology.orchestra.run.smithi100.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-10T07:56:57.182 INFO:teuthology.orchestra.run.smithi100.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-10T07:56:57.233 INFO:teuthology.orchestra.run.smithi153.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.0 MB/s | 1.6 MB 00:00 2024-09-10T07:56:57.234 INFO:teuthology.orchestra.run.smithi022.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 707 kB/s | 689 kB 00:00 2024-09-10T07:56:57.241 INFO:teuthology.orchestra.run.smithi100.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-10T07:56:57.275 INFO:teuthology.orchestra.run.smithi100.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-10T07:56:57.300 INFO:teuthology.orchestra.run.smithi100.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T07:56:57.325 INFO:teuthology.orchestra.run.smithi100.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-10T07:56:57.350 INFO:teuthology.orchestra.run.smithi100.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-09-10T07:56:57.376 INFO:teuthology.orchestra.run.smithi100.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-10T07:56:57.401 INFO:teuthology.orchestra.run.smithi100.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T07:56:57.426 INFO:teuthology.orchestra.run.smithi100.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-10T07:56:57.452 INFO:teuthology.orchestra.run.smithi100.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-10T07:56:57.477 INFO:teuthology.orchestra.run.smithi100.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T07:56:57.502 INFO:teuthology.orchestra.run.smithi100.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-10T07:56:57.525 INFO:teuthology.orchestra.run.smithi153.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.0 MB/s | 910 kB 00:00 2024-09-10T07:56:57.528 INFO:teuthology.orchestra.run.smithi100.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-10T07:56:57.553 INFO:teuthology.orchestra.run.smithi100.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 715 kB/s | 18 kB 00:00 2024-09-10T07:56:57.578 INFO:teuthology.orchestra.run.smithi100.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-10T07:56:57.603 INFO:teuthology.orchestra.run.smithi100.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-10T07:56:57.625 INFO:teuthology.orchestra.run.smithi153.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-09-10T07:56:57.628 INFO:teuthology.orchestra.run.smithi100.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 786 kB/s | 20 kB 00:00 2024-09-10T07:56:57.692 INFO:teuthology.orchestra.run.smithi153.stdout:(70/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-09-10T07:56:57.696 INFO:teuthology.orchestra.run.smithi100.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-10T07:56:57.717 INFO:teuthology.orchestra.run.smithi022.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 703 kB/s | 943 kB 00:01 2024-09-10T07:56:57.729 INFO:teuthology.orchestra.run.smithi100.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-10T07:56:57.754 INFO:teuthology.orchestra.run.smithi100.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T07:56:57.780 INFO:teuthology.orchestra.run.smithi100.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-10T07:56:57.784 INFO:teuthology.orchestra.run.smithi153.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.3 MB/s | 4.9 MB 00:01 2024-09-10T07:56:57.813 INFO:teuthology.orchestra.run.smithi100.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-10T07:56:57.834 INFO:teuthology.orchestra.run.smithi153.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-10T07:56:57.839 INFO:teuthology.orchestra.run.smithi100.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-10T07:56:57.873 INFO:teuthology.orchestra.run.smithi100.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-10T07:56:57.889 INFO:teuthology.orchestra.run.smithi100.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-10T07:56:57.915 INFO:teuthology.orchestra.run.smithi100.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 675 kB/s | 28 kB 00:00 2024-09-10T07:56:57.935 INFO:teuthology.orchestra.run.smithi022.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 153 kB/s | 107 kB 00:00 2024-09-10T07:56:57.957 INFO:teuthology.orchestra.run.smithi100.stdout:(137/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-10T07:56:57.974 INFO:teuthology.orchestra.run.smithi100.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-09-10T07:56:57.976 INFO:teuthology.orchestra.run.smithi153.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.6 MB/s | 1.0 MB 00:00 2024-09-10T07:56:57.990 INFO:teuthology.orchestra.run.smithi100.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-10T07:56:58.008 INFO:teuthology.orchestra.run.smithi100.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-10T07:56:58.027 INFO:teuthology.orchestra.run.smithi153.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-10T07:56:58.033 INFO:teuthology.orchestra.run.smithi100.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-10T07:56:58.058 INFO:teuthology.orchestra.run.smithi100.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-10T07:56:58.084 INFO:teuthology.orchestra.run.smithi100.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T07:56:58.109 INFO:teuthology.orchestra.run.smithi100.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-10T07:56:58.118 INFO:teuthology.orchestra.run.smithi153.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-10T07:56:58.134 INFO:teuthology.orchestra.run.smithi100.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-10T07:56:58.159 INFO:teuthology.orchestra.run.smithi100.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T07:56:58.185 INFO:teuthology.orchestra.run.smithi100.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T07:56:58.210 INFO:teuthology.orchestra.run.smithi153.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-10T07:56:58.251 INFO:teuthology.orchestra.run.smithi100.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-10T07:56:58.260 INFO:teuthology.orchestra.run.smithi022.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 40 kB/s | 22 kB 00:00 2024-09-10T07:56:58.261 INFO:teuthology.orchestra.run.smithi153.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-10T07:56:58.311 INFO:teuthology.orchestra.run.smithi153.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-10T07:56:58.369 INFO:teuthology.orchestra.run.smithi153.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-10T07:56:58.420 INFO:teuthology.orchestra.run.smithi153.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-10T07:56:58.435 INFO:teuthology.orchestra.run.smithi100.stdout:(149/156): librados2-19.1.1-305.g1cf819b7.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-10T07:56:58.712 INFO:teuthology.orchestra.run.smithi153.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 6.8 MB/s | 6.0 MB 00:00 2024-09-10T07:56:58.770 INFO:teuthology.orchestra.run.smithi153.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-10T07:56:58.827 INFO:teuthology.orchestra.run.smithi022.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 58 kB/s | 33 kB 00:00 2024-09-10T07:56:58.827 INFO:teuthology.orchestra.run.smithi100.stdout:(150/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 4.9 MB/s | 3.2 MB 00:00 2024-09-10T07:56:58.829 INFO:teuthology.orchestra.run.smithi153.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-10T07:56:58.869 INFO:teuthology.orchestra.run.smithi022.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 339 kB/s | 313 kB 00:00 2024-09-10T07:56:58.904 INFO:teuthology.orchestra.run.smithi153.stdout:(84/156): postgresql-server-13.16-1.el9.x86_64. 4.5 MB/s | 5.8 MB 00:01 2024-09-10T07:56:58.938 INFO:teuthology.orchestra.run.smithi153.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 709 kB/s | 77 kB 00:00 2024-09-10T07:56:58.963 INFO:teuthology.orchestra.run.smithi153.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 718 kB/s | 42 kB 00:00 2024-09-10T07:56:58.997 INFO:teuthology.orchestra.run.smithi153.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-10T07:56:59.056 INFO:teuthology.orchestra.run.smithi153.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-10T07:56:59.081 INFO:teuthology.orchestra.run.smithi153.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-10T07:56:59.098 INFO:teuthology.orchestra.run.smithi153.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-10T07:56:59.123 INFO:teuthology.orchestra.run.smithi153.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-10T07:56:59.165 INFO:teuthology.orchestra.run.smithi153.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 998 kB/s | 42 kB 00:00 2024-09-10T07:56:59.207 INFO:teuthology.orchestra.run.smithi153.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-10T07:56:59.282 INFO:teuthology.orchestra.run.smithi153.stdout:(94/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.9 MB/s | 5.1 MB 00:00 2024-09-10T07:56:59.308 INFO:teuthology.orchestra.run.smithi153.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-09-10T07:56:59.324 INFO:teuthology.orchestra.run.smithi153.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 858 kB/s | 36 kB 00:00 2024-09-10T07:56:59.350 INFO:teuthology.orchestra.run.smithi153.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-10T07:56:59.392 INFO:teuthology.orchestra.run.smithi153.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-10T07:56:59.402 INFO:teuthology.orchestra.run.smithi100.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 2.0 MB/s | 2.3 MB 00:01 2024-09-10T07:56:59.417 INFO:teuthology.orchestra.run.smithi153.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-10T07:56:59.451 INFO:teuthology.orchestra.run.smithi153.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T07:56:59.452 INFO:teuthology.orchestra.run.smithi100.stdout:(152/156): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:01 2024-09-10T07:56:59.467 INFO:teuthology.orchestra.run.smithi153.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T07:56:59.478 INFO:teuthology.orchestra.run.smithi100.stdout:(153/156): NetworkManager-team-1.49.90-1.el9.x8 63 kB/s | 41 kB 00:00 2024-09-10T07:56:59.493 INFO:teuthology.orchestra.run.smithi153.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-10T07:56:59.653 INFO:teuthology.orchestra.run.smithi022.stdout:(54/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 9.1 MB/s | 49 MB 00:05 2024-09-10T07:56:59.778 INFO:teuthology.orchestra.run.smithi022.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 20 kB/s | 18 kB 00:00 2024-09-10T07:56:59.993 INFO:teuthology.orchestra.run.smithi153.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 42 kB/s | 22 kB 00:00 2024-09-10T07:57:00.052 INFO:teuthology.orchestra.run.smithi153.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-09-10T07:57:00.085 INFO:teuthology.orchestra.run.smithi153.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-10T07:57:00.102 INFO:teuthology.orchestra.run.smithi153.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-10T07:57:00.119 INFO:teuthology.orchestra.run.smithi022.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 24 kB/s | 11 kB 00:00 2024-09-10T07:57:00.170 INFO:teuthology.orchestra.run.smithi100.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 324 kB/s | 249 kB 00:00 2024-09-10T07:57:00.211 INFO:teuthology.orchestra.run.smithi153.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-10T07:57:00.227 INFO:teuthology.orchestra.run.smithi153.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.6 MB/s | 26 kB 00:00 2024-09-10T07:57:00.244 INFO:teuthology.orchestra.run.smithi153.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-10T07:57:00.270 INFO:teuthology.orchestra.run.smithi153.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T07:57:00.295 INFO:teuthology.orchestra.run.smithi153.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-10T07:57:00.337 INFO:teuthology.orchestra.run.smithi153.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-10T07:57:00.371 INFO:teuthology.orchestra.run.smithi153.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-10T07:57:00.396 INFO:teuthology.orchestra.run.smithi153.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T07:57:00.411 INFO:teuthology.orchestra.run.smithi100.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-10T07:57:00.438 INFO:teuthology.orchestra.run.smithi153.stdout:(115/156): protobuf-compiler-3.14.0-13.el9.x86_ 913 kB/s | 863 kB 00:00 2024-09-10T07:57:00.463 INFO:teuthology.orchestra.run.smithi153.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 478 kB/s | 32 kB 00:00 2024-09-10T07:57:00.478 INFO:teuthology.orchestra.run.smithi100.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 2.4 MB 00:01 2024-09-10T07:57:00.485 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-10T07:57:00.485 INFO:teuthology.orchestra.run.smithi100.stdout:Total 18 MB/s | 226 MB 00:12 2024-09-10T07:57:00.486 INFO:teuthology.orchestra.run.smithi022.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 226 kB/s | 160 kB 00:00 2024-09-10T07:57:00.497 INFO:teuthology.orchestra.run.smithi153.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-10T07:57:00.522 INFO:teuthology.orchestra.run.smithi153.stdout:(118/156): python3-certifi-2023.05.07-4.el9.noa 168 kB/s | 14 kB 00:00 2024-09-10T07:57:00.548 INFO:teuthology.orchestra.run.smithi153.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.2 MB/s | 358 kB 00:00 2024-09-10T07:57:00.573 INFO:teuthology.orchestra.run.smithi153.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-10T07:57:00.598 INFO:teuthology.orchestra.run.smithi153.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T07:57:00.624 INFO:teuthology.orchestra.run.smithi153.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-10T07:57:00.649 INFO:teuthology.orchestra.run.smithi153.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-10T07:57:00.682 INFO:teuthology.orchestra.run.smithi153.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 531 kB/s | 18 kB 00:00 2024-09-10T07:57:00.711 INFO:teuthology.orchestra.run.smithi022.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2024-09-10T07:57:00.716 INFO:teuthology.orchestra.run.smithi153.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 699 kB/s | 23 kB 00:00 2024-09-10T07:57:00.741 INFO:teuthology.orchestra.run.smithi153.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-10T07:57:00.758 INFO:teuthology.orchestra.run.smithi153.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-10T07:57:00.808 INFO:teuthology.orchestra.run.smithi153.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-09-10T07:57:00.834 INFO:teuthology.orchestra.run.smithi153.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T07:57:00.859 INFO:teuthology.orchestra.run.smithi153.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T07:57:00.876 INFO:teuthology.orchestra.run.smithi153.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-10T07:57:00.935 INFO:teuthology.orchestra.run.smithi153.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-09-10T07:57:00.952 INFO:teuthology.orchestra.run.smithi153.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 992 kB/s | 16 kB 00:00 2024-09-10T07:57:00.977 INFO:teuthology.orchestra.run.smithi153.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-10T07:57:01.002 INFO:teuthology.orchestra.run.smithi153.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-10T07:57:01.019 INFO:teuthology.orchestra.run.smithi153.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-09-10T07:57:01.036 INFO:teuthology.orchestra.run.smithi153.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 924 kB/s | 31 kB 00:00 2024-09-10T07:57:01.053 INFO:teuthology.orchestra.run.smithi153.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-10T07:57:01.078 INFO:teuthology.orchestra.run.smithi153.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-10T07:57:01.095 INFO:teuthology.orchestra.run.smithi153.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 853 kB/s | 36 kB 00:00 2024-09-10T07:57:01.120 INFO:teuthology.orchestra.run.smithi153.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-10T07:57:01.146 INFO:teuthology.orchestra.run.smithi153.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-10T07:57:01.171 INFO:teuthology.orchestra.run.smithi153.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-10T07:57:01.188 INFO:teuthology.orchestra.run.smithi153.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-10T07:57:01.213 INFO:teuthology.orchestra.run.smithi153.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.6 MB/s | 191 kB 00:00 2024-09-10T07:57:01.239 INFO:teuthology.orchestra.run.smithi153.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-09-10T07:57:01.297 INFO:teuthology.orchestra.run.smithi153.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-10T07:57:01.378 INFO:teuthology.orchestra.run.smithi022.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 743 kB/s | 662 kB 00:00 2024-09-10T07:57:01.556 INFO:teuthology.orchestra.run.smithi153.stdout:(148/156): librados2-19.1.1-305.g1cf819b7.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-10T07:57:01.578 INFO:teuthology.orchestra.run.smithi022.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 670 kB/s | 581 kB 00:00 2024-09-10T07:57:01.648 INFO:teuthology.orchestra.run.smithi153.stdout:(149/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 9.0 MB/s | 3.2 MB 00:00 2024-09-10T07:57:01.732 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-10T07:57:01.748 INFO:teuthology.orchestra.run.smithi153.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-09-10T07:57:01.790 INFO:teuthology.orchestra.run.smithi153.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 983 kB/s | 41 kB 00:00 2024-09-10T07:57:01.849 INFO:teuthology.orchestra.run.smithi153.stdout:(152/156): NetworkManager-libnm-1.49.90-1.el9.x 9.0 MB/s | 1.8 MB 00:00 2024-09-10T07:57:01.874 INFO:teuthology.orchestra.run.smithi153.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.9 MB/s | 249 kB 00:00 2024-09-10T07:57:01.882 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-10T07:57:01.882 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-10T07:57:01.887 INFO:teuthology.orchestra.run.smithi022.stdout:(61/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.0 MB/s | 3.0 MB 00:03 2024-09-10T07:57:01.913 INFO:teuthology.orchestra.run.smithi022.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 46 kB/s | 24 kB 00:00 2024-09-10T07:57:01.916 INFO:teuthology.orchestra.run.smithi153.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-10T07:57:01.983 INFO:teuthology.orchestra.run.smithi153.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-10T07:57:02.204 INFO:teuthology.orchestra.run.smithi022.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-09-10T07:57:02.638 INFO:teuthology.orchestra.run.smithi022.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 260 kB/s | 188 kB 00:00 2024-09-10T07:57:02.689 INFO:teuthology.orchestra.run.smithi022.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 366 kB/s | 292 kB 00:00 2024-09-10T07:57:02.764 INFO:teuthology.orchestra.run.smithi022.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 69 kB/s | 38 kB 00:00 2024-09-10T07:57:03.691 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-10T07:57:03.692 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-10T07:57:03.716 INFO:teuthology.orchestra.run.smithi153.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.5 MB/s | 16 MB 00:04 2024-09-10T07:57:03.722 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-10T07:57:03.722 INFO:teuthology.orchestra.run.smithi153.stdout:Total 15 MB/s | 226 MB 00:15 2024-09-10T07:57:03.739 INFO:teuthology.orchestra.run.smithi022.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.5 MB/s | 4.9 MB 00:01 2024-09-10T07:57:03.781 INFO:teuthology.orchestra.run.smithi022.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.6 MB/s | 1.6 MB 00:01 2024-09-10T07:57:03.848 INFO:teuthology.orchestra.run.smithi022.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 4.4 MB 00:01 2024-09-10T07:57:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 194 kB/s | 137 kB 00:00 2024-09-10T07:57:04.673 INFO:teuthology.orchestra.run.smithi022.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 974 kB/s | 910 kB 00:00 2024-09-10T07:57:04.903 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-10T07:57:05.032 INFO:teuthology.orchestra.run.smithi022.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 4.9 MB/s | 5.8 MB 00:01 2024-09-10T07:57:05.057 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-10T07:57:05.057 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-10T07:57:05.390 INFO:teuthology.orchestra.run.smithi022.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 122 kB/s | 87 kB 00:00 2024-09-10T07:57:05.432 INFO:teuthology.orchestra.run.smithi022.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-10T07:57:06.016 INFO:teuthology.orchestra.run.smithi022.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 98 kB/s | 61 kB 00:00 2024-09-10T07:57:06.225 INFO:teuthology.orchestra.run.smithi022.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.0 MB/s | 6.0 MB 00:01 2024-09-10T07:57:06.249 INFO:teuthology.orchestra.run.smithi022.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 300 kB/s | 245 kB 00:00 2024-09-10T07:57:06.733 INFO:teuthology.orchestra.run.smithi022.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 40 kB/s | 19 kB 00:00 2024-09-10T07:57:06.775 INFO:teuthology.orchestra.run.smithi022.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 47 kB/s | 26 kB 00:00 2024-09-10T07:57:06.842 INFO:teuthology.orchestra.run.smithi022.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 301 kB/s | 248 kB 00:00 2024-09-10T07:57:06.887 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-10T07:57:06.888 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-10T07:57:07.326 INFO:teuthology.orchestra.run.smithi022.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-09-10T07:57:07.584 INFO:teuthology.orchestra.run.smithi022.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 202 kB/s | 172 kB 00:00 2024-09-10T07:57:08.009 INFO:teuthology.orchestra.run.smithi022.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.4 MB/s | 5.1 MB 00:01 2024-09-10T07:57:08.093 INFO:teuthology.orchestra.run.smithi022.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 327 kB/s | 250 kB 00:00 2024-09-10T07:57:08.327 INFO:teuthology.orchestra.run.smithi022.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 299 kB/s | 222 kB 00:00 2024-09-10T07:57:08.652 INFO:teuthology.orchestra.run.smithi022.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 120 kB/s | 77 kB 00:00 2024-09-10T07:57:08.719 INFO:teuthology.orchestra.run.smithi022.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 68 kB/s | 42 kB 00:00 2024-09-10T07:57:09.127 INFO:teuthology.orchestra.run.smithi022.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 340 kB/s | 269 kB 00:00 2024-09-10T07:57:09.369 INFO:teuthology.orchestra.run.smithi022.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 221 kB/s | 159 kB 00:00 2024-09-10T07:57:09.528 INFO:teuthology.orchestra.run.smithi022.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 345 kB/s | 279 kB 00:00 2024-09-10T07:57:09.845 INFO:teuthology.orchestra.run.smithi022.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 71 kB/s | 51 kB 00:00 2024-09-10T07:57:09.974 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-10T07:57:09.995 INFO:teuthology.orchestra.run.smithi022.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 87 kB/s | 54 kB 00:00 2024-09-10T07:57:10.074 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T07:57:10.209 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T07:57:10.408 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T07:57:10.420 INFO:teuthology.orchestra.run.smithi022.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2024-09-10T07:57:10.450 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T07:57:10.475 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T07:57:10.527 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T07:57:10.654 INFO:teuthology.orchestra.run.smithi022.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 67 kB/s | 44 kB 00:00 2024-09-10T07:57:10.858 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T07:57:10.959 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:57:11.080 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:57:11.102 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:57:11.193 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:57:11.223 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:57:11.346 INFO:teuthology.orchestra.run.smithi022.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.9 MB/s | 16 MB 00:01 2024-09-10T07:57:11.369 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T07:57:11.371 INFO:teuthology.orchestra.run.smithi022.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 51 kB/s | 36 kB 00:00 2024-09-10T07:57:11.397 INFO:teuthology.orchestra.run.smithi022.stdout:(97/156): qatlib-24.02.0-1.el9.x86_64.rpm 226 kB/s | 221 kB 00:00 2024-09-10T07:57:11.428 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T07:57:11.457 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:57:11.561 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:57:11.591 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:57:11.653 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:57:11.676 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:57:11.696 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:57:11.859 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:57:11.922 INFO:teuthology.orchestra.run.smithi022.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-10T07:57:11.989 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:57:11.997 INFO:teuthology.orchestra.run.smithi022.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 96 kB/s | 58 kB 00:00 2024-09-10T07:57:12.190 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T07:57:12.292 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:57:12.314 INFO:teuthology.orchestra.run.smithi022.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 323 kB/s | 304 kB 00:00 2024-09-10T07:57:12.375 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:57:12.597 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:57:12.606 INFO:teuthology.orchestra.run.smithi022.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 140 kB/s | 96 kB 00:00 2024-09-10T07:57:12.648 INFO:teuthology.orchestra.run.smithi022.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 98 kB/s | 64 kB 00:00 2024-09-10T07:57:12.708 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T07:57:12.723 INFO:teuthology.orchestra.run.smithi022.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 192 kB/s | 22 kB 00:00 2024-09-10T07:57:12.773 INFO:teuthology.orchestra.run.smithi022.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-10T07:57:12.798 INFO:teuthology.orchestra.run.smithi022.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-10T07:57:12.803 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T07:57:12.824 INFO:teuthology.orchestra.run.smithi022.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-10T07:57:12.838 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T07:57:12.873 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T07:57:12.874 INFO:teuthology.orchestra.run.smithi022.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-10T07:57:12.908 INFO:teuthology.orchestra.run.smithi022.stdout:(108/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 76 kB/s | 45 kB 00:00 2024-09-10T07:57:12.941 INFO:teuthology.orchestra.run.smithi022.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-09-10T07:57:12.947 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T07:57:12.967 INFO:teuthology.orchestra.run.smithi022.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-10T07:57:12.991 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T07:57:12.992 INFO:teuthology.orchestra.run.smithi022.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 594 kB/s | 49 kB 00:00 2024-09-10T07:57:13.017 INFO:teuthology.orchestra.run.smithi022.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-10T07:57:13.031 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T07:57:13.059 INFO:teuthology.orchestra.run.smithi022.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-10T07:57:13.075 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T07:57:13.084 INFO:teuthology.orchestra.run.smithi022.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-10T07:57:13.107 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T07:57:13.109 INFO:teuthology.orchestra.run.smithi022.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T07:57:13.135 INFO:teuthology.orchestra.run.smithi022.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-10T07:57:13.135 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T07:57:13.160 INFO:teuthology.orchestra.run.smithi022.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-10T07:57:13.185 INFO:teuthology.orchestra.run.smithi022.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-10T07:57:13.205 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T07:57:13.227 INFO:teuthology.orchestra.run.smithi022.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-10T07:57:13.253 INFO:teuthology.orchestra.run.smithi022.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T07:57:13.258 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T07:57:13.278 INFO:teuthology.orchestra.run.smithi022.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-10T07:57:13.296 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T07:57:13.320 INFO:teuthology.orchestra.run.smithi022.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-10T07:57:13.332 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T07:57:13.345 INFO:teuthology.orchestra.run.smithi022.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-10T07:57:13.371 INFO:teuthology.orchestra.run.smithi022.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-10T07:57:13.396 INFO:teuthology.orchestra.run.smithi022.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-10T07:57:13.407 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T07:57:13.421 INFO:teuthology.orchestra.run.smithi022.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 784 kB/s | 19 kB 00:00 2024-09-10T07:57:13.442 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T07:57:13.447 INFO:teuthology.orchestra.run.smithi022.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 784 kB/s | 20 kB 00:00 2024-09-10T07:57:13.454 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-10T07:57:13.485 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T07:57:13.514 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T07:57:13.522 INFO:teuthology.orchestra.run.smithi022.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.3 MB/s | 4.4 MB 00:00 2024-09-10T07:57:13.547 INFO:teuthology.orchestra.run.smithi022.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T07:57:13.573 INFO:teuthology.orchestra.run.smithi022.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T07:57:13.584 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T07:57:13.595 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T07:57:13.598 INFO:teuthology.orchestra.run.smithi022.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T07:57:13.630 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T07:57:13.633 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T07:57:13.648 INFO:teuthology.orchestra.run.smithi022.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.2 MB/s | 2.0 MB 00:00 2024-09-10T07:57:13.673 INFO:teuthology.orchestra.run.smithi022.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-10T07:57:13.686 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T07:57:13.707 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T07:57:13.715 INFO:teuthology.orchestra.run.smithi022.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2024-09-10T07:57:13.729 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T07:57:13.741 INFO:teuthology.orchestra.run.smithi022.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-09-10T07:57:13.763 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T07:57:13.766 INFO:teuthology.orchestra.run.smithi022.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 976 kB/s | 90 kB 00:00 2024-09-10T07:57:13.791 INFO:teuthology.orchestra.run.smithi022.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 373 kB/s | 28 kB 00:00 2024-09-10T07:57:13.814 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T07:57:13.816 INFO:teuthology.orchestra.run.smithi022.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-09-10T07:57:13.840 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T07:57:13.842 INFO:teuthology.orchestra.run.smithi022.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-10T07:57:13.867 INFO:teuthology.orchestra.run.smithi022.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-10T07:57:13.892 INFO:teuthology.orchestra.run.smithi022.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-10T07:57:13.902 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T07:57:13.917 INFO:teuthology.orchestra.run.smithi022.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-10T07:57:13.943 INFO:teuthology.orchestra.run.smithi022.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T07:57:13.968 INFO:teuthology.orchestra.run.smithi022.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T07:57:13.993 INFO:teuthology.orchestra.run.smithi022.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-10T07:57:14.019 INFO:teuthology.orchestra.run.smithi022.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T07:57:14.044 INFO:teuthology.orchestra.run.smithi022.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T07:57:14.094 INFO:teuthology.orchestra.run.smithi022.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-10T07:57:14.145 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T07:57:14.255 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:57:14.295 INFO:teuthology.orchestra.run.smithi022.stdout:(149/156): librados2-19.1.1-305.g1cf819b7.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-10T07:57:14.376 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:57:14.398 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:57:14.427 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T07:57:14.428 INFO:teuthology.orchestra.run.smithi022.stdout:(150/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 8.2 MB/s | 3.2 MB 00:00 2024-09-10T07:57:14.489 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:57:14.514 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T07:57:14.521 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:57:14.536 INFO:teuthology.orchestra.run.smithi022.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 376 kB/s | 41 kB 00:00 2024-09-10T07:57:14.543 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T07:57:14.586 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T07:57:14.624 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T07:57:14.665 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T07:57:14.679 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T07:57:14.687 INFO:teuthology.orchestra.run.smithi022.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 1.6 MB/s | 249 kB 00:00 2024-09-10T07:57:14.732 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T07:57:14.761 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:57:14.824 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T07:57:14.864 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:57:14.895 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:57:14.902 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T07:57:14.946 INFO:teuthology.orchestra.run.smithi022.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 2.8 MB/s | 1.8 MB 00:00 2024-09-10T07:57:14.956 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T07:57:14.958 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:57:14.979 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:57:14.996 INFO:teuthology.orchestra.run.smithi022.stdout:(154/156): NetworkManager-1.49.90-1.el9.x86_64. 2.6 MB/s | 2.3 MB 00:00 2024-09-10T07:57:14.999 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:57:15.031 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T07:57:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T07:57:15.071 INFO:teuthology.orchestra.run.smithi022.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 1.4 MB 00:00 2024-09-10T07:57:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T07:57:15.139 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:57:15.144 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T07:57:15.201 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T07:57:15.249 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T07:57:15.285 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:57:15.291 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T07:57:15.427 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T07:57:15.453 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T07:57:15.467 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T07:57:15.509 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T07:57:15.545 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:57:15.614 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T07:57:15.646 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:57:15.865 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:57:15.899 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T07:57:15.976 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T07:57:15.978 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T07:57:16.010 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T07:57:16.035 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T07:57:16.072 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T07:57:16.101 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T07:57:16.104 INFO:teuthology.orchestra.run.smithi022.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-09-10T07:57:16.112 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-10T07:57:16.112 INFO:teuthology.orchestra.run.smithi022.stdout:Total 9.3 MB/s | 226 MB 00:24 2024-09-10T07:57:16.116 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T07:57:16.144 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T07:57:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T07:57:16.249 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T07:57:16.262 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T07:57:16.292 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T07:57:16.301 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T07:57:16.319 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T07:57:16.345 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T07:57:16.362 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T07:57:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T07:57:16.402 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T07:57:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T07:57:16.433 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T07:57:16.463 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T07:57:16.483 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T07:57:16.498 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T07:57:16.531 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T07:57:16.536 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T07:57:16.567 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T07:57:16.573 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T07:57:16.607 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T07:57:16.610 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T07:57:16.687 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T07:57:16.697 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T07:57:16.716 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T07:57:16.759 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T07:57:16.797 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T07:57:16.867 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T07:57:16.928 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T07:57:16.978 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T07:57:17.004 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T07:57:17.069 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T07:57:17.136 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T07:57:17.173 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T07:57:17.190 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T07:57:17.229 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T07:57:17.329 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-09-10T07:57:17.499 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-09-10T07:57:17.499 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-09-10T07:57:17.718 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T07:57:17.802 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T07:57:17.830 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T07:57:17.872 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T07:57:17.911 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T07:57:17.951 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T07:57:17.953 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T07:57:18.000 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T07:57:18.034 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T07:57:18.124 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T07:57:18.133 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T07:57:18.180 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T07:57:18.189 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T07:57:18.233 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T07:57:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T07:57:18.321 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T07:57:18.333 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T07:57:18.362 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T07:57:18.365 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T07:57:18.423 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T07:57:18.473 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T07:57:18.509 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T07:57:18.552 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T07:57:18.563 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T07:57:18.593 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T07:57:18.609 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T07:57:18.687 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T07:57:18.738 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T07:57:18.787 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T07:57:18.829 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T07:57:18.932 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T07:57:19.129 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T07:57:19.244 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T07:57:19.269 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T07:57:19.294 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T07:57:19.330 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T07:57:19.371 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T07:57:19.441 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T07:57:19.496 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T07:57:19.528 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T07:57:19.556 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T07:57:19.590 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T07:57:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T07:57:19.661 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T07:57:19.691 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T07:57:19.725 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T07:57:19.758 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T07:57:19.800 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T07:57:19.814 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-09-10T07:57:19.814 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-09-10T07:57:19.843 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T07:57:19.939 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T07:57:19.990 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T07:57:20.021 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T07:57:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T07:57:20.180 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T07:57:20.672 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T07:57:20.765 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T07:57:20.793 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T07:57:20.826 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T07:57:20.910 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T07:57:20.969 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T07:57:21.003 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T07:57:21.106 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T07:57:21.136 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T07:57:21.158 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T07:57:21.181 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:57:21.203 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T07:57:21.263 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:57:21.292 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T07:57:21.294 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T07:57:21.330 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T07:57:21.338 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T07:57:21.525 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T07:57:21.570 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T07:57:21.647 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T07:57:21.813 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T07:57:21.842 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:57:21.913 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:57:21.944 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T07:57:22.300 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T07:57:22.409 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T07:57:23.651 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T07:57:23.748 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T07:57:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T07:57:23.808 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T07:57:24.117 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T07:57:24.163 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:57:24.252 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:57:24.285 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T07:57:24.320 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T07:57:24.583 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:57:24.623 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:57:24.808 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T07:57:24.850 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:57:24.912 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:57:24.943 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T07:57:25.165 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:57:25.202 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:57:25.277 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:57:25.277 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T07:57:25.277 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T07:57:25.277 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:57:25.312 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:57:26.655 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-09-10T07:57:26.800 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T07:57:26.847 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T07:57:26.901 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T07:57:26.935 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T07:57:26.959 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T07:57:27.016 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T07:57:27.360 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T07:57:27.461 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:57:27.572 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:57:27.611 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:57:27.614 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:57:27.637 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:57:27.729 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:57:27.760 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:57:27.934 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T07:57:27.990 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T07:57:28.017 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:57:28.127 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:57:28.152 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:57:28.157 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:57:28.192 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:57:28.215 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T07:57:28.244 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:57:28.270 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T07:57:28.287 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:57:28.287 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T07:57:28.288 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T07:57:28.288 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:57:28.319 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:57:28.423 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:57:28.584 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T07:57:28.701 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T07:57:28.814 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:57:28.877 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:57:29.103 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T07:57:29.221 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T07:57:29.317 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T07:57:29.350 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T07:57:29.385 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T07:57:29.461 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T07:57:29.520 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T07:57:29.560 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T07:57:29.611 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T07:57:29.644 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T07:57:29.671 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T07:57:29.744 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T07:57:29.796 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T07:57:29.824 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T07:57:29.860 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T07:57:29.947 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T07:57:29.979 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T07:57:30.023 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T07:57:30.051 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T07:57:30.127 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T07:57:30.174 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T07:57:30.253 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T07:57:30.402 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T07:57:30.453 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T07:57:31.030 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T07:57:31.109 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T07:57:31.143 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T07:57:31.197 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T07:57:31.232 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T07:57:31.292 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T07:57:31.458 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T07:57:31.510 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T07:57:31.567 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T07:57:31.641 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T07:57:31.677 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T07:57:31.714 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T07:57:31.762 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T07:57:31.805 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T07:57:31.849 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T07:57:31.891 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T07:57:32.036 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T07:57:32.077 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T07:57:32.126 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T07:57:32.234 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T07:57:32.266 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T07:57:32.307 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T07:57:32.348 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T07:57:32.373 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T07:57:32.471 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T07:57:32.606 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T07:57:32.647 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T07:57:32.675 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T07:57:32.718 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T07:57:32.757 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T07:57:32.797 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T07:57:32.827 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T07:57:32.861 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T07:57:32.894 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T07:57:32.937 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T07:57:32.971 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T07:57:33.063 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T07:57:33.110 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T07:57:33.141 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T07:57:33.250 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T07:57:33.305 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T07:57:34.092 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T07:57:34.150 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T07:57:34.184 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T07:57:34.289 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T07:57:34.340 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T07:57:34.386 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T07:57:34.477 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T07:57:34.511 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T07:57:34.704 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T07:57:34.734 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T07:57:34.820 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T07:57:35.528 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T07:57:35.646 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T07:57:36.996 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T07:57:37.092 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T07:57:37.103 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:57:37.103 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-09-10T07:57:37.103 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-09-10T07:57:37.103 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-09-10T07:57:37.103 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-09-10T07:57:37.103 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-09-10T07:57:37.103 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-09-10T07:57:37.103 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-09-10T07:57:37.103 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:57:37.122 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T07:57:37.151 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T07:57:37.283 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:57:37.299 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:57:37.299 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:37.299 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T07:57:37.299 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:57:37.478 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T07:57:37.530 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:57:37.613 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T07:57:37.652 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T07:57:37.688 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T07:57:38.196 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T07:57:38.293 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:57:38.313 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T07:57:38.343 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T07:57:38.744 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:57:38.771 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:57:38.771 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:38.771 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T07:57:38.771 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:57:38.771 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:57:38.771 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:57:38.994 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:57:39.018 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:57:39.018 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:39.018 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T07:57:39.019 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:57:39.019 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:57:39.019 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:57:39.445 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:57:39.469 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:57:39.469 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:39.469 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T07:57:39.469 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:57:39.469 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:57:39.469 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:57:39.575 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T07:57:39.632 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T07:57:39.688 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T07:57:39.874 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T07:57:39.921 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T07:57:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:57:39.970 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-09-10T07:57:39.970 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-09-10T07:57:39.970 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-09-10T07:57:39.970 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-09-10T07:57:39.970 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-09-10T07:57:39.970 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /root 2024-09-10T07:57:39.970 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-09-10T07:57:39.970 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:57:39.999 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T07:57:40.087 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T07:57:40.154 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:57:40.169 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:57:40.170 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:40.170 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T07:57:40.170 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:57:40.226 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T07:57:40.280 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T07:57:40.311 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T07:57:40.339 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T07:57:40.744 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:57:40.776 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:57:40.789 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:57:40.813 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:57:40.836 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T07:57:40.908 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T07:57:40.936 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:57:41.368 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T07:57:41.409 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:57:41.502 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T07:57:41.503 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T07:57:41.503 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T07:57:41.503 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:57:41.535 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:57:41.649 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:57:41.675 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:57:41.676 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:41.676 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T07:57:41.676 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:57:41.676 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:57:41.676 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:57:41.907 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:57:41.930 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:57:41.931 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:41.931 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T07:57:41.931 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:57:41.931 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:57:41.931 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:57:41.981 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:57:42.013 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:57:42.367 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:57:42.390 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:57:42.390 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:42.390 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T07:57:42.390 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:57:42.390 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:57:42.390 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:57:42.497 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T07:57:42.554 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T07:57:42.609 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T07:57:42.797 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T07:57:42.850 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T07:57:42.930 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T07:57:42.976 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:57:43.004 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:57:43.018 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T07:57:43.108 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:57:43.161 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T07:57:43.209 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T07:57:43.250 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T07:57:43.274 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T07:57:43.290 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T07:57:43.293 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:57:43.320 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:57:43.320 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:43.320 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T07:57:43.321 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:57:43.321 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:57:43.321 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:57:43.368 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:57:43.397 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:57:43.490 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T07:57:43.532 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T07:57:43.714 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:57:43.742 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:57:43.773 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T07:57:43.837 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T07:57:43.865 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:57:44.463 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T07:57:44.502 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:57:44.526 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:57:44.526 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:44.526 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T07:57:44.526 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:57:44.527 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:57:44.527 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:57:44.569 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:57:44.593 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:57:44.593 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:44.593 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T07:57:44.593 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:57:44.645 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:57:44.668 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:57:44.669 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:44.669 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T07:57:44.669 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:57:44.669 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:57:44.669 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:57:44.928 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:57:44.967 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:57:44.970 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:57:44.995 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:57:44.995 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:44.995 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T07:57:44.995 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:57:44.995 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:57:44.995 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:57:45.944 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:57:45.975 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:57:46.079 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:57:46.238 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T07:57:46.269 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:57:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:57:46.293 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:46.293 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T07:57:46.293 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:57:46.293 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:57:46.293 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:57:46.345 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:57:46.356 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:57:46.458 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T07:57:46.510 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T07:57:47.450 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T07:57:47.489 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:57:47.512 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:57:47.512 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:47.512 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T07:57:47.512 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:57:47.512 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:57:47.513 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:57:47.556 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:57:47.579 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:57:47.579 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:47.579 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T07:57:47.579 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:57:47.624 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:57:47.646 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:57:47.647 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:47.647 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T07:57:47.647 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:57:47.647 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:57:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:57:47.949 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:57:47.972 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:57:47.972 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:47.972 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T07:57:47.972 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:57:47.973 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:57:47.973 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:57:49.507 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T07:57:49.548 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T07:57:49.598 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T07:57:49.630 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T07:57:49.657 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T07:57:49.837 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T07:57:49.879 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T07:57:49.909 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T07:57:49.939 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T07:57:49.985 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T07:57:50.554 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:57:50.592 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:57:50.613 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:57:51.449 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T07:57:51.538 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T07:57:51.579 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T07:57:51.661 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T07:57:51.691 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T07:57:51.716 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T07:57:51.742 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T07:57:51.742 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:57:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:57:51.835 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:57:51.919 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:57:51.944 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T07:57:51.950 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:57:51.950 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:57:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:57:52.121 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:57:52.205 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:57:52.268 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:57:52.528 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T07:57:52.569 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T07:57:52.619 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T07:57:52.659 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T07:57:52.703 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T07:57:52.887 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T07:57:52.924 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T07:57:52.972 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T07:57:53.010 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T07:57:53.056 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T07:57:53.567 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T07:57:53.567 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2024-09-10T07:57:53.567 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2024-09-10T07:57:53.567 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2024-09-10T07:57:53.567 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2024-09-10T07:57:53.567 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2024-09-10T07:57:53.568 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /root 2024-09-10T07:57:53.568 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2024-09-10T07:57:53.568 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:57:53.656 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:57:53.695 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:57:53.715 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:57:53.739 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:57:53.755 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T07:57:53.756 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:53.756 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T07:57:53.756 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:57:54.581 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T07:57:54.674 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T07:57:54.716 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T07:57:54.798 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T07:57:54.836 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T07:57:54.861 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T07:57:54.887 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T07:57:54.887 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:57:54.954 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:57:54.954 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:57:55.021 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:57:55.046 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T07:57:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:57:55.051 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:57:55.232 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:57:55.232 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:57:55.292 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:57:55.321 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T07:57:55.321 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:55.321 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T07:57:55.321 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:57:55.321 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T07:57:55.321 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:57:55.341 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:57:55.403 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:57:55.561 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:57:55.586 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T07:57:55.586 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:55.586 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T07:57:55.586 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:57:55.586 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T07:57:55.586 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:57:56.054 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:57:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T07:57:56.078 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:57:56.078 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T07:57:56.079 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:57:56.079 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T07:57:56.079 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:57:56.185 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T07:57:56.244 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T07:57:56.307 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T07:57:56.515 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T07:57:56.564 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T07:57:56.646 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T07:57:56.744 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T07:57:56.897 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T07:57:56.954 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T07:57:56.989 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T07:57:57.014 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T07:57:57.511 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:57:57.538 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T07:57:57.570 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T07:57:57.636 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T07:57:57.661 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:57:57.952 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:57:57.952 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T07:57:57.952 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T07:57:57.952 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T07:57:57.952 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T07:57:57.953 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T07:57:57.953 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T07:57:57.953 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T07:57:57.953 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:57:57.953 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:57:57.953 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:57:57.953 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T07:57:57.953 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T07:57:57.953 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:57:57.954 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T07:57:57.954 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T07:57:57.954 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T07:57:57.954 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T07:57:57.954 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T07:57:57.954 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T07:57:57.954 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T07:57:57.954 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T07:57:57.954 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T07:57:57.954 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T07:57:57.954 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T07:57:57.954 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T07:57:57.955 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T07:57:57.955 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T07:57:57.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T07:57:57.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T07:57:57.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T07:57:57.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T07:57:57.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T07:57:57.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T07:57:57.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T07:57:57.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T07:57:57.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T07:57:57.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T07:57:57.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T07:57:57.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T07:57:57.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T07:57:57.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T07:57:57.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T07:57:57.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T07:57:57.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T07:57:57.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T07:57:57.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T07:57:57.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T07:57:57.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T07:57:57.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T07:57:57.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T07:57:57.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T07:57:57.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T07:57:57.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T07:57:57.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T07:57:57.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T07:57:57.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T07:57:57.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T07:57:57.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T07:57:57.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T07:57:57.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T07:57:57.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T07:57:57.971 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T07:57:57.971 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T07:57:57.971 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T07:57:57.971 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T07:57:57.971 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T07:57:57.971 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T07:57:57.971 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T07:57:57.971 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T07:57:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T07:57:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T07:57:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T07:57:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T07:57:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T07:57:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T07:57:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T07:57:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T07:57:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T07:57:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T07:57:57.972 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T07:57:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T07:57:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T07:57:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T07:57:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T07:57:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T07:57:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T07:57:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T07:57:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T07:57:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T07:57:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T07:57:57.973 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T07:57:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T07:57:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T07:57:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T07:57:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T07:57:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T07:57:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T07:57:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T07:57:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T07:57:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T07:57:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T07:57:57.974 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T07:57:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T07:57:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T07:57:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T07:57:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T07:57:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T07:57:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T07:57:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T07:57:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T07:57:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T07:57:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T07:57:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T07:57:57.975 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T07:57:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T07:57:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T07:57:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T07:57:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T07:57:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T07:57:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T07:57:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T07:57:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T07:57:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T07:57:57.976 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T07:57:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T07:57:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T07:57:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T07:57:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T07:57:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T07:57:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T07:57:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T07:57:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T07:57:57.977 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T07:57:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T07:57:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T07:57:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T07:57:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T07:57:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T07:57:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T07:57:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T07:57:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T07:57:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T07:57:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T07:57:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T07:57:57.978 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T07:57:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T07:57:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T07:57:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T07:57:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T07:57:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T07:57:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T07:57:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T07:57:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T07:57:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T07:57:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T07:57:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T07:57:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T07:57:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T07:57:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T07:57:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T07:57:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T07:57:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T07:57:57.980 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T07:57:58.775 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T07:57:58.813 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:57:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T07:57:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:57:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T07:58:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T07:58:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:58:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T07:58:00.207 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:58:00.207 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T07:58:00.207 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:58:00.207 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T07:58:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:58:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:58:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T07:58:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T07:58:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T07:58:00.575 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:58:00.575 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:58:00.575 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-09-10T07:58:00.575 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T07:58:00.575 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T07:58:00.575 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T07:58:00.575 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T07:58:00.575 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.576 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:00.577 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.577 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.577 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.577 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:00.577 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:00.577 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:00.577 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:00.577 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:00.577 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.577 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T07:58:00.578 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T07:58:00.579 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T07:58:00.579 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T07:58:00.579 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T07:58:00.579 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T07:58:00.579 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T07:58:00.579 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T07:58:00.579 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T07:58:00.579 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T07:58:00.579 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T07:58:00.579 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.579 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.579 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.580 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T07:58:00.580 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T07:58:00.580 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T07:58:00.580 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T07:58:00.580 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T07:58:00.580 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.580 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.580 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T07:58:00.580 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.580 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T07:58:00.581 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T07:58:00.581 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T07:58:00.581 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T07:58:00.581 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T07:58:00.581 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T07:58:00.581 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T07:58:00.581 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T07:58:00.581 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T07:58:00.581 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T07:58:00.581 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T07:58:00.581 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T07:58:00.582 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T07:58:00.582 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T07:58:00.582 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T07:58:00.582 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T07:58:00.582 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T07:58:00.582 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T07:58:00.582 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T07:58:00.582 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T07:58:00.582 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T07:58:00.582 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T07:58:00.582 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T07:58:00.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T07:58:00.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T07:58:00.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T07:58:00.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T07:58:00.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T07:58:00.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T07:58:00.583 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T07:58:00.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T07:58:00.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T07:58:00.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T07:58:00.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T07:58:00.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T07:58:00.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T07:58:00.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T07:58:00.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T07:58:00.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T07:58:00.584 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T07:58:00.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T07:58:00.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T07:58:00.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T07:58:00.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T07:58:00.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T07:58:00.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T07:58:00.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T07:58:00.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T07:58:00.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T07:58:00.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T07:58:00.585 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T07:58:00.586 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T07:58:00.586 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T07:58:00.586 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T07:58:00.586 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T07:58:00.586 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T07:58:00.586 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T07:58:00.586 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T07:58:00.586 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T07:58:00.586 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T07:58:00.586 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T07:58:00.586 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T07:58:00.587 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T07:58:00.587 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.587 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.587 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T07:58:00.587 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T07:58:00.587 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T07:58:00.587 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.587 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T07:58:00.587 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T07:58:00.587 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T07:58:00.587 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T07:58:00.588 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T07:58:00.588 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T07:58:00.588 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T07:58:00.588 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T07:58:00.588 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T07:58:00.588 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T07:58:00.588 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T07:58:00.588 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T07:58:00.588 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T07:58:00.588 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T07:58:00.588 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T07:58:00.589 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.589 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.589 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:00.589 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T07:58:00.589 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T07:58:00.589 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T07:58:00.589 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T07:58:00.589 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T07:58:00.589 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T07:58:00.590 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T07:58:00.590 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T07:58:00.590 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-10T07:58:00.985 DEBUG:teuthology.parallel:result is None 2024-09-10T07:58:01.098 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:58:01.098 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T07:58:01.098 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T07:58:01.098 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T07:58:01.098 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T07:58:01.098 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T07:58:01.099 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T07:58:01.100 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T07:58:01.100 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T07:58:01.100 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T07:58:01.100 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T07:58:01.100 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T07:58:01.100 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T07:58:01.100 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T07:58:01.100 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T07:58:01.100 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T07:58:01.100 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T07:58:01.101 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T07:58:01.101 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T07:58:01.101 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T07:58:01.101 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T07:58:01.101 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T07:58:01.101 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T07:58:01.101 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T07:58:01.101 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T07:58:01.101 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T07:58:01.101 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T07:58:01.101 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T07:58:01.102 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T07:58:01.102 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T07:58:01.102 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T07:58:01.102 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T07:58:01.102 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T07:58:01.102 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T07:58:01.102 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T07:58:01.102 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T07:58:01.102 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T07:58:01.102 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T07:58:01.102 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T07:58:01.102 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T07:58:01.103 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T07:58:01.103 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T07:58:01.103 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T07:58:01.103 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T07:58:01.103 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T07:58:01.103 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T07:58:01.103 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T07:58:01.103 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T07:58:01.103 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T07:58:01.103 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T07:58:01.103 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T07:58:01.103 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T07:58:01.104 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T07:58:01.104 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T07:58:01.104 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T07:58:01.104 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T07:58:01.104 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T07:58:01.104 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T07:58:01.104 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T07:58:01.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T07:58:01.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T07:58:01.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T07:58:01.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T07:58:01.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T07:58:01.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T07:58:01.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T07:58:01.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T07:58:01.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T07:58:01.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T07:58:01.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T07:58:01.105 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T07:58:01.106 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T07:58:01.107 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T07:58:01.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T07:58:01.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T07:58:01.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T07:58:01.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T07:58:01.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T07:58:01.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T07:58:01.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T07:58:01.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T07:58:01.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T07:58:01.108 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T07:58:01.109 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T07:58:01.110 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T07:58:01.111 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T07:58:01.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T07:58:01.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T07:58:01.112 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T07:58:01.410 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T07:58:01.443 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:58:01.468 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T07:58:01.469 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:58:01.469 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T07:58:01.469 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:58:01.469 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T07:58:01.469 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:58:01.511 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:58:01.535 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T07:58:01.535 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:58:01.536 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T07:58:01.536 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:58:01.586 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:58:01.611 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T07:58:01.611 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:58:01.611 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T07:58:01.611 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:58:01.612 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T07:58:01.612 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:58:01.937 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:58:01.962 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T07:58:01.963 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T07:58:01.963 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T07:58:01.963 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:58:01.963 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T07:58:01.963 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:58:03.941 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:58:03.941 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:58:03.941 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-09-10T07:58:03.941 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T07:58:03.941 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T07:58:03.941 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T07:58:03.941 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T07:58:03.942 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.942 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.942 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T07:58:03.942 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T07:58:03.942 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-10T07:58:03.942 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T07:58:03.942 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T07:58:03.942 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T07:58:03.942 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T07:58:03.942 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.942 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.942 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.943 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.944 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:03.944 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.944 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.944 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.944 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:03.944 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:03.944 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.944 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.944 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:03.944 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T07:58:03.944 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T07:58:03.944 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T07:58:03.945 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T07:58:03.946 INFO:teuthology.orchestra.run.smithi153.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T07:58:03.947 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T07:58:03.947 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T07:58:03.947 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T07:58:03.947 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T07:58:03.947 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T07:58:03.947 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T07:58:03.947 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T07:58:03.947 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T07:58:03.947 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T07:58:03.947 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T07:58:03.947 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T07:58:03.948 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T07:58:03.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T07:58:03.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T07:58:03.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T07:58:03.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T07:58:03.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T07:58:03.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T07:58:03.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T07:58:03.948 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T07:58:03.949 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T07:58:03.950 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.951 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T07:58:03.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T07:58:03.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T07:58:03.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T07:58:03.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T07:58:03.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T07:58:03.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T07:58:03.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T07:58:03.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T07:58:03.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T07:58:03.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T07:58:03.952 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T07:58:03.953 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T07:58:03.953 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T07:58:03.953 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T07:58:03.953 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T07:58:03.953 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T07:58:03.953 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T07:58:03.953 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.953 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.953 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:03.953 INFO:teuthology.orchestra.run.smithi153.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T07:58:03.953 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T07:58:03.953 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T07:58:03.954 INFO:teuthology.orchestra.run.smithi153.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T07:58:03.954 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T07:58:03.954 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T07:58:03.954 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T07:58:03.954 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T07:58:03.954 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-10T07:58:04.344 DEBUG:teuthology.parallel:result is None 2024-09-10T07:58:06.833 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T07:58:06.875 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T07:58:06.916 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T07:58:06.947 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T07:58:06.974 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T07:58:07.189 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T07:58:07.229 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T07:58:07.260 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T07:58:07.289 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T07:58:07.335 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T07:58:07.974 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:58:08.008 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:58:08.030 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T07:58:08.949 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T07:58:09.030 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T07:58:09.309 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T07:58:09.309 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T07:58:09.309 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T07:58:09.310 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T07:58:09.310 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T07:58:09.310 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:58:09.361 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T07:58:09.361 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:58:09.444 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T07:58:09.469 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T07:58:09.475 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:58:09.475 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:58:09.663 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T07:58:09.663 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:58:09.731 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T07:58:09.798 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:58:15.252 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:58:15.252 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T07:58:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T07:58:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T07:58:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T07:58:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T07:58:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T07:58:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T07:58:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T07:58:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T07:58:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T07:58:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T07:58:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T07:58:15.253 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T07:58:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T07:58:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T07:58:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T07:58:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T07:58:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T07:58:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T07:58:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T07:58:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T07:58:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T07:58:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T07:58:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T07:58:15.254 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T07:58:15.255 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T07:58:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T07:58:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T07:58:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T07:58:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T07:58:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T07:58:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T07:58:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T07:58:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T07:58:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T07:58:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T07:58:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T07:58:15.256 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T07:58:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T07:58:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T07:58:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T07:58:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T07:58:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T07:58:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T07:58:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T07:58:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T07:58:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T07:58:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T07:58:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T07:58:15.257 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T07:58:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T07:58:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T07:58:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T07:58:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T07:58:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T07:58:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T07:58:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T07:58:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T07:58:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T07:58:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T07:58:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T07:58:15.258 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T07:58:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T07:58:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T07:58:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T07:58:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T07:58:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T07:58:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T07:58:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T07:58:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T07:58:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T07:58:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T07:58:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T07:58:15.259 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T07:58:15.260 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T07:58:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T07:58:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T07:58:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T07:58:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T07:58:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T07:58:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T07:58:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T07:58:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T07:58:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T07:58:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T07:58:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T07:58:15.261 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T07:58:15.262 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T07:58:15.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T07:58:15.264 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T07:58:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T07:58:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T07:58:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T07:58:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T07:58:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T07:58:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T07:58:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T07:58:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T07:58:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T07:58:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T07:58:15.265 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T07:58:17.829 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T07:58:17.829 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:58:17.829 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2024-09-10T07:58:17.829 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T07:58:17.829 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T07:58:17.829 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T07:58:17.829 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T07:58:17.829 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.830 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:17.831 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.832 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.832 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.832 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:17.832 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:17.832 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.832 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.832 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T07:58:17.832 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T07:58:17.832 INFO:teuthology.orchestra.run.smithi022.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T07:58:17.832 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T07:58:17.832 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T07:58:17.832 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T07:58:17.833 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T07:58:17.833 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T07:58:17.833 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T07:58:17.833 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T07:58:17.833 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T07:58:17.833 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T07:58:17.833 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.833 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.833 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.833 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T07:58:17.833 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T07:58:17.834 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T07:58:17.834 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T07:58:17.834 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T07:58:17.834 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.834 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.834 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T07:58:17.834 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.834 INFO:teuthology.orchestra.run.smithi022.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T07:58:17.834 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T07:58:17.834 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T07:58:17.834 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T07:58:17.835 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T07:58:17.836 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T07:58:17.836 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T07:58:17.836 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T07:58:17.836 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T07:58:17.836 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T07:58:17.836 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T07:58:17.836 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.836 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.836 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.836 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T07:58:17.836 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T07:58:17.837 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T07:58:17.838 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T07:58:17.839 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T07:58:17.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T07:58:17.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T07:58:17.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T07:58:17.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T07:58:17.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T07:58:17.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T07:58:17.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T07:58:17.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T07:58:17.840 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T07:58:17.841 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T07:58:17.842 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T07:58:17.842 INFO:teuthology.orchestra.run.smithi022.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T07:58:17.842 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T07:58:17.842 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T07:58:17.842 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T07:58:17.842 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:58:17.842 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-09-10T07:58:18.251 DEBUG:teuthology.parallel:result is None 2024-09-10T07:58:18.252 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:58:18.393 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T07:58:18.417 INFO:teuthology.orchestra.run.smithi022.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T07:58:18.418 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T07:58:18.418 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T07:58:18.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:58:18.567 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T07:58:18.594 INFO:teuthology.orchestra.run.smithi100.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T07:58:18.594 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T07:58:18.594 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T07:58:18.596 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:58:18.731 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T07:58:18.758 INFO:teuthology.orchestra.run.smithi153.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T07:58:18.759 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T07:58:18.759 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T07:58:18.761 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T07:58:18.761 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T07:58:18.761 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T07:58:18.794 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T07:58:18.794 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T07:58:18.827 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-10T07:58:18.827 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T07:58:18.859 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T07:58:18.860 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T07:58:18.860 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T07:58:18.890 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T07:58:18.958 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T07:58:18.959 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T07:58:18.989 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T07:58:19.057 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-10T07:58:19.058 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T07:58:19.088 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T07:58:19.157 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T07:58:19.157 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T07:58:19.157 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T07:58:19.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T07:58:19.258 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T07:58:19.258 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T07:58:19.287 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T07:58:19.357 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-10T07:58:19.357 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T07:58:19.383 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T07:58:19.447 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T07:58:19.447 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T07:58:19.447 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T07:58:19.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T07:58:19.549 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T07:58:19.550 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T07:58:19.580 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T07:58:19.649 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-10T07:58:19.649 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T07:58:19.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T07:58:19.739 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T07:58:19.840 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-10T07:58:19.840 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:58:19.840 INFO:tasks.cephadm:Cluster fsid is 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:58:19.840 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T07:58:19.841 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.22', 'mon.b': '172.21.15.100', 'mon.c': '172.21.15.153'} 2024-09-10T07:58:19.841 INFO:tasks.cephadm:First mon is mon.a on smithi022 2024-09-10T07:58:19.841 INFO:tasks.cephadm:First mgr is x 2024-09-10T07:58:19.841 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T07:58:19.841 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname $(hostname -s) 2024-09-10T07:58:19.873 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname $(hostname -s) 2024-09-10T07:58:19.902 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname $(hostname -s) 2024-09-10T07:58:19.928 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T07:58:19.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:58:20.069 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82914/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:14:38.445020', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82912/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-305-g1cf819b7', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-305.g1cf819b7'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-09 22:05:03.996701', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240909.165402-squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-10T07:58:20.208 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240909.165402-squid, sha1 1cf819b7212a6048e92fc78c4eff963344f6d56b from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:58:20.209 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm 2024-09-10T07:58:20.210 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm 2024-09-10T07:58:20.210 DEBUG:teuthology.orchestra.run.smithi022:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T07:58:20.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 07:58 /home/ubuntu/cephtest/cephadm 2024-09-10T07:58:20.612 DEBUG:teuthology.orchestra.run.smithi100:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T07:58:21.008 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 07:58 /home/ubuntu/cephtest/cephadm 2024-09-10T07:58:21.009 DEBUG:teuthology.orchestra.run.smithi153:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T07:58:21.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r--. 1 ubuntu ubuntu 784613 Sep 10 07:58 /home/ubuntu/cephtest/cephadm 2024-09-10T07:58:21.613 DEBUG:teuthology.orchestra.run.smithi022:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T07:58:21.633 DEBUG:teuthology.orchestra.run.smithi100:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T07:58:21.653 DEBUG:teuthology.orchestra.run.smithi153:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T07:58:21.688 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b on all hosts... 2024-09-10T07:58:21.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T07:58:21.691 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T07:58:21.695 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b pull 2024-09-10T07:58:23.309 INFO:teuthology.orchestra.run.smithi100.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T07:58:23.312 INFO:teuthology.orchestra.run.smithi153.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T07:58:23.494 INFO:teuthology.orchestra.run.smithi022.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T07:58:51.593 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T07:58:51.593 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T07:58:51.593 INFO:teuthology.orchestra.run.smithi022.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T07:58:51.593 INFO:teuthology.orchestra.run.smithi022.stdout: "repo_digests": [ 2024-09-10T07:58:51.593 INFO:teuthology.orchestra.run.smithi022.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T07:58:51.594 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-10T07:58:51.594 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T07:58:54.099 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T07:58:54.100 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T07:58:54.100 INFO:teuthology.orchestra.run.smithi100.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T07:58:54.100 INFO:teuthology.orchestra.run.smithi100.stdout: "repo_digests": [ 2024-09-10T07:58:54.100 INFO:teuthology.orchestra.run.smithi100.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T07:58:54.100 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-10T07:58:54.100 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T07:58:55.535 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-10T07:58:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T07:58:55.535 INFO:teuthology.orchestra.run.smithi153.stdout: "image_id": "41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005", 2024-09-10T07:58:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: "repo_digests": [ 2024-09-10T07:58:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559" 2024-09-10T07:58:55.536 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-10T07:58:55.536 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-10T07:58:55.559 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph 2024-09-10T07:58:55.595 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph 2024-09-10T07:58:55.628 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph 2024-09-10T07:58:55.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /etc/ceph 2024-09-10T07:58:55.686 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /etc/ceph 2024-09-10T07:58:55.714 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /etc/ceph 2024-09-10T07:58:55.739 INFO:tasks.cephadm:Writing seed config... 2024-09-10T07:58:55.741 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-10T07:58:55.741 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-10T07:58:55.741 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-10T07:58:55.742 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-10T07:58:55.742 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-10T07:58:55.742 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T07:58:55.742 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-10T07:58:55.742 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-10T07:58:55.743 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-10T07:58:55.743 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-10T07:58:55.743 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-10T07:58:55.743 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-10T07:58:55.743 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-10T07:58:55.743 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-10T07:58:55.744 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-10T07:58:55.744 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-10T07:58:55.744 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-10T07:58:55.744 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-10T07:58:55.744 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-10T07:58:55.744 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-10T07:58:55.745 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T07:58:55.745 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-10T07:58:55.745 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T07:58:55.745 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T07:58:55.745 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T07:58:55.745 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T07:58:55.746 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T07:58:55.746 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T07:58:55.746 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T07:58:55.746 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-10T07:58:55.746 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-10T07:58:55.746 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T07:58:55.747 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-10T07:58:55.747 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T07:58:55.747 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-10T07:58:55.747 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-10T07:58:55.747 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T07:58:55.747 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T07:58:55.748 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-10T07:58:55.748 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T07:58:55.748 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T07:58:55.748 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T07:58:55.748 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T07:58:55.749 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T07:58:55.749 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-10T07:58:55.749 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T07:58:55.749 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T07:58:55.751 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T07:58:55.751 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T07:58:55.771 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 71bf679e-6f4a-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-10T07:58:55.771 DEBUG:teuthology.orchestra.run.smithi022:mon.a> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T07:58:55.814 DEBUG:teuthology.orchestra.run.smithi022:mgr.x> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T07:58:55.858 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T07:58:55.858 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b -v bootstrap --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.22 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T07:58:56.078 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-10T07:58:56.078 INFO:teuthology.orchestra.run.smithi022.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b', '-v', 'bootstrap', '--fsid', '71bf679e-6f4a-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.22', '--skip-admin-label'] 2024-09-10T07:58:56.078 INFO:teuthology.orchestra.run.smithi022.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T07:58:56.079 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying podman|docker is present... 2024-09-10T07:58:56.103 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 5.2.2 2024-09-10T07:58:56.103 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying lvm2 is present... 2024-09-10T07:58:56.103 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying time synchronization is in place... 2024-09-10T07:58:56.111 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T07:58:56.111 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T07:58:56.118 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T07:58:56.118 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-10T07:58:56.125 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2024-09-10T07:58:56.131 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2024-09-10T07:58:56.131 INFO:teuthology.orchestra.run.smithi022.stdout:Unit chronyd.service is enabled and running 2024-09-10T07:58:56.131 INFO:teuthology.orchestra.run.smithi022.stdout:Repeating the final host check... 2024-09-10T07:58:56.154 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 5.2.2 2024-09-10T07:58:56.155 INFO:teuthology.orchestra.run.smithi022.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T07:58:56.155 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl is present 2024-09-10T07:58:56.155 INFO:teuthology.orchestra.run.smithi022.stdout:lvcreate is present 2024-09-10T07:58:56.161 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T07:58:56.162 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T07:58:56.168 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T07:58:56.168 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-10T07:58:56.175 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2024-09-10T07:58:56.182 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2024-09-10T07:58:56.182 INFO:teuthology.orchestra.run.smithi022.stdout:Unit chronyd.service is enabled and running 2024-09-10T07:58:56.182 INFO:teuthology.orchestra.run.smithi022.stdout:Host looks OK 2024-09-10T07:58:56.182 INFO:teuthology.orchestra.run.smithi022.stdout:Cluster fsid: 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:58:56.182 INFO:teuthology.orchestra.run.smithi022.stdout:Acquiring lock 139944478221312 on /run/cephadm/71bf679e-6f4a-11ef-bcea-c7b262605968.lock 2024-09-10T07:58:56.182 INFO:teuthology.orchestra.run.smithi022.stdout:Lock 139944478221312 acquired on /run/cephadm/71bf679e-6f4a-11ef-bcea-c7b262605968.lock 2024-09-10T07:58:56.182 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 3300 ... 2024-09-10T07:58:56.183 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 6789 ... 2024-09-10T07:58:56.183 INFO:teuthology.orchestra.run.smithi022.stdout:Base mon IP(s) is [172.21.15.22:3300, 172.21.15.22:6789], mon addrv is [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-09-10T07:58:56.186 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.22 metric 100 2024-09-10T07:58:56.186 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.22 metric 100 2024-09-10T07:58:56.189 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T07:58:56.189 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T07:58:56.189 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1769sec hoplimit 64 pref medium 2024-09-10T07:58:56.192 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T07:58:56.192 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T07:58:56.192 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T07:58:56.192 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T07:58:56.192 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2024-09-10T07:58:56.192 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T07:58:56.192 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2024-09-10T07:58:56.193 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2024-09-10T07:58:56.193 INFO:teuthology.orchestra.run.smithi022.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T07:58:56.193 INFO:teuthology.orchestra.run.smithi022.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T07:58:56.194 INFO:teuthology.orchestra.run.smithi022.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T07:58:56.721 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 2024-09-10T07:58:56.721 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b... 2024-09-10T07:58:56.721 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T07:58:56.721 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying blob sha256:3965ca83761b6e221cd35b61f2ebac0e3b1f9d68a1ce39c1ada69153a1d73116 2024-09-10T07:58:56.721 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T07:58:56.721 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying config sha256:41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 2024-09-10T07:58:56.721 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T07:58:57.633 INFO:teuthology.orchestra.run.smithi022.stdout:ceph: stdout ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable) 2024-09-10T07:58:57.633 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph version: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable) 2024-09-10T07:58:57.633 INFO:teuthology.orchestra.run.smithi022.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T07:58:58.648 INFO:teuthology.orchestra.run.smithi022.stdout:stat: stdout 167 167 2024-09-10T07:58:58.648 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial keys... 2024-09-10T07:58:59.528 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQBC/N9m9vusORAAgS5vDwriykFWaIEQc0ncVA== 2024-09-10T07:59:00.509 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQBD/N9mzDeJMxAAv/cQEIllvGO5l9B7s7KuPA== 2024-09-10T07:59:01.497 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQBE/N9mjs8uMhAAZQpdS/bct8Y3zy8y6IYNqQ== 2024-09-10T07:59:01.498 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial monmap... 2024-09-10T07:59:02.354 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T07:59:02.354 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T07:59:02.354 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:59:02.355 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T07:59:02.355 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool for a [v2:172.21.15.22:3300,v1:172.21.15.22:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T07:59:02.355 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = quincy 2024-09-10T07:59:02.355 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: set fsid to 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:59:02.355 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T07:59:02.355 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T07:59:02.355 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mon... 2024-09-10T07:59:03.226 INFO:teuthology.orchestra.run.smithi022.stdout:create mon.a on 2024-09-10T07:59:03.446 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T07:59:03.593 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T07:59:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-71bf679e-6f4a-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-71bf679e-6f4a-11ef-bcea-c7b262605968.target. 2024-09-10T07:59:03.773 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-71bf679e-6f4a-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-71bf679e-6f4a-11ef-bcea-c7b262605968.target. 2024-09-10T07:59:04.012 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.a 2024-09-10T07:59:04.012 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T07:59:04.184 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-71bf679e-6f4a-11ef-bcea-c7b262605968.target.wants/ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@.service. 2024-09-10T07:59:04.693 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:04 smithi022 podman[30458]: 2024-09-10 07:59:04.666121429 +0000 UTC m=+0.350225528 container start 17c87c405aa4b325501c3320d8ebf228924c4812cb6d2e44dad2b4951f048d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T07:59:04.759 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T07:59:04.760 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-10T07:59:04.768 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T07:59:04.768 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-10T07:59:04.768 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-10T07:59:04.768 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T07:59:04.768 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon to start... 2024-09-10T07:59:04.768 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon... 2024-09-10T07:59:04.981 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:04 smithi022 ceph-mon[30481]: mkfs 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:59:04.981 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:04 smithi022 ceph-mon[30481]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T07:59:04.982 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:04 smithi022 bash[30458]: 17c87c405aa4b325501c3320d8ebf228924c4812cb6d2e44dad2b4951f048d43 2024-09-10T07:59:04.982 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:04 smithi022 systemd[1]: Started Ceph mon.a for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T07:59:05.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:05 smithi022 ceph-mon[30481]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T07:59:05.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:05 smithi022 ceph-mon[30481]: monmap epoch 1 2024-09-10T07:59:05.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:05 smithi022 ceph-mon[30481]: fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:59:05.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:05 smithi022 ceph-mon[30481]: last_changed 2024-09-10T07:59:01.813763+0000 2024-09-10T07:59:05.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:05 smithi022 ceph-mon[30481]: created 2024-09-10T07:59:01.813763+0000 2024-09-10T07:59:05.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:05 smithi022 ceph-mon[30481]: min_mon_release 19 (squid) 2024-09-10T07:59:05.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:05 smithi022 ceph-mon[30481]: election_strategy: 1 2024-09-10T07:59:05.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:05 smithi022 ceph-mon[30481]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-10T07:59:05.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:05 smithi022 ceph-mon[30481]: fsmap 2024-09-10T07:59:05.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:05 smithi022 ceph-mon[30481]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T07:59:05.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:05 smithi022 ceph-mon[30481]: mgrmap e1: no daemons active 2024-09-10T07:59:05.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:05 smithi022 ceph-mon[30481]: from='client.? 172.21.15.22:0/3810780336' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-10T07:59:05.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T07:59:05.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout id: 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:59:05.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T07:59:05.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-10T07:59:05.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout services: 2024-09-10T07:59:05.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.540143s) 2024-09-10T07:59:05.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T07:59:05.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T07:59:05.802 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-10T07:59:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout data: 2024-09-10T07:59:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T07:59:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T07:59:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T07:59:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T07:59:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-10T07:59:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.170+0000 7f987918f640 1 Processor -- start 2024-09-10T07:59:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.170+0000 7f987918f640 1 -- start start 2024-09-10T07:59:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.170+0000 7f987918f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 0x7f987410a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.170+0000 7f987918f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f987407be30 con 0x7f9874108080 2024-09-10T07:59:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.171+0000 7f9872d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 0x7f987410a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.171+0000 7f9872d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 0x7f987410a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46918/0 (socket says 172.21.15.22:46918) 2024-09-10T07:59:05.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.171+0000 7f9872d9d640 1 -- 172.21.15.22:0/2716532349 learned_addr learned my addr 172.21.15.22:0/2716532349 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:05.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.171+0000 7f9872d9d640 1 -- 172.21.15.22:0/2716532349 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987410a9b0 con 0x7f9874108080 2024-09-10T07:59:05.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.173+0000 7f9872d9d640 1 --2- 172.21.15.22:0/2716532349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 0x7f987410a470 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9864009820 tx=0x7f986402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a685d0d69f098a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:05.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.173+0000 7f9871d9b640 1 -- 172.21.15.22:0/2716532349 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9864037070 con 0x7f9874108080 2024-09-10T07:59:05.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.173+0000 7f9871d9b640 1 -- 172.21.15.22:0/2716532349 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9864032440 con 0x7f9874108080 2024-09-10T07:59:05.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.173+0000 7f9871d9b640 1 -- 172.21.15.22:0/2716532349 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9864032740 con 0x7f9874108080 2024-09-10T07:59:05.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.174+0000 7f987918f640 1 -- 172.21.15.22:0/2716532349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 msgr2=0x7f987410a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:05.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.174+0000 7f987918f640 1 --2- 172.21.15.22:0/2716532349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 0x7f987410a470 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9864009820 tx=0x7f986402a270 comp rx=0 tx=0).stop 2024-09-10T07:59:05.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.174+0000 7f987918f640 1 -- 172.21.15.22:0/2716532349 shutdown_connections 2024-09-10T07:59:05.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.174+0000 7f987918f640 1 --2- 172.21.15.22:0/2716532349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 0x7f987410a470 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:05.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.174+0000 7f987918f640 1 -- 172.21.15.22:0/2716532349 >> 172.21.15.22:0/2716532349 conn(0x7f9874101ca0 msgr2=0x7f98741040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:05.804 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.174+0000 7f987918f640 1 -- 172.21.15.22:0/2716532349 shutdown_connections 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.174+0000 7f987918f640 1 -- 172.21.15.22:0/2716532349 wait complete. 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.175+0000 7f987918f640 1 Processor -- start 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.175+0000 7f987918f640 1 -- start start 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.175+0000 7f987918f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 0x7f987419ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.175+0000 7f987918f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f987410ae90 con 0x7f9874108080 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.175+0000 7f9872d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 0x7f987419ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.175+0000 7f9872d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 0x7f987419ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46934/0 (socket says 172.21.15.22:46934) 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.175+0000 7f9872d9d640 1 -- 172.21.15.22:0/3810780336 learned_addr learned my addr 172.21.15.22:0/3810780336 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.176+0000 7f9872d9d640 1 -- 172.21.15.22:0/3810780336 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987419b290 con 0x7f9874108080 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.176+0000 7f9872d9d640 1 --2- 172.21.15.22:0/3810780336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 0x7f987419ad50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f98640090b0 tx=0x7f98640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.176+0000 7f985bfff640 1 -- 172.21.15.22:0/3810780336 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9864041070 con 0x7f9874108080 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.176+0000 7f985bfff640 1 -- 172.21.15.22:0/3810780336 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986403c7a0 con 0x7f9874108080 2024-09-10T07:59:05.805 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.176+0000 7f987918f640 1 -- 172.21.15.22:0/3810780336 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987419b520 con 0x7f9874108080 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.176+0000 7f985bfff640 1 -- 172.21.15.22:0/3810780336 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9864037040 con 0x7f9874108080 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.176+0000 7f987918f640 1 -- 172.21.15.22:0/3810780336 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987419e210 con 0x7f9874108080 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.176+0000 7f985bfff640 1 -- 172.21.15.22:0/3810780336 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9864044070 con 0x7f9874108080 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.176+0000 7f985bfff640 1 -- 172.21.15.22:0/3810780336 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f986403d3f0 con 0x7f9874108080 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.177+0000 7f987918f640 1 -- 172.21.15.22:0/3810780336 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98741084e0 con 0x7f9874108080 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.180+0000 7f985bfff640 1 -- 172.21.15.22:0/3810780336 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9864046450 con 0x7f9874108080 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.242+0000 7f987918f640 1 -- 172.21.15.22:0/3810780336 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f987402d8a0 con 0x7f9874108080 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.242+0000 7f985bfff640 1 -- 172.21.15.22:0/3810780336 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f9864046630 con 0x7f9874108080 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.243+0000 7f987918f640 1 -- 172.21.15.22:0/3810780336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 msgr2=0x7f987419ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.243+0000 7f987918f640 1 --2- 172.21.15.22:0/3810780336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 0x7f987419ad50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f98640090b0 tx=0x7f98640046c0 comp rx=0 tx=0).stop 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.243+0000 7f987918f640 1 -- 172.21.15.22:0/3810780336 shutdown_connections 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.243+0000 7f987918f640 1 --2- 172.21.15.22:0/3810780336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9874108080 0x7f987419ad50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:05.806 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.243+0000 7f987918f640 1 -- 172.21.15.22:0/3810780336 >> 172.21.15.22:0/3810780336 conn(0x7f9874101ca0 msgr2=0x7f9874102ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:05.807 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.243+0000 7f987918f640 1 -- 172.21.15.22:0/3810780336 shutdown_connections 2024-09-10T07:59:05.807 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:05.244+0000 7f987918f640 1 -- 172.21.15.22:0/3810780336 wait complete. 2024-09-10T07:59:05.807 INFO:teuthology.orchestra.run.smithi022.stdout:mon is available 2024-09-10T07:59:05.807 INFO:teuthology.orchestra.run.smithi022.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T07:59:06.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:06 smithi022 ceph-mon[30481]: from='client.? 172.21.15.22:0/1510613505' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T07:59:06.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:06 smithi022 ceph-mon[30481]: from='client.? 172.21.15.22:0/1510613505' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T07:59:06.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-10T07:59:06.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T07:59:06.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:59:06.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-09-10T07:59:06.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T07:59:06.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T07:59:06.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T07:59:06.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T07:59:06.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-10T07:59:06.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T07:59:06.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.194+0000 7f5276454640 1 Processor -- start 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.194+0000 7f5276454640 1 -- start start 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.194+0000 7f5276454640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 0x7f527007c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.194+0000 7f5276454640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f527007c7d0 con 0x7f527007de30 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.195+0000 7f526ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 0x7f527007c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:06.794 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.195+0000 7f526ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 0x7f527007c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46938/0 (socket says 172.21.15.22:46938) 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.195+0000 7f526ffff640 1 -- 172.21.15.22:0/1187297794 learned_addr learned my addr 172.21.15.22:0/1187297794 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.195+0000 7f526ffff640 1 -- 172.21.15.22:0/1187297794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527007c950 con 0x7f527007de30 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.196+0000 7f526ffff640 1 --2- 172.21.15.22:0/1187297794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 0x7f527007c290 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5260009820 tx=0x7f526002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e7aa2fb70f2ffa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.196+0000 7f526f7fe640 1 -- 172.21.15.22:0/1187297794 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5260037070 con 0x7f527007de30 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.196+0000 7f526f7fe640 1 -- 172.21.15.22:0/1187297794 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5260032440 con 0x7f527007de30 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.196+0000 7f526f7fe640 1 -- 172.21.15.22:0/1187297794 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5260032740 con 0x7f527007de30 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.196+0000 7f5276454640 1 -- 172.21.15.22:0/1187297794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 msgr2=0x7f527007c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.196+0000 7f5276454640 1 --2- 172.21.15.22:0/1187297794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 0x7f527007c290 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5260009820 tx=0x7f526002a270 comp rx=0 tx=0).stop 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.197+0000 7f5276454640 1 -- 172.21.15.22:0/1187297794 shutdown_connections 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.197+0000 7f5276454640 1 --2- 172.21.15.22:0/1187297794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 0x7f527007c290 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.197+0000 7f5276454640 1 -- 172.21.15.22:0/1187297794 >> 172.21.15.22:0/1187297794 conn(0x7f5270102db0 msgr2=0x7f52701051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.197+0000 7f5276454640 1 -- 172.21.15.22:0/1187297794 shutdown_connections 2024-09-10T07:59:06.795 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.197+0000 7f5276454640 1 -- 172.21.15.22:0/1187297794 wait complete. 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.197+0000 7f5276454640 1 Processor -- start 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.197+0000 7f5276454640 1 -- start start 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.197+0000 7f5276454640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 0x7f527019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.197+0000 7f5276454640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f527007cef0 con 0x7f527007de30 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.197+0000 7f526ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 0x7f527019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.198+0000 7f526ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 0x7f527019cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46952/0 (socket says 172.21.15.22:46952) 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.198+0000 7f526ffff640 1 -- 172.21.15.22:0/1510613505 learned_addr learned my addr 172.21.15.22:0/1510613505 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.198+0000 7f526ffff640 1 -- 172.21.15.22:0/1510613505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527019d4f0 con 0x7f527007de30 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.198+0000 7f526ffff640 1 --2- 172.21.15.22:0/1510613505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 0x7f527019cfb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f52600090b0 tx=0x7f52600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.198+0000 7f526dffb640 1 -- 172.21.15.22:0/1510613505 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5260041070 con 0x7f527007de30 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.198+0000 7f526dffb640 1 -- 172.21.15.22:0/1510613505 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526003c7a0 con 0x7f527007de30 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.198+0000 7f526dffb640 1 -- 172.21.15.22:0/1510613505 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5260037040 con 0x7f527007de30 2024-09-10T07:59:06.796 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.198+0000 7f5276454640 1 -- 172.21.15.22:0/1510613505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527019d780 con 0x7f527007de30 2024-09-10T07:59:06.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.198+0000 7f5276454640 1 -- 172.21.15.22:0/1510613505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52701a0470 con 0x7f527007de30 2024-09-10T07:59:06.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.198+0000 7f526dffb640 1 -- 172.21.15.22:0/1510613505 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5260044070 con 0x7f527007de30 2024-09-10T07:59:06.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.198+0000 7f526dffb640 1 -- 172.21.15.22:0/1510613505 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f526003d3f0 con 0x7f527007de30 2024-09-10T07:59:06.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.199+0000 7f5276454640 1 -- 172.21.15.22:0/1510613505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f527007c310 con 0x7f527007de30 2024-09-10T07:59:06.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.201+0000 7f526dffb640 1 -- 172.21.15.22:0/1510613505 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5260046450 con 0x7f527007de30 2024-09-10T07:59:06.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.261+0000 7f5276454640 1 -- 172.21.15.22:0/1510613505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f527002d940 con 0x7f527007de30 2024-09-10T07:59:06.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.264+0000 7f526dffb640 1 -- 172.21.15.22:0/1510613505 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f5260046630 con 0x7f527007de30 2024-09-10T07:59:06.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.264+0000 7f526dffb640 1 -- 172.21.15.22:0/1510613505 <== mon.0 v2:172.21.15.22:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5260056070 con 0x7f527007de30 2024-09-10T07:59:06.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.265+0000 7f5276454640 1 -- 172.21.15.22:0/1510613505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 msgr2=0x7f527019cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:06.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.265+0000 7f5276454640 1 --2- 172.21.15.22:0/1510613505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 0x7f527019cfb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f52600090b0 tx=0x7f52600046c0 comp rx=0 tx=0).stop 2024-09-10T07:59:06.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.265+0000 7f5276454640 1 -- 172.21.15.22:0/1510613505 shutdown_connections 2024-09-10T07:59:06.797 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.265+0000 7f5276454640 1 --2- 172.21.15.22:0/1510613505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527007de30 0x7f527019cfb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:06.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.265+0000 7f5276454640 1 -- 172.21.15.22:0/1510613505 >> 172.21.15.22:0/1510613505 conn(0x7f5270102db0 msgr2=0x7f52701031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:06.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.265+0000 7f5276454640 1 -- 172.21.15.22:0/1510613505 shutdown_connections 2024-09-10T07:59:06.798 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:06.265+0000 7f5276454640 1 -- 172.21.15.22:0/1510613505 wait complete. 2024-09-10T07:59:06.798 INFO:teuthology.orchestra.run.smithi022.stdout:Generating new minimal ceph.conf... 2024-09-10T07:59:08.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:07 smithi022 ceph-mon[30481]: from='client.? 172.21.15.22:0/2942803408' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T07:59:11.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.175+0000 7f6c1d8c9640 1 Processor -- start 2024-09-10T07:59:11.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.175+0000 7f6c1d8c9640 1 -- start start 2024-09-10T07:59:11.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.175+0000 7f6c1d8c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 0x7f6c18106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:11.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.175+0000 7f6c1d8c9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6c18106ee0 con 0x7f6c18106510 2024-09-10T07:59:11.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.176+0000 7f6c16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 0x7f6c18106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:11.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.176+0000 7f6c16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 0x7f6c18106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46954/0 (socket says 172.21.15.22:46954) 2024-09-10T07:59:11.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.176+0000 7f6c16ffd640 1 -- 172.21.15.22:0/4002728554 learned_addr learned my addr 172.21.15.22:0/4002728554 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:11.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.176+0000 7f6c16ffd640 1 -- 172.21.15.22:0/4002728554 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c181076c0 con 0x7f6c18106510 2024-09-10T07:59:11.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.177+0000 7f6c16ffd640 1 --2- 172.21.15.22:0/4002728554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 0x7f6c18106910 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009820 tx=0x7f6c1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6b11f56b279722 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:11.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.177+0000 7f6c15ffb640 1 -- 172.21.15.22:0/4002728554 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c10037070 con 0x7f6c18106510 2024-09-10T07:59:11.393 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.177+0000 7f6c15ffb640 1 -- 172.21.15.22:0/4002728554 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c10032900 con 0x7f6c18106510 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.177+0000 7f6c15ffb640 1 -- 172.21.15.22:0/4002728554 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c10030850 con 0x7f6c18106510 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.177+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/4002728554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 msgr2=0x7f6c18106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.177+0000 7f6c1d8c9640 1 --2- 172.21.15.22:0/4002728554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 0x7f6c18106910 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009820 tx=0x7f6c1002a270 comp rx=0 tx=0).stop 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.177+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/4002728554 shutdown_connections 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.177+0000 7f6c1d8c9640 1 --2- 172.21.15.22:0/4002728554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 0x7f6c18106910 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.178+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/4002728554 >> 172.21.15.22:0/4002728554 conn(0x7f6c18101ca0 msgr2=0x7f6c181040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.178+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/4002728554 shutdown_connections 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.178+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/4002728554 wait complete. 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.178+0000 7f6c1d8c9640 1 Processor -- start 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.178+0000 7f6c1d8c9640 1 -- start start 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.178+0000 7f6c1d8c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 0x7f6c1807ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.178+0000 7f6c1d8c9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1810aa70 con 0x7f6c18106510 2024-09-10T07:59:11.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.179+0000 7f6c16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 0x7f6c1807ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.179+0000 7f6c16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 0x7f6c1807ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46968/0 (socket says 172.21.15.22:46968) 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.179+0000 7f6c16ffd640 1 -- 172.21.15.22:0/2942803408 learned_addr learned my addr 172.21.15.22:0/2942803408 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.179+0000 7f6c16ffd640 1 -- 172.21.15.22:0/2942803408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1819e3b0 con 0x7f6c18106510 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.179+0000 7f6c16ffd640 1 --2- 172.21.15.22:0/2942803408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 0x7f6c1807ba20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009940 tx=0x7f6c100326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.179+0000 7f6c1c8c7640 1 -- 172.21.15.22:0/2942803408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c10042070 con 0x7f6c18106510 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.179+0000 7f6c1c8c7640 1 -- 172.21.15.22:0/2942803408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c10032be0 con 0x7f6c18106510 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.179+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/2942803408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1819e580 con 0x7f6c18106510 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.179+0000 7f6c1c8c7640 1 -- 172.21.15.22:0/2942803408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c10037040 con 0x7f6c18106510 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.179+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/2942803408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1819e920 con 0x7f6c18106510 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.179+0000 7f6c1c8c7640 1 -- 172.21.15.22:0/2942803408 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c10045070 con 0x7f6c18106510 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.180+0000 7f6c1c8c7640 1 -- 172.21.15.22:0/2942803408 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6c100479f0 con 0x7f6c18106510 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.180+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/2942803408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1810abf0 con 0x7f6c18106510 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.182+0000 7f6c1c8c7640 1 -- 172.21.15.22:0/2942803408 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6c10032d90 con 0x7f6c18106510 2024-09-10T07:59:11.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.242+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/2942803408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f6c1819ec60 con 0x7f6c18106510 2024-09-10T07:59:11.396 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.242+0000 7f6c1c8c7640 1 -- 172.21.15.22:0/2942803408 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f6c1003d430 con 0x7f6c18106510 2024-09-10T07:59:11.396 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.243+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/2942803408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 msgr2=0x7f6c1807ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:11.396 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.243+0000 7f6c1d8c9640 1 --2- 172.21.15.22:0/2942803408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 0x7f6c1807ba20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009940 tx=0x7f6c100326e0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.396 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.243+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/2942803408 shutdown_connections 2024-09-10T07:59:11.396 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.243+0000 7f6c1d8c9640 1 --2- 172.21.15.22:0/2942803408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c18106510 0x7f6c1807ba20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:11.396 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.243+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/2942803408 >> 172.21.15.22:0/2942803408 conn(0x7f6c18101ca0 msgr2=0x7f6c18102830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:11.396 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.243+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/2942803408 shutdown_connections 2024-09-10T07:59:11.396 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:07.243+0000 7f6c1d8c9640 1 -- 172.21.15.22:0/2942803408 wait complete. 2024-09-10T07:59:11.396 INFO:teuthology.orchestra.run.smithi022.stdout:Restarting the monitor... 2024-09-10T07:59:11.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:11 smithi022 systemd[1]: Stopping Ceph mon.a for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T07:59:13.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:12 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a[30473]: 2024-09-10T07:59:12.572+0000 7f766aae8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T07:59:13.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:12 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a[30473]: 2024-09-10T07:59:12.572+0000 7f766aae8640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T07:59:13.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:12 smithi022 podman[30728]: 2024-09-10 07:59:12.603427412 +0000 UTC m=+1.027195116 container died 17c87c405aa4b325501c3320d8ebf228924c4812cb6d2e44dad2b4951f048d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T07:59:16.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:16 smithi022 podman[30728]: 2024-09-10 07:59:16.445778207 +0000 UTC m=+4.869545910 container cleanup 17c87c405aa4b325501c3320d8ebf228924c4812cb6d2e44dad2b4951f048d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T07:59:16.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:16 smithi022 bash[30728]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a 2024-09-10T07:59:18.870 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:18 smithi022 podman[30740]: 2024-09-10 07:59:18.604444283 +0000 UTC m=+5.999799605 container remove 17c87c405aa4b325501c3320d8ebf228924c4812cb6d2e44dad2b4951f048d43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T07:59:19.218 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:18 smithi022 systemd[1]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T07:59:19.218 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:18 smithi022 systemd[1]: Stopped Ceph mon.a for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T07:59:19.218 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:18 smithi022 systemd[1]: Starting Ceph mon.a for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T07:59:19.219 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 podman[30836]: 2024-09-10 07:59:19.007801024 +0000 UTC m=+0.016283046 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:59:19.219 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 podman[30836]: 2024-09-10 07:59:19.108032485 +0000 UTC m=+0.116514497 container create 37fd5bc61b8b22766e9916f7ff5554a0ae1369e0e052657a73fdfd409f519cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-10T07:59:19.463 INFO:teuthology.orchestra.run.smithi022.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T07:59:19.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 podman[30836]: 2024-09-10 07:59:19.327230674 +0000 UTC m=+0.335712705 container init 37fd5bc61b8b22766e9916f7ff5554a0ae1369e0e052657a73fdfd409f519cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-10T07:59:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 podman[30836]: 2024-09-10 07:59:19.330420289 +0000 UTC m=+0.338902302 container start 37fd5bc61b8b22766e9916f7ff5554a0ae1369e0e052657a73fdfd409f519cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T07:59:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T07:59:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable), process ceph-mon, pid 2 2024-09-10T07:59:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: pidfile_write: ignore empty --pid-file 2024-09-10T07:59:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: load: jerasure load: lrc 2024-09-10T07:59:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: RocksDB version: 7.9.2 2024-09-10T07:59:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Git sha 0 2024-09-10T07:59:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Compile date 2024-09-09 20:43:47 2024-09-10T07:59:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: DB SUMMARY 2024-09-10T07:59:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: DB Session ID: V87YXQOARJCMH3A3NPSZ 2024-09-10T07:59:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: CURRENT file: CURRENT 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105246 ; 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.error_if_exists: 0 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.create_if_missing: 0 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.paranoid_checks: 1 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.env: 0x56507fddd940 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T07:59:19.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.info_log: 0x5650815bb6e0 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.statistics: (nil) 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.use_fsync: 0 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_log_file_size: 0 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.allow_fallocate: 1 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.use_direct_reads: 0 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T07:59:19.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.db_log_dir: 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.wal_dir: 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.write_buffer_manager: 0x5650815cadc0 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T07:59:19.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T07:59:19.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T07:59:19.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T07:59:19.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T07:59:19.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T07:59:19.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T07:59:19.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.unordered_write: 0 2024-09-10T07:59:19.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T07:59:19.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T07:59:19.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T07:59:19.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T07:59:19.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.row_cache: None 2024-09-10T07:59:19.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.wal_filter: None 2024-09-10T07:59:19.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T07:59:19.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T07:59:19.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.two_write_queues: 0 2024-09-10T07:59:19.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T07:59:19.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.wal_compression: 0 2024-09-10T07:59:19.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.atomic_flush: 0 2024-09-10T07:59:19.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T07:59:19.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T07:59:19.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T07:59:19.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.log_readahead_size: 0 2024-09-10T07:59:19.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T07:59:19.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_background_jobs: 2 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_background_compactions: -1 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_subcompactions: 1 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T07:59:19.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_open_files: -1 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_background_flushes: -1 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Compression algorithms supported: 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: kZSTD supported: 0 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: kXpressCompression supported: 0 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: kBZip2Compression supported: 0 2024-09-10T07:59:19.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T07:59:19.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: kLZ4Compression supported: 1 2024-09-10T07:59:19.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: kZlibCompression supported: 1 2024-09-10T07:59:19.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T07:59:19.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: kSnappyCompression supported: 1 2024-09-10T07:59:19.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T07:59:19.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T07:59:19.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T07:59:19.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T07:59:19.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T07:59:19.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.merge_operator: 2024-09-10T07:59:19.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_filter: None 2024-09-10T07:59:19.513 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5650815bb320) 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout: cache_index_and_filter_blocks: 1 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout: pin_top_level_index_and_filter: 1 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_type: 0 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout: data_block_index_type: 0 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_shortening: 1 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T07:59:19.514 INFO:journalctl@ceph.mon.a.smithi022.stdout: checksum: 4 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: no_block_cache: 0 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache: 0x5650815af1f0 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_name: BinnedLRUCache 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_options: 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: capacity : 536870912 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: num_shard_bits : 4 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: strict_capacity_limit : 0 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: high_pri_pool_ratio: 0.000 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_compressed: (nil) 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: persistent_cache: (nil) 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_size: 4096 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_size_deviation: 10 2024-09-10T07:59:19.515 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_restart_interval: 16 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_block_restart_interval: 1 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: metadata_block_size: 4096 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: partition_filters: 0 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: use_delta_encoding: 1 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: filter_policy: bloomfilter 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: whole_key_filtering: 1 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: verify_compression: 0 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: read_amp_bytes_per_bit: 0 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: format_version: 5 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: enable_index_compression: 1 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_align: 0 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: max_auto_readahead_size: 262144 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: prepopulate_block_cache: 0 2024-09-10T07:59:19.516 INFO:journalctl@ceph.mon.a.smithi022.stdout: initial_auto_readahead_size: 8192 2024-09-10T07:59:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T07:59:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T07:59:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T07:59:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compression: NoCompression 2024-09-10T07:59:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T07:59:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T07:59:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T07:59:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.num_levels: 7 2024-09-10T07:59:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T07:59:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T07:59:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T07:59:19.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T07:59:19.518 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T07:59:19.519 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T07:59:19.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.inplace_update_support: 0 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T07:59:19.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T07:59:19.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.bloom_locality: 0 2024-09-10T07:59:19.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.max_successive_merges: 0 2024-09-10T07:59:19.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T07:59:19.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T07:59:19.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T07:59:19.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T07:59:19.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.ttl: 2592000 2024-09-10T07:59:19.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T07:59:19.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T07:59:19.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T07:59:19.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.enable_blob_files: false 2024-09-10T07:59:19.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.min_blob_size: 0 2024-09-10T07:59:19.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T07:59:19.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T07:59:19.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T07:59:19.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T07:59:19.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T07:59:19.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T07:59:19.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T07:59:19.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T07:59:19.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T07:59:19.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T07:59:19.523 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c3d55e99-0e64-45f8-a014-cb52bf7284ae 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725955159357949, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725955159359037, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100313, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98198, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14290, "raw_average_key_size": 49, "raw_value_size": 90471, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1725955159, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c3d55e99-0e64-45f8-a014-cb52bf7284ae", "db_session_id": "V87YXQOARJCMH3A3NPSZ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: EVENT_LOG_v1 {"time_micros": 1725955159359136, "job": 1, "event": "recovery_finished"} 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5650815dce00 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: DB pointer 0x5650816d8000 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** DB Stats ** 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T07:59:19.524 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** Compaction Stats [default] ** 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: L0 2/0 99.82 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: Sum 2/0 99.82 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T07:59:19.525 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** Compaction Stats [default] ** 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 139.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T07:59:19.526 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative compaction: 0.00 GB write, 28.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval compaction: 0.00 GB write, 28.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout: Block cache BinnedLRUCache@0x5650815af1f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: starting mon.a rank 0 at public addrs [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] at bind addrs [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: mon.a@-1(???) e1 preinit fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: mon.a@-1(???).mds e1 new map 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: mon.a@-1(???).mds e1 print_map 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout: e1 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout: btime 2024-09-10T07:59:04:703892+0000 2024-09-10T07:59:19.527 INFO:journalctl@ceph.mon.a.smithi022.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T07:59:19.528 INFO:journalctl@ceph.mon.a.smithi022.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T07:59:19.528 INFO:journalctl@ceph.mon.a.smithi022.stdout: legacy client fscid: -1 2024-09-10T07:59:19.528 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-10T07:59:19.528 INFO:journalctl@ceph.mon.a.smithi022.stdout: No filesystems configured 2024-09-10T07:59:19.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T07:59:19.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T07:59:19.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T07:59:19.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T07:59:19.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 ceph-mon[30854]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T07:59:19.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 bash[30836]: 37fd5bc61b8b22766e9916f7ff5554a0ae1369e0e052657a73fdfd409f519cb5 2024-09-10T07:59:19.528 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:19 smithi022 systemd[1]: Started Ceph mon.a for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T07:59:20.498 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.938+0000 7fde64cd8640 1 Processor -- start 2024-09-10T07:59:20.498 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.939+0000 7fde64cd8640 1 -- start start 2024-09-10T07:59:20.498 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.939+0000 7fde64cd8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 0x7fde60107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:20.498 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.939+0000 7fde64cd8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fde60107ff0 con 0x7fde60107620 2024-09-10T07:59:20.498 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.939+0000 7fde5e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 0x7fde60107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:20.498 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.939+0000 7fde5e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 0x7fde60107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53372/0 (socket says 172.21.15.22:53372) 2024-09-10T07:59:20.498 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.939+0000 7fde5e59c640 1 -- 172.21.15.22:0/3071667859 learned_addr learned my addr 172.21.15.22:0/3071667859 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:20.498 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.939+0000 7fde5e59c640 1 -- 172.21.15.22:0/3071667859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde60108820 con 0x7fde60107620 2024-09-10T07:59:20.498 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.941+0000 7fde5e59c640 1 --2- 172.21.15.22:0/3071667859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 0x7fde60107a20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fde50009820 tx=0x7fde5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176121747632a2cf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:20.498 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.941+0000 7fde5dd9b640 1 -- 172.21.15.22:0/3071667859 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde50037070 con 0x7fde60107620 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.941+0000 7fde5dd9b640 1 -- 172.21.15.22:0/3071667859 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde50032900 con 0x7fde60107620 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.942+0000 7fde5dd9b640 1 -- 172.21.15.22:0/3071667859 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde50030850 con 0x7fde60107620 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.942+0000 7fde64cd8640 1 -- 172.21.15.22:0/3071667859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 msgr2=0x7fde60107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.942+0000 7fde64cd8640 1 --2- 172.21.15.22:0/3071667859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 0x7fde60107a20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fde50009820 tx=0x7fde5002a270 comp rx=0 tx=0).stop 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.942+0000 7fde64cd8640 1 -- 172.21.15.22:0/3071667859 shutdown_connections 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.942+0000 7fde64cd8640 1 --2- 172.21.15.22:0/3071667859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 0x7fde60107a20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.942+0000 7fde64cd8640 1 -- 172.21.15.22:0/3071667859 >> 172.21.15.22:0/3071667859 conn(0x7fde60102db0 msgr2=0x7fde601051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.942+0000 7fde64cd8640 1 -- 172.21.15.22:0/3071667859 shutdown_connections 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.942+0000 7fde64cd8640 1 -- 172.21.15.22:0/3071667859 wait complete. 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.943+0000 7fde64cd8640 1 Processor -- start 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.943+0000 7fde64cd8640 1 -- start start 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.943+0000 7fde64cd8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 0x7fde6019d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:20.499 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.943+0000 7fde64cd8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fde6010bbd0 con 0x7fde60107620 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.943+0000 7fde5e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 0x7fde6019d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.943+0000 7fde5e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 0x7fde6019d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53376/0 (socket says 172.21.15.22:53376) 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.943+0000 7fde5e59c640 1 -- 172.21.15.22:0/1908857024 learned_addr learned my addr 172.21.15.22:0/1908857024 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.944+0000 7fde5e59c640 1 -- 172.21.15.22:0/1908857024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6019ddc0 con 0x7fde60107620 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.944+0000 7fde5e59c640 1 --2- 172.21.15.22:0/1908857024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 0x7fde6019d880 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fde500097f0 tx=0x7fde50030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.944+0000 7fde57fff640 1 -- 172.21.15.22:0/1908857024 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde50042070 con 0x7fde60107620 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.944+0000 7fde57fff640 1 -- 172.21.15.22:0/1908857024 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde50032ca0 con 0x7fde60107620 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.944+0000 7fde57fff640 1 -- 172.21.15.22:0/1908857024 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde50037040 con 0x7fde60107620 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.944+0000 7fde64cd8640 1 -- 172.21.15.22:0/1908857024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde6019e050 con 0x7fde60107620 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.944+0000 7fde64cd8640 1 -- 172.21.15.22:0/1908857024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde601a0d40 con 0x7fde60107620 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.944+0000 7fde57fff640 1 -- 172.21.15.22:0/1908857024 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fde50045070 con 0x7fde60107620 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.944+0000 7fde57fff640 1 -- 172.21.15.22:0/1908857024 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fde50047a30 con 0x7fde60107620 2024-09-10T07:59:20.500 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.945+0000 7fde64cd8640 1 -- 172.21.15.22:0/1908857024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde6010bd50 con 0x7fde60107620 2024-09-10T07:59:20.501 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:19.947+0000 7fde57fff640 1 -- 172.21.15.22:0/1908857024 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fde5003da60 con 0x7fde60107620 2024-09-10T07:59:20.501 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:20.007+0000 7fde64cd8640 1 -- 172.21.15.22:0/1908857024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fde601a1330 con 0x7fde60107620 2024-09-10T07:59:20.501 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:20.009+0000 7fde57fff640 1 -- 172.21.15.22:0/1908857024 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fde5003d430 con 0x7fde60107620 2024-09-10T07:59:20.501 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:20.009+0000 7fde64cd8640 1 -- 172.21.15.22:0/1908857024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 msgr2=0x7fde6019d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:20.501 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:20.009+0000 7fde64cd8640 1 --2- 172.21.15.22:0/1908857024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 0x7fde6019d880 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fde500097f0 tx=0x7fde50030ec0 comp rx=0 tx=0).stop 2024-09-10T07:59:20.501 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:20.009+0000 7fde64cd8640 1 -- 172.21.15.22:0/1908857024 shutdown_connections 2024-09-10T07:59:20.501 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:20.009+0000 7fde64cd8640 1 --2- 172.21.15.22:0/1908857024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde60107620 0x7fde6019d880 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:20.501 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:20.009+0000 7fde64cd8640 1 -- 172.21.15.22:0/1908857024 >> 172.21.15.22:0/1908857024 conn(0x7fde60102db0 msgr2=0x7fde60103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:20.501 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:20.010+0000 7fde64cd8640 1 -- 172.21.15.22:0/1908857024 shutdown_connections 2024-09-10T07:59:20.501 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:20.010+0000 7fde64cd8640 1 -- 172.21.15.22:0/1908857024 wait complete. 2024-09-10T07:59:20.501 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T07:59:20.524 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T07:59:20.524 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mgr... 2024-09-10T07:59:20.524 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T07:59:20.525 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T07:59:20.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:20 smithi022 ceph-mon[30854]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T07:59:20.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:20 smithi022 ceph-mon[30854]: monmap epoch 1 2024-09-10T07:59:20.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:20 smithi022 ceph-mon[30854]: fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:59:20.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:20 smithi022 ceph-mon[30854]: last_changed 2024-09-10T07:59:01.813763+0000 2024-09-10T07:59:20.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:20 smithi022 ceph-mon[30854]: created 2024-09-10T07:59:01.813763+0000 2024-09-10T07:59:20.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:20 smithi022 ceph-mon[30854]: min_mon_release 19 (squid) 2024-09-10T07:59:20.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:20 smithi022 ceph-mon[30854]: election_strategy: 1 2024-09-10T07:59:20.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:20 smithi022 ceph-mon[30854]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-10T07:59:20.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:20 smithi022 ceph-mon[30854]: fsmap 2024-09-10T07:59:20.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:20 smithi022 ceph-mon[30854]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T07:59:20.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:20 smithi022 ceph-mon[30854]: mgrmap e1: no daemons active 2024-09-10T07:59:20.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:20 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1908857024' entity='client.admin' 2024-09-10T07:59:20.784 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.x 2024-09-10T07:59:20.784 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T07:59:20.935 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-71bf679e-6f4a-11ef-bcea-c7b262605968.target.wants/ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@.service. 2024-09-10T07:59:21.143 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:20 smithi022 systemd[1]: Starting Ceph mgr.x for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T07:59:21.420 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:21 smithi022 podman[31065]: 2024-09-10 07:59:21.144927907 +0000 UTC m=+0.091058675 container create 87cb76ffedbc842d408afa4cd042e86e54dfd59f18ba09cd5044ece9f85f1356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-10T07:59:21.421 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:21 smithi022 podman[31065]: 2024-09-10 07:59:21.07012305 +0000 UTC m=+0.016253785 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T07:59:21.421 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:21 smithi022 podman[31065]: 2024-09-10 07:59:21.347239612 +0000 UTC m=+0.293370340 container init 87cb76ffedbc842d408afa4cd042e86e54dfd59f18ba09cd5044ece9f85f1356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=) 2024-09-10T07:59:21.421 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:21 smithi022 podman[31065]: 2024-09-10 07:59:21.349999394 +0000 UTC m=+0.296130119 container start 87cb76ffedbc842d408afa4cd042e86e54dfd59f18ba09cd5044ece9f85f1356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T07:59:21.421 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:21 smithi022 bash[31065]: 87cb76ffedbc842d408afa4cd042e86e54dfd59f18ba09cd5044ece9f85f1356 2024-09-10T07:59:21.435 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T07:59:21.435 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-10T07:59:21.443 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T07:59:21.443 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-10T07:59:21.443 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-10T07:59:21.443 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T07:59:21.452 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T07:59:21.452 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-10T07:59:21.460 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T07:59:21.460 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-10T07:59:21.461 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-10T07:59:21.461 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T07:59:21.461 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr to start... 2024-09-10T07:59:21.461 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr... 2024-09-10T07:59:21.679 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:21 smithi022 systemd[1]: Started Ceph mgr.x for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T07:59:21.691 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:21 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:21.475+0000 7fec2cc79040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T07:59:21.691 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:21 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:21.536+0000 7fec2cc79040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T07:59:21.958 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:21 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:21.699+0000 7fec2cc79040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T07:59:21.958 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:21 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:21.769+0000 7fec2cc79040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T07:59:21.958 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:21 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:21.928+0000 7fec2cc79040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:59:22.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:22 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3953510750' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T07:59:22.253 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:22 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:22.080+0000 7fec2cc79040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:59:22.579 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-10T07:59:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:59:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T07:59:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T07:59:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T07:59:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T07:59:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T07:59:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T07:59:22.582 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T07:59:22.583 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:59:22.584 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T07:59:22.584 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T07:59:22.584 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T07:59:22.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T07:59:22.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T07:59:22.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T07:59:22.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:22.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T07:59:22.591 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T07:59:04:703892+0000", 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T07:59:22.592 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:59:22.593 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T07:59:04.704524+0000", 2024-09-10T07:59:22.594 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T07:59:22.594 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:22.594 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T07:59:22.594 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:59:22.594 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.888+0000 7ff15c56d640 1 Processor -- start 2024-09-10T07:59:22.594 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.888+0000 7ff15c56d640 1 -- start start 2024-09-10T07:59:22.594 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.888+0000 7ff15c56d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 0x7ff1541062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:22.594 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.888+0000 7ff15c56d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff15407bdb0 con 0x7ff154105ef0 2024-09-10T07:59:22.594 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.889+0000 7ff15a309640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 0x7ff1541062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:22.594 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.889+0000 7ff15a309640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 0x7ff1541062f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53402/0 (socket says 172.21.15.22:53402) 2024-09-10T07:59:22.594 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.889+0000 7ff15a309640 1 -- 172.21.15.22:0/3798178036 learned_addr learned my addr 172.21.15.22:0/3798178036 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:22.594 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.889+0000 7ff15a309640 1 -- 172.21.15.22:0/3798178036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff154106830 con 0x7ff154105ef0 2024-09-10T07:59:22.595 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.890+0000 7ff15a309640 1 --2- 172.21.15.22:0/3798178036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 0x7ff1541062f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff150009820 tx=0x7ff15002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ac97c9bf935906 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:22.595 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.890+0000 7ff159307640 1 -- 172.21.15.22:0/3798178036 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff150037070 con 0x7ff154105ef0 2024-09-10T07:59:22.595 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.890+0000 7ff159307640 1 -- 172.21.15.22:0/3798178036 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff150032900 con 0x7ff154105ef0 2024-09-10T07:59:22.595 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.890+0000 7ff159307640 1 -- 172.21.15.22:0/3798178036 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff150030850 con 0x7ff154105ef0 2024-09-10T07:59:22.595 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.891+0000 7ff15c56d640 1 -- 172.21.15.22:0/3798178036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 msgr2=0x7ff1541062f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:22.595 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.891+0000 7ff15c56d640 1 --2- 172.21.15.22:0/3798178036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 0x7ff1541062f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff150009820 tx=0x7ff15002a270 comp rx=0 tx=0).stop 2024-09-10T07:59:22.595 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.891+0000 7ff15c56d640 1 -- 172.21.15.22:0/3798178036 shutdown_connections 2024-09-10T07:59:22.595 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.891+0000 7ff15c56d640 1 --2- 172.21.15.22:0/3798178036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 0x7ff1541062f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:22.595 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.891+0000 7ff15c56d640 1 -- 172.21.15.22:0/3798178036 >> 172.21.15.22:0/3798178036 conn(0x7ff154101ca0 msgr2=0x7ff1541040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:22.595 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.891+0000 7ff15c56d640 1 -- 172.21.15.22:0/3798178036 shutdown_connections 2024-09-10T07:59:22.595 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.891+0000 7ff15c56d640 1 -- 172.21.15.22:0/3798178036 wait complete. 2024-09-10T07:59:22.595 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.891+0000 7ff15c56d640 1 Processor -- start 2024-09-10T07:59:22.596 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.891+0000 7ff15c56d640 1 -- start start 2024-09-10T07:59:22.596 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.892+0000 7ff15c56d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 0x7ff15419d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:22.596 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.892+0000 7ff15c56d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff1541077b0 con 0x7ff154105ef0 2024-09-10T07:59:22.596 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.892+0000 7ff15a309640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 0x7ff15419d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:22.596 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.892+0000 7ff15a309640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 0x7ff15419d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53418/0 (socket says 172.21.15.22:53418) 2024-09-10T07:59:22.596 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.892+0000 7ff15a309640 1 -- 172.21.15.22:0/3953510750 learned_addr learned my addr 172.21.15.22:0/3953510750 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:22.596 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.892+0000 7ff15a309640 1 -- 172.21.15.22:0/3953510750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15419dd00 con 0x7ff154105ef0 2024-09-10T07:59:22.596 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.892+0000 7ff15a309640 1 --2- 172.21.15.22:0/3953510750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 0x7ff15419d7c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff1500097f0 tx=0x7ff150030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:22.596 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.892+0000 7ff14b7fe640 1 -- 172.21.15.22:0/3953510750 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff150042070 con 0x7ff154105ef0 2024-09-10T07:59:22.596 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.892+0000 7ff14b7fe640 1 -- 172.21.15.22:0/3953510750 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff150032ca0 con 0x7ff154105ef0 2024-09-10T07:59:22.596 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.892+0000 7ff15c56d640 1 -- 172.21.15.22:0/3953510750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15419df90 con 0x7ff154105ef0 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.892+0000 7ff14b7fe640 1 -- 172.21.15.22:0/3953510750 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff150037040 con 0x7ff154105ef0 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.893+0000 7ff15c56d640 1 -- 172.21.15.22:0/3953510750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1541a0c80 con 0x7ff154105ef0 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.893+0000 7ff14b7fe640 1 -- 172.21.15.22:0/3953510750 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff150045070 con 0x7ff154105ef0 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.893+0000 7ff14b7fe640 1 -- 172.21.15.22:0/3953510750 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff150047af0 con 0x7ff154105ef0 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.894+0000 7ff15c56d640 1 -- 172.21.15.22:0/3953510750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff154107e80 con 0x7ff154105ef0 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.896+0000 7ff14b7fe640 1 -- 172.21.15.22:0/3953510750 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ff15003db10 con 0x7ff154105ef0 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.958+0000 7ff15c56d640 1 -- 172.21.15.22:0/3953510750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff15402d940 con 0x7ff154105ef0 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.958+0000 7ff14b7fe640 1 -- 172.21.15.22:0/3953510750 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7ff15003d430 con 0x7ff154105ef0 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.960+0000 7ff15c56d640 1 -- 172.21.15.22:0/3953510750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 msgr2=0x7ff15419d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.960+0000 7ff15c56d640 1 --2- 172.21.15.22:0/3953510750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 0x7ff15419d7c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff1500097f0 tx=0x7ff150030ec0 comp rx=0 tx=0).stop 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.960+0000 7ff15c56d640 1 -- 172.21.15.22:0/3953510750 shutdown_connections 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.960+0000 7ff15c56d640 1 --2- 172.21.15.22:0/3953510750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff154105ef0 0x7ff15419d7c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:22.597 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.960+0000 7ff15c56d640 1 -- 172.21.15.22:0/3953510750 >> 172.21.15.22:0/3953510750 conn(0x7ff154101ca0 msgr2=0x7ff1541944a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:22.598 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.960+0000 7ff15c56d640 1 -- 172.21.15.22:0/3953510750 shutdown_connections 2024-09-10T07:59:22.598 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:21.960+0000 7ff15c56d640 1 -- 172.21.15.22:0/3953510750 wait complete. 2024-09-10T07:59:22.598 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (1/15)... 2024-09-10T07:59:22.674 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:22 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:22.414+0000 7fec2cc79040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:59:22.674 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:22 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:22.478+0000 7fec2cc79040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:59:22.674 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:22 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:22.675+0000 7fec2cc79040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:59:24.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:23 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:23.601+0000 7fec2cc79040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:59:24.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:23 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:23.672+0000 7fec2cc79040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:59:24.708 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:24 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:24.436+0000 7fec2cc79040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:59:24.709 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:24 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:24.557+0000 7fec2cc79040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:59:25.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:24 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:24.709+0000 7fec2cc79040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:59:25.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:24 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:24.774+0000 7fec2cc79040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:59:25.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:24 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:24.934+0000 7fec2cc79040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:59:25.309 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:25 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/814208956' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T07:59:25.309 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:25 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:25.007+0000 7fec2cc79040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:59:25.310 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:25 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:25.071+0000 7fec2cc79040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:59:25.310 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:25 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:25.241+0000 7fec2cc79040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:59:25.310 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:25 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:25.310+0000 7fec2cc79040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:59:25.591 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:25 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:25.380+0000 7fec2cc79040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:59:25.591 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:25 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:25.467+0000 7fec2cc79040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:59:25.592 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:25 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:25.529+0000 7fec2cc79040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T07:59:25.592 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:25 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:25.592+0000 7fec2cc79040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T07:59:25.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-10T07:59:25.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:59:25.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T07:59:25.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T07:59:25.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T07:59:25.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T07:59:25.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:25.719 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T07:59:25.719 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:59:25.719 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T07:59:25.719 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T07:59:25.719 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T07:59:25.726 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T07:59:25.726 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:25.727 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T07:59:04:703892+0000", 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T07:59:25.728 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T07:59:04.704524+0000", 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.004+0000 7f02dd768640 1 Processor -- start 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.004+0000 7f02dd768640 1 -- start start 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.005+0000 7f02dd768640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 0x7f02d810a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.005+0000 7f02dd768640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f02d807bdf0 con 0x7f02d81080c0 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.005+0000 7f02d6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 0x7f02d810a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.005+0000 7f02d6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 0x7f02d810a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41380/0 (socket says 172.21.15.22:41380) 2024-09-10T07:59:25.729 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.005+0000 7f02d6ffd640 1 -- 172.21.15.22:0/1168070021 learned_addr learned my addr 172.21.15.22:0/1168070021 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.005+0000 7f02d6ffd640 1 -- 172.21.15.22:0/1168070021 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d810a9f0 con 0x7f02d81080c0 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.006+0000 7f02d6ffd640 1 --2- 172.21.15.22:0/1168070021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 0x7f02d810a4b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009820 tx=0x7f02c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee7117cecc0114 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.006+0000 7f02d5ffb640 1 -- 172.21.15.22:0/1168070021 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02c8037070 con 0x7f02d81080c0 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.006+0000 7f02d5ffb640 1 -- 172.21.15.22:0/1168070021 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02c8032900 con 0x7f02d81080c0 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.006+0000 7f02d5ffb640 1 -- 172.21.15.22:0/1168070021 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02c8030850 con 0x7f02d81080c0 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.007+0000 7f02dd768640 1 -- 172.21.15.22:0/1168070021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 msgr2=0x7f02d810a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.007+0000 7f02dd768640 1 --2- 172.21.15.22:0/1168070021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 0x7f02d810a4b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009820 tx=0x7f02c802a270 comp rx=0 tx=0).stop 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.007+0000 7f02dd768640 1 -- 172.21.15.22:0/1168070021 shutdown_connections 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.007+0000 7f02dd768640 1 --2- 172.21.15.22:0/1168070021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 0x7f02d810a4b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.007+0000 7f02dd768640 1 -- 172.21.15.22:0/1168070021 >> 172.21.15.22:0/1168070021 conn(0x7f02d8101ca0 msgr2=0x7f02d81040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.007+0000 7f02dd768640 1 -- 172.21.15.22:0/1168070021 shutdown_connections 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.007+0000 7f02dd768640 1 -- 172.21.15.22:0/1168070021 wait complete. 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.007+0000 7f02dd768640 1 Processor -- start 2024-09-10T07:59:25.730 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.008+0000 7f02dd768640 1 -- start start 2024-09-10T07:59:25.731 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.008+0000 7f02dd768640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 0x7f02d8107940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:25.731 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.008+0000 7f02dd768640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f02d810b9d0 con 0x7f02d81080c0 2024-09-10T07:59:25.731 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.008+0000 7f02d6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 0x7f02d8107940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:25.731 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.008+0000 7f02d6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 0x7f02d8107940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41394/0 (socket says 172.21.15.22:41394) 2024-09-10T07:59:25.731 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.008+0000 7f02d6ffd640 1 -- 172.21.15.22:0/814208956 learned_addr learned my addr 172.21.15.22:0/814208956 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:25.731 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.008+0000 7f02d6ffd640 1 -- 172.21.15.22:0/814208956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d8107e80 con 0x7f02d81080c0 2024-09-10T07:59:25.731 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.008+0000 7f02d6ffd640 1 --2- 172.21.15.22:0/814208956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 0x7f02d8107940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02c8031000 tx=0x7f02c80326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:25.731 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.009+0000 7f02bffff640 1 -- 172.21.15.22:0/814208956 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02c8042070 con 0x7f02d81080c0 2024-09-10T07:59:25.731 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.009+0000 7f02dd768640 1 -- 172.21.15.22:0/814208956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02d8106070 con 0x7f02d81080c0 2024-09-10T07:59:25.731 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.009+0000 7f02bffff640 1 -- 172.21.15.22:0/814208956 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02c8032be0 con 0x7f02d81080c0 2024-09-10T07:59:25.731 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.009+0000 7f02bffff640 1 -- 172.21.15.22:0/814208956 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02c8037040 con 0x7f02d81080c0 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.009+0000 7f02dd768640 1 -- 172.21.15.22:0/814208956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02d81065b0 con 0x7f02d81080c0 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.009+0000 7f02bffff640 1 -- 172.21.15.22:0/814208956 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f02c8045070 con 0x7f02d81080c0 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.009+0000 7f02bffff640 1 -- 172.21.15.22:0/814208956 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f02c8047b20 con 0x7f02d81080c0 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.010+0000 7f02dd768640 1 -- 172.21.15.22:0/814208956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d8108520 con 0x7f02d81080c0 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.012+0000 7f02bffff640 1 -- 172.21.15.22:0/814208956 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f02c80328a0 con 0x7f02d81080c0 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.074+0000 7f02dd768640 1 -- 172.21.15.22:0/814208956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f02d81068f0 con 0x7f02d81080c0 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.075+0000 7f02bffff640 1 -- 172.21.15.22:0/814208956 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f02c8032d90 con 0x7f02d81080c0 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.076+0000 7f02dd768640 1 -- 172.21.15.22:0/814208956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 msgr2=0x7f02d8107940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.076+0000 7f02dd768640 1 --2- 172.21.15.22:0/814208956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 0x7f02d8107940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f02c8031000 tx=0x7f02c80326e0 comp rx=0 tx=0).stop 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.076+0000 7f02dd768640 1 -- 172.21.15.22:0/814208956 shutdown_connections 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.076+0000 7f02dd768640 1 --2- 172.21.15.22:0/814208956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02d81080c0 0x7f02d8107940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.076+0000 7f02dd768640 1 -- 172.21.15.22:0/814208956 >> 172.21.15.22:0/814208956 conn(0x7f02d8101ca0 msgr2=0x7f02d8102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:25.732 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.076+0000 7f02dd768640 1 -- 172.21.15.22:0/814208956 shutdown_connections 2024-09-10T07:59:25.733 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:25.076+0000 7f02dd768640 1 -- 172.21.15.22:0/814208956 wait complete. 2024-09-10T07:59:25.733 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (2/15)... 2024-09-10T07:59:26.753 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:26.422+0000 7fec2cc79040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T07:59:26.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: Activating manager daemon x 2024-09-10T07:59:26.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: mgrmap e2: x(active, starting, since 0.00320891s) 2024-09-10T07:59:26.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: from='mgr.14100 172.21.15.22:0/2954571326' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T07:59:26.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: from='mgr.14100 172.21.15.22:0/2954571326' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T07:59:26.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: from='mgr.14100 172.21.15.22:0/2954571326' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T07:59:26.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: from='mgr.14100 172.21.15.22:0/2954571326' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:59:26.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: from='mgr.14100 172.21.15.22:0/2954571326' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T07:59:26.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: Manager daemon x is now available 2024-09-10T07:59:26.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: from='mgr.14100 172.21.15.22:0/2954571326' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T07:59:26.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: from='mgr.14100 172.21.15.22:0/2954571326' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T07:59:26.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: from='mgr.14100 172.21.15.22:0/2954571326' entity='mgr.x' 2024-09-10T07:59:26.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: from='mgr.14100 172.21.15.22:0/2954571326' entity='mgr.x' 2024-09-10T07:59:26.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:26 smithi022 ceph-mon[30854]: from='mgr.14100 172.21.15.22:0/2954571326' entity='mgr.x' 2024-09-10T07:59:28.685 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:28 smithi022 ceph-mon[30854]: mgrmap e3: x(active, since 1.00645s) 2024-09-10T07:59:28.685 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:28 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2667062897' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-10T07:59:28.965 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-10T07:59:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:59:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T07:59:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T07:59:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T07:59:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T07:59:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T07:59:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T07:59:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T07:59:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-09-10T07:59:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:59:28.966 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T07:59:28.967 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T07:59:28.968 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T07:59:28.968 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T07:59:28.968 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T07:59:28.968 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:28.968 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T07:59:28.968 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T07:59:28.968 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T07:59:28.968 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T07:59:28.968 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T07:59:28.968 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T07:59:28.968 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T07:59:28.968 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T07:59:04:703892+0000", 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T07:59:28.969 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T07:59:04.704524+0000", 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.136+0000 7f6dd272a640 1 Processor -- start 2024-09-10T07:59:28.970 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.137+0000 7f6dd272a640 1 -- start start 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.137+0000 7f6dd272a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 0x7f6dcc10a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.137+0000 7f6dd272a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc07bdd0 con 0x7f6dcc1080e0 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.137+0000 7f6dcbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 0x7f6dcc10a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.137+0000 7f6dcbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 0x7f6dcc10a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41438/0 (socket says 172.21.15.22:41438) 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.137+0000 7f6dcbfff640 1 -- 172.21.15.22:0/1204450349 learned_addr learned my addr 172.21.15.22:0/1204450349 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.137+0000 7f6dcbfff640 1 -- 172.21.15.22:0/1204450349 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc10aa10 con 0x7f6dcc1080e0 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.138+0000 7f6dcbfff640 1 --2- 172.21.15.22:0/1204450349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 0x7f6dcc10a4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009820 tx=0x7f6dbc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d1b9bbacab4abd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.138+0000 7f6dcb7fe640 1 -- 172.21.15.22:0/1204450349 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dbc037070 con 0x7f6dcc1080e0 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.138+0000 7f6dcb7fe640 1 -- 172.21.15.22:0/1204450349 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6dbc032900 con 0x7f6dcc1080e0 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.138+0000 7f6dcb7fe640 1 -- 172.21.15.22:0/1204450349 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dbc030850 con 0x7f6dcc1080e0 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.139+0000 7f6dd272a640 1 -- 172.21.15.22:0/1204450349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 msgr2=0x7f6dcc10a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.139+0000 7f6dd272a640 1 --2- 172.21.15.22:0/1204450349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 0x7f6dcc10a4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009820 tx=0x7f6dbc02a270 comp rx=0 tx=0).stop 2024-09-10T07:59:28.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.139+0000 7f6dd272a640 1 -- 172.21.15.22:0/1204450349 shutdown_connections 2024-09-10T07:59:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.139+0000 7f6dd272a640 1 --2- 172.21.15.22:0/1204450349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 0x7f6dcc10a4d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.139+0000 7f6dd272a640 1 -- 172.21.15.22:0/1204450349 >> 172.21.15.22:0/1204450349 conn(0x7f6dcc101ca0 msgr2=0x7f6dcc1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.139+0000 7f6dd272a640 1 -- 172.21.15.22:0/1204450349 shutdown_connections 2024-09-10T07:59:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.139+0000 7f6dd272a640 1 -- 172.21.15.22:0/1204450349 wait complete. 2024-09-10T07:59:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.140+0000 7f6dd272a640 1 Processor -- start 2024-09-10T07:59:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.140+0000 7f6dd272a640 1 -- start start 2024-09-10T07:59:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.140+0000 7f6dd272a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 0x7f6dcc107960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.140+0000 7f6dd272a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc10b9f0 con 0x7f6dcc1080e0 2024-09-10T07:59:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.140+0000 7f6dcbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 0x7f6dcc107960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.140+0000 7f6dcbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 0x7f6dcc107960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41452/0 (socket says 172.21.15.22:41452) 2024-09-10T07:59:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.140+0000 7f6dcbfff640 1 -- 172.21.15.22:0/2667062897 learned_addr learned my addr 172.21.15.22:0/2667062897 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:28.972 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.140+0000 7f6dcbfff640 1 -- 172.21.15.22:0/2667062897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc107ea0 con 0x7f6dcc1080e0 2024-09-10T07:59:28.973 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.140+0000 7f6dcbfff640 1 --2- 172.21.15.22:0/2667062897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 0x7f6dcc107960 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc031000 tx=0x7f6dbc0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:28.973 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.141+0000 7f6dc9ffb640 1 -- 172.21.15.22:0/2667062897 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dbc042070 con 0x7f6dcc1080e0 2024-09-10T07:59:28.973 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.141+0000 7f6dd272a640 1 -- 172.21.15.22:0/2667062897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dcc106090 con 0x7f6dcc1080e0 2024-09-10T07:59:28.973 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.141+0000 7f6dc9ffb640 1 -- 172.21.15.22:0/2667062897 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6dbc032be0 con 0x7f6dcc1080e0 2024-09-10T07:59:28.973 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.141+0000 7f6dd272a640 1 -- 172.21.15.22:0/2667062897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dcc1065d0 con 0x7f6dcc1080e0 2024-09-10T07:59:28.973 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.141+0000 7f6dc9ffb640 1 -- 172.21.15.22:0/2667062897 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dbc037040 con 0x7f6dcc1080e0 2024-09-10T07:59:28.973 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.142+0000 7f6dc9ffb640 1 -- 172.21.15.22:0/2667062897 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) ==== 46170+0+0 (secure 0 0 0) 0x7f6dbc045070 con 0x7f6dcc1080e0 2024-09-10T07:59:28.973 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.142+0000 7f6dd272a640 1 -- 172.21.15.22:0/2667062897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dac0052c0 con 0x7f6dcc1080e0 2024-09-10T07:59:28.973 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.142+0000 7f6dc9ffb640 1 --2- 172.21.15.22:0/2667062897 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f6db8038e10 0x7f6db803b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:28.973 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.143+0000 7f6dc9ffb640 1 -- 172.21.15.22:0/2667062897 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6dbc06bd90 con 0x7f6dcc1080e0 2024-09-10T07:59:28.973 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.143+0000 7f6dc3fff640 1 --2- 172.21.15.22:0/2667062897 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f6db8038e10 0x7f6db803b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:28.973 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.143+0000 7f6dc3fff640 1 --2- 172.21.15.22:0/2667062897 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f6db8038e10 0x7f6db803b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6db40098c0 tx=0x7f6db4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.148+0000 7f6dc9ffb640 1 -- 172.21.15.22:0/2667062897 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6dbc03dc40 con 0x7f6dcc1080e0 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.389+0000 7f6dd272a640 1 -- 172.21.15.22:0/2667062897 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6dac0055b0 con 0x7f6dcc1080e0 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.390+0000 7f6dc9ffb640 1 -- 172.21.15.22:0/2667062897 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f6dbc03c7b0 con 0x7f6dcc1080e0 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.392+0000 7f6dd272a640 1 -- 172.21.15.22:0/2667062897 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f6db8038e10 msgr2=0x7f6db803b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.392+0000 7f6dd272a640 1 --2- 172.21.15.22:0/2667062897 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f6db8038e10 0x7f6db803b2d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6db40098c0 tx=0x7f6db4006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.392+0000 7f6dd272a640 1 -- 172.21.15.22:0/2667062897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 msgr2=0x7f6dcc107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.392+0000 7f6dd272a640 1 --2- 172.21.15.22:0/2667062897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 0x7f6dcc107960 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc031000 tx=0x7f6dbc0326e0 comp rx=0 tx=0).stop 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.392+0000 7f6dd272a640 1 -- 172.21.15.22:0/2667062897 shutdown_connections 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.392+0000 7f6dd272a640 1 --2- 172.21.15.22:0/2667062897 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f6db8038e10 0x7f6db803b2d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.392+0000 7f6dd272a640 1 --2- 172.21.15.22:0/2667062897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dcc1080e0 0x7f6dcc107960 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.392+0000 7f6dd272a640 1 -- 172.21.15.22:0/2667062897 >> 172.21.15.22:0/2667062897 conn(0x7f6dcc101ca0 msgr2=0x7f6dcc102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.392+0000 7f6dd272a640 1 -- 172.21.15.22:0/2667062897 shutdown_connections 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:28.392+0000 7f6dd272a640 1 -- 172.21.15.22:0/2667062897 wait complete. 2024-09-10T07:59:28.974 INFO:teuthology.orchestra.run.smithi022.stdout:mgr is available 2024-09-10T07:59:29.548 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:29 smithi022 ceph-mon[30854]: mgrmap e4: x(active, since 2s) 2024-09-10T07:59:30.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-10T07:59:30.109 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T07:59:30.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.363+0000 7ff7cef62640 1 Processor -- start 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.363+0000 7ff7cef62640 1 -- start start 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.363+0000 7ff7cef62640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 0x7ff7c807c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.363+0000 7ff7cef62640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c807c880 con 0x7ff7c807de50 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.363+0000 7ff7cccfe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 0x7ff7c807c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.363+0000 7ff7cccfe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 0x7ff7c807c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41468/0 (socket says 172.21.15.22:41468) 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.363+0000 7ff7cccfe640 1 -- 172.21.15.22:0/1924766277 learned_addr learned my addr 172.21.15.22:0/1924766277 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.364+0000 7ff7cccfe640 1 -- 172.21.15.22:0/1924766277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c807ca00 con 0x7ff7c807de50 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.365+0000 7ff7cccfe640 1 --2- 172.21.15.22:0/1924766277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 0x7ff7c807c2b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009820 tx=0x7ff7bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387f57b97eb6d79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.365+0000 7ff7c77fe640 1 -- 172.21.15.22:0/1924766277 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7bc037070 con 0x7ff7c807de50 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.365+0000 7ff7c77fe640 1 -- 172.21.15.22:0/1924766277 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7bc032900 con 0x7ff7c807de50 2024-09-10T07:59:30.111 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.365+0000 7ff7c77fe640 1 -- 172.21.15.22:0/1924766277 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7bc030850 con 0x7ff7c807de50 2024-09-10T07:59:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.365+0000 7ff7cef62640 1 -- 172.21.15.22:0/1924766277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 msgr2=0x7ff7c807c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.365+0000 7ff7cef62640 1 --2- 172.21.15.22:0/1924766277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 0x7ff7c807c2b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc009820 tx=0x7ff7bc02a270 comp rx=0 tx=0).stop 2024-09-10T07:59:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.366+0000 7ff7cef62640 1 -- 172.21.15.22:0/1924766277 shutdown_connections 2024-09-10T07:59:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.366+0000 7ff7cef62640 1 --2- 172.21.15.22:0/1924766277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 0x7ff7c807c2b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.366+0000 7ff7cef62640 1 -- 172.21.15.22:0/1924766277 >> 172.21.15.22:0/1924766277 conn(0x7ff7c8102db0 msgr2=0x7ff7c81051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.366+0000 7ff7cef62640 1 -- 172.21.15.22:0/1924766277 shutdown_connections 2024-09-10T07:59:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.366+0000 7ff7cef62640 1 -- 172.21.15.22:0/1924766277 wait complete. 2024-09-10T07:59:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.366+0000 7ff7cef62640 1 Processor -- start 2024-09-10T07:59:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.366+0000 7ff7cef62640 1 -- start start 2024-09-10T07:59:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.366+0000 7ff7cef62640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 0x7ff7c819d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.366+0000 7ff7cef62640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c810dc50 con 0x7ff7c807de50 2024-09-10T07:59:30.112 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.366+0000 7ff7cccfe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 0x7ff7c819d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.366+0000 7ff7cccfe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 0x7ff7c819d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41478/0 (socket says 172.21.15.22:41478) 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.366+0000 7ff7cccfe640 1 -- 172.21.15.22:0/1322642924 learned_addr learned my addr 172.21.15.22:0/1322642924 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.367+0000 7ff7cccfe640 1 -- 172.21.15.22:0/1322642924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c819dda0 con 0x7ff7c807de50 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.367+0000 7ff7cccfe640 1 --2- 172.21.15.22:0/1322642924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 0x7ff7c819d860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0097f0 tx=0x7ff7bc030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.367+0000 7ff7c5ffb640 1 -- 172.21.15.22:0/1322642924 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7bc042070 con 0x7ff7c807de50 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.367+0000 7ff7c5ffb640 1 -- 172.21.15.22:0/1322642924 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7bc032ca0 con 0x7ff7c807de50 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.367+0000 7ff7cef62640 1 -- 172.21.15.22:0/1322642924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c819e030 con 0x7ff7c807de50 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.367+0000 7ff7c5ffb640 1 -- 172.21.15.22:0/1322642924 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7bc037040 con 0x7ff7c807de50 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.367+0000 7ff7cef62640 1 -- 172.21.15.22:0/1322642924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c81a0d20 con 0x7ff7c807de50 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.368+0000 7ff7c5ffb640 1 -- 172.21.15.22:0/1322642924 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7ff7bc045070 con 0x7ff7c807de50 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.368+0000 7ff7c5ffb640 1 --2- 172.21.15.22:0/1322642924 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7ff7b8038f20 0x7ff7b803b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.368+0000 7ff7c5ffb640 1 -- 172.21.15.22:0/1322642924 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff7bc06bee0 con 0x7ff7c807de50 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.368+0000 7ff7cef62640 1 -- 172.21.15.22:0/1322642924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c807c330 con 0x7ff7c807de50 2024-09-10T07:59:30.113 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.369+0000 7ff7c7fff640 1 --2- 172.21.15.22:0/1322642924 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7ff7b8038f20 0x7ff7b803b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.369+0000 7ff7c7fff640 1 --2- 172.21.15.22:0/1322642924 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7ff7b8038f20 0x7ff7b803b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40098c0 tx=0x7ff7b4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.373+0000 7ff7c5ffb640 1 -- 172.21.15.22:0/1322642924 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff7bc09b1b0 con 0x7ff7c807de50 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.548+0000 7ff7cef62640 1 -- 172.21.15.22:0/1322642924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7ff7c81a0ef0 con 0x7ff7c807de50 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.549+0000 7ff7c5ffb640 1 -- 172.21.15.22:0/1322642924 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7ff7bc045360 con 0x7ff7c807de50 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.552+0000 7ff7cef62640 1 -- 172.21.15.22:0/1322642924 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7ff7b8038f20 msgr2=0x7ff7b803b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.552+0000 7ff7cef62640 1 --2- 172.21.15.22:0/1322642924 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7ff7b8038f20 0x7ff7b803b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40098c0 tx=0x7ff7b4006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.552+0000 7ff7cef62640 1 -- 172.21.15.22:0/1322642924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 msgr2=0x7ff7c819d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.552+0000 7ff7cef62640 1 --2- 172.21.15.22:0/1322642924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 0x7ff7c819d860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc0097f0 tx=0x7ff7bc030ec0 comp rx=0 tx=0).stop 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.552+0000 7ff7cef62640 1 -- 172.21.15.22:0/1322642924 shutdown_connections 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.552+0000 7ff7cef62640 1 --2- 172.21.15.22:0/1322642924 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7ff7b8038f20 0x7ff7b803b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.552+0000 7ff7cef62640 1 --2- 172.21.15.22:0/1322642924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7c807de50 0x7ff7c819d860 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.552+0000 7ff7cef62640 1 -- 172.21.15.22:0/1322642924 >> 172.21.15.22:0/1322642924 conn(0x7ff7c8102db0 msgr2=0x7ff7c81039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.552+0000 7ff7cef62640 1 -- 172.21.15.22:0/1322642924 shutdown_connections 2024-09-10T07:59:30.114 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:29.552+0000 7ff7cef62640 1 -- 172.21.15.22:0/1322642924 wait complete. 2024-09-10T07:59:30.115 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling cephadm module... 2024-09-10T07:59:30.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:30 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1322642924' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-10T07:59:31.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:31 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2542981244' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-10T07:59:31.753 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:31 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: ignoring --setuser ceph since I am not root 2024-09-10T07:59:31.753 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:31 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: ignoring --setgroup ceph since I am not root 2024-09-10T07:59:31.753 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:31 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:31.590+0000 7fc6cba3a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T07:59:31.753 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:31 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:31.649+0000 7fc6cba3a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T07:59:32.140 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:31 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:31.805+0000 7fc6cba3a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T07:59:32.140 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:31 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:31.876+0000 7fc6cba3a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T07:59:32.140 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:32 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:32.030+0000 7fc6cba3a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:59:32.142 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.579+0000 7f21a3ff9640 1 Processor -- start 2024-09-10T07:59:32.147 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.580+0000 7f21a3ff9640 1 -- start start 2024-09-10T07:59:32.147 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.580+0000 7f21a3ff9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 0x7f219c10a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:32.147 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.580+0000 7f21a3ff9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f219c07be30 con 0x7f219c108080 2024-09-10T07:59:32.147 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.580+0000 7f21a1d95640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 0x7f219c10a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:32.147 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.580+0000 7f21a1d95640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 0x7f219c10a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41492/0 (socket says 172.21.15.22:41492) 2024-09-10T07:59:32.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.580+0000 7f21a1d95640 1 -- 172.21.15.22:0/847101624 learned_addr learned my addr 172.21.15.22:0/847101624 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:32.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.580+0000 7f21a1d95640 1 -- 172.21.15.22:0/847101624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c10a9b0 con 0x7f219c108080 2024-09-10T07:59:32.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.581+0000 7f21a1d95640 1 --2- 172.21.15.22:0/847101624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 0x7f219c10a470 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2198009820 tx=0x7f219802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efde331f8a67adc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:32.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.581+0000 7f21a0d93640 1 -- 172.21.15.22:0/847101624 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2198037070 con 0x7f219c108080 2024-09-10T07:59:32.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.581+0000 7f21a0d93640 1 -- 172.21.15.22:0/847101624 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2198032900 con 0x7f219c108080 2024-09-10T07:59:32.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.581+0000 7f21a0d93640 1 -- 172.21.15.22:0/847101624 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2198030850 con 0x7f219c108080 2024-09-10T07:59:32.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.582+0000 7f21a3ff9640 1 -- 172.21.15.22:0/847101624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 msgr2=0x7f219c10a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:32.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.582+0000 7f21a3ff9640 1 --2- 172.21.15.22:0/847101624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 0x7f219c10a470 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2198009820 tx=0x7f219802a270 comp rx=0 tx=0).stop 2024-09-10T07:59:32.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.582+0000 7f21a3ff9640 1 -- 172.21.15.22:0/847101624 shutdown_connections 2024-09-10T07:59:32.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.582+0000 7f21a3ff9640 1 --2- 172.21.15.22:0/847101624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 0x7f219c10a470 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:32.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.582+0000 7f21a3ff9640 1 -- 172.21.15.22:0/847101624 >> 172.21.15.22:0/847101624 conn(0x7f219c101ca0 msgr2=0x7f219c1040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:32.148 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.582+0000 7f21a3ff9640 1 -- 172.21.15.22:0/847101624 shutdown_connections 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.582+0000 7f21a3ff9640 1 -- 172.21.15.22:0/847101624 wait complete. 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.583+0000 7f21a3ff9640 1 Processor -- start 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.583+0000 7f21a3ff9640 1 -- start start 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.583+0000 7f21a3ff9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 0x7f219c19b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.583+0000 7f21a3ff9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f219c10b9f0 con 0x7f219c108080 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.583+0000 7f21a1d95640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 0x7f219c19b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.583+0000 7f21a1d95640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 0x7f219c19b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41496/0 (socket says 172.21.15.22:41496) 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.583+0000 7f21a1d95640 1 -- 172.21.15.22:0/2542981244 learned_addr learned my addr 172.21.15.22:0/2542981244 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.583+0000 7f21a1d95640 1 -- 172.21.15.22:0/2542981244 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c19bb70 con 0x7f219c108080 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.583+0000 7f21a1d95640 1 --2- 172.21.15.22:0/2542981244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 0x7f219c19b630 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f21980097f0 tx=0x7f2198030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.584+0000 7f2192ffd640 1 -- 172.21.15.22:0/2542981244 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2198042070 con 0x7f219c108080 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.584+0000 7f2192ffd640 1 -- 172.21.15.22:0/2542981244 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2198032ca0 con 0x7f219c108080 2024-09-10T07:59:32.149 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.584+0000 7f21a3ff9640 1 -- 172.21.15.22:0/2542981244 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219c19be00 con 0x7f219c108080 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.584+0000 7f2192ffd640 1 -- 172.21.15.22:0/2542981244 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2198037040 con 0x7f219c108080 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.584+0000 7f21a3ff9640 1 -- 172.21.15.22:0/2542981244 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219c19eaf0 con 0x7f219c108080 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.585+0000 7f2192ffd640 1 -- 172.21.15.22:0/2542981244 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f2198045070 con 0x7f219c108080 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.585+0000 7f21a3ff9640 1 -- 172.21.15.22:0/2542981244 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f219c1084e0 con 0x7f219c108080 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.585+0000 7f2192ffd640 1 --2- 172.21.15.22:0/2542981244 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f2188038f70 0x7f218803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.585+0000 7f2192ffd640 1 -- 172.21.15.22:0/2542981244 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f219806bff0 con 0x7f219c108080 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.585+0000 7f21a1594640 1 --2- 172.21.15.22:0/2542981244 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f2188038f70 0x7f218803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.586+0000 7f21a1594640 1 --2- 172.21.15.22:0/2542981244 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f2188038f70 0x7f218803b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f218c0098c0 tx=0x7f218c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.590+0000 7f2192ffd640 1 -- 172.21.15.22:0/2542981244 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f219803bde0 con 0x7f219c108080 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:30.814+0000 7f21a3ff9640 1 -- 172.21.15.22:0/2542981244 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f219c19f100 con 0x7f219c108080 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:31.434+0000 7f2192ffd640 1 -- 172.21.15.22:0/2542981244 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f219803c720 con 0x7f219c108080 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:31.436+0000 7f2192ffd640 1 -- 172.21.15.22:0/2542981244 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f219803d430 con 0x7f219c108080 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:31.438+0000 7f21a3ff9640 1 -- 172.21.15.22:0/2542981244 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f2188038f70 msgr2=0x7f218803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:31.438+0000 7f21a3ff9640 1 --2- 172.21.15.22:0/2542981244 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f2188038f70 0x7f218803b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f218c0098c0 tx=0x7f218c006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:32.150 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:31.438+0000 7f21a3ff9640 1 -- 172.21.15.22:0/2542981244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 msgr2=0x7f219c19b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:32.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:31.438+0000 7f21a3ff9640 1 --2- 172.21.15.22:0/2542981244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 0x7f219c19b630 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f21980097f0 tx=0x7f2198030ec0 comp rx=0 tx=0).stop 2024-09-10T07:59:32.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:31.438+0000 7f21a3ff9640 1 -- 172.21.15.22:0/2542981244 shutdown_connections 2024-09-10T07:59:32.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:31.438+0000 7f21a3ff9640 1 --2- 172.21.15.22:0/2542981244 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f2188038f70 0x7f218803b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:32.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:31.438+0000 7f21a3ff9640 1 --2- 172.21.15.22:0/2542981244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f219c108080 0x7f219c19b630 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:32.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:31.438+0000 7f21a3ff9640 1 -- 172.21.15.22:0/2542981244 >> 172.21.15.22:0/2542981244 conn(0x7f219c101ca0 msgr2=0x7f219c102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:32.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:31.438+0000 7f21a3ff9640 1 -- 172.21.15.22:0/2542981244 shutdown_connections 2024-09-10T07:59:32.151 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:31.438+0000 7f21a3ff9640 1 -- 172.21.15.22:0/2542981244 wait complete. 2024-09-10T07:59:32.434 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:32 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:32.183+0000 7fc6cba3a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:59:32.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:32 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2542981244' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T07:59:32.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:32 smithi022 ceph-mon[30854]: mgrmap e5: x(active, since 5s) 2024-09-10T07:59:32.753 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:32 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:32.517+0000 7fc6cba3a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:59:32.753 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:32 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:32.586+0000 7fc6cba3a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:59:33.088 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:32 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:32.781+0000 7fc6cba3a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:59:33.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:59:33.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T07:59:33.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T07:59:33.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T07:59:33.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T07:59:33.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:59:33.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.548+0000 7f496c569640 1 Processor -- start 2024-09-10T07:59:33.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.548+0000 7f496c569640 1 -- start start 2024-09-10T07:59:33.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.549+0000 7f496c569640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 0x7f4964106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:33.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.549+0000 7f496c569640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4964106ee0 con 0x7f4964106510 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.549+0000 7f496a305640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 0x7f4964106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.549+0000 7f496a305640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 0x7f4964106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41526/0 (socket says 172.21.15.22:41526) 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.549+0000 7f496a305640 1 -- 172.21.15.22:0/568795508 learned_addr learned my addr 172.21.15.22:0/568795508 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.549+0000 7f496a305640 1 -- 172.21.15.22:0/568795508 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49641076c0 con 0x7f4964106510 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.550+0000 7f496a305640 1 --2- 172.21.15.22:0/568795508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 0x7f4964106910 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4960009820 tx=0x7f496002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e77d53e00c3b502 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.550+0000 7f4969303640 1 -- 172.21.15.22:0/568795508 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4960037070 con 0x7f4964106510 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.550+0000 7f4969303640 1 -- 172.21.15.22:0/568795508 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4960032900 con 0x7f4964106510 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.550+0000 7f4969303640 1 -- 172.21.15.22:0/568795508 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4960030850 con 0x7f4964106510 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.551+0000 7f496c569640 1 -- 172.21.15.22:0/568795508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 msgr2=0x7f4964106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.551+0000 7f496c569640 1 --2- 172.21.15.22:0/568795508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 0x7f4964106910 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4960009820 tx=0x7f496002a270 comp rx=0 tx=0).stop 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.551+0000 7f496c569640 1 -- 172.21.15.22:0/568795508 shutdown_connections 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.551+0000 7f496c569640 1 --2- 172.21.15.22:0/568795508 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 0x7f4964106910 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.551+0000 7f496c569640 1 -- 172.21.15.22:0/568795508 >> 172.21.15.22:0/568795508 conn(0x7f4964101ca0 msgr2=0x7f49641040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.551+0000 7f496c569640 1 -- 172.21.15.22:0/568795508 shutdown_connections 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.551+0000 7f496c569640 1 -- 172.21.15.22:0/568795508 wait complete. 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.551+0000 7f496c569640 1 Processor -- start 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.551+0000 7f496c569640 1 -- start start 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.552+0000 7f496c569640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 0x7f496407ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.552+0000 7f496c569640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f496410aa70 con 0x7f4964106510 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.552+0000 7f496a305640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 0x7f496407ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.552+0000 7f496a305640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 0x7f496407ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41538/0 (socket says 172.21.15.22:41538) 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.552+0000 7f496a305640 1 -- 172.21.15.22:0/3236157125 learned_addr learned my addr 172.21.15.22:0/3236157125 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.552+0000 7f496a305640 1 -- 172.21.15.22:0/3236157125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496419e3b0 con 0x7f4964106510 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.552+0000 7f496a305640 1 --2- 172.21.15.22:0/3236157125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 0x7f496407ba20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4960009940 tx=0x7f49600326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.552+0000 7f495b7fe640 1 -- 172.21.15.22:0/3236157125 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4960042070 con 0x7f4964106510 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.552+0000 7f495b7fe640 1 -- 172.21.15.22:0/3236157125 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4960032be0 con 0x7f4964106510 2024-09-10T07:59:33.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.552+0000 7f496c569640 1 -- 172.21.15.22:0/3236157125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496419e580 con 0x7f4964106510 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.553+0000 7f496c569640 1 -- 172.21.15.22:0/3236157125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f496419e920 con 0x7f4964106510 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.553+0000 7f495b7fe640 1 -- 172.21.15.22:0/3236157125 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4960037040 con 0x7f4964106510 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.553+0000 7f495b7fe640 1 -- 172.21.15.22:0/3236157125 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f4960045070 con 0x7f4964106510 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.554+0000 7f495b7fe640 1 --2- 172.21.15.22:0/3236157125 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f4950038fc0 0x7f495003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.554+0000 7f495b7fe640 1 -- 172.21.15.22:0/3236157125 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f496006cf20 con 0x7f4964106510 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.554+0000 7f4969b04640 1 -- 172.21.15.22:0/3236157125 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f4950038fc0 msgr2=0x7f495003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3970835433 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.554+0000 7f4969b04640 1 --2- 172.21.15.22:0/3236157125 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f4950038fc0 0x7f495003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.554+0000 7f496c569640 1 -- 172.21.15.22:0/3236157125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49480052c0 con 0x7f4964106510 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.563+0000 7f495b7fe640 1 -- 172.21.15.22:0/3236157125 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4960045360 con 0x7f4964106510 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.755+0000 7f4969b04640 1 -- 172.21.15.22:0/3236157125 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f4950038fc0 msgr2=0x7f495003b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3970835433 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.755+0000 7f4969b04640 1 --2- 172.21.15.22:0/3236157125 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f4950038fc0 0x7f495003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.786+0000 7f496c569640 1 -- 172.21.15.22:0/3236157125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f4948005dc0 con 0x7f4964106510 2024-09-10T07:59:33.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.786+0000 7f495b7fe640 1 -- 172.21.15.22:0/3236157125 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f496003dbd0 con 0x7f4964106510 2024-09-10T07:59:33.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.788+0000 7f496c569640 1 -- 172.21.15.22:0/3236157125 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f4950038fc0 msgr2=0x7f495003b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:59:33.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.788+0000 7f496c569640 1 --2- 172.21.15.22:0/3236157125 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f4950038fc0 0x7f495003b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:33.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.788+0000 7f496c569640 1 -- 172.21.15.22:0/3236157125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 msgr2=0x7f496407ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:33.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.788+0000 7f496c569640 1 --2- 172.21.15.22:0/3236157125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 0x7f496407ba20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4960009940 tx=0x7f49600326e0 comp rx=0 tx=0).stop 2024-09-10T07:59:33.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.788+0000 7f496c569640 1 -- 172.21.15.22:0/3236157125 shutdown_connections 2024-09-10T07:59:33.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.788+0000 7f496c569640 1 --2- 172.21.15.22:0/3236157125 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f4950038fc0 0x7f495003b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:33.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.788+0000 7f496c569640 1 --2- 172.21.15.22:0/3236157125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4964106510 0x7f496407ba20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:33.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.788+0000 7f496c569640 1 -- 172.21.15.22:0/3236157125 >> 172.21.15.22:0/3236157125 conn(0x7f4964101ca0 msgr2=0x7f4964102830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:33.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.789+0000 7f496c569640 1 -- 172.21.15.22:0/3236157125 shutdown_connections 2024-09-10T07:59:33.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:32.789+0000 7f496c569640 1 -- 172.21.15.22:0/3236157125 wait complete. 2024-09-10T07:59:33.401 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2024-09-10T07:59:33.401 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 5... 2024-09-10T07:59:33.642 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:33 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3236157125' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T07:59:34.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:33 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:33.720+0000 7fc6cba3a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:59:34.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:33 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:33.792+0000 7fc6cba3a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:59:34.753 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:34 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:34.542+0000 7fc6cba3a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:59:34.753 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:34 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:34.663+0000 7fc6cba3a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:59:35.102 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:34 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:34.812+0000 7fc6cba3a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:59:35.103 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:34 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:34.876+0000 7fc6cba3a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:59:35.103 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:35.032+0000 7fc6cba3a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:59:35.103 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:35.103+0000 7fc6cba3a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:59:35.399 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:35.165+0000 7fc6cba3a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:59:35.399 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:35.332+0000 7fc6cba3a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:59:35.399 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:35.399+0000 7fc6cba3a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:59:35.678 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:35.469+0000 7fc6cba3a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:59:35.678 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:35.555+0000 7fc6cba3a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:59:35.678 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:35.617+0000 7fc6cba3a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T07:59:35.678 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:35.678+0000 7fc6cba3a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T07:59:37.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:36.503+0000 7fc6cba3a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T07:59:37.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: Active manager daemon x restarted 2024-09-10T07:59:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: Activating manager daemon x 2024-09-10T07:59:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T07:59:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: mgrmap e6: x(active, starting, since 0.0036669s) 2024-09-10T07:59:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T07:59:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T07:59:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T07:59:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T07:59:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T07:59:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: Manager daemon x is now available 2024-09-10T07:59:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:59:37.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:59:37.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T07:59:37.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:36 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T07:59:37.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:37 smithi022 ceph-mon[30854]: Found migration_current of "None". Setting to last migration. 2024-09-10T07:59:37.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:37 smithi022 ceph-mon[30854]: mgrmap e7: x(active, since 1.00561s) 2024-09-10T07:59:38.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:59:38.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T07:59:38.088 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T07:59:38.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:59:38.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.815+0000 7f17b9438640 1 Processor -- start 2024-09-10T07:59:38.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.815+0000 7f17b9438640 1 -- start start 2024-09-10T07:59:38.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.815+0000 7f17b9438640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 0x7f17b410a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:38.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.815+0000 7f17b9438640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f17b407be00 con 0x7f17b41080f0 2024-09-10T07:59:38.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.815+0000 7f17b2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 0x7f17b410a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:38.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.815+0000 7f17b2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 0x7f17b410a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46570/0 (socket says 172.21.15.22:46570) 2024-09-10T07:59:38.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.815+0000 7f17b2ffd640 1 -- 172.21.15.22:0/2063540213 learned_addr learned my addr 172.21.15.22:0/2063540213 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:38.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.816+0000 7f17b2ffd640 1 -- 172.21.15.22:0/2063540213 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b410aa20 con 0x7f17b41080f0 2024-09-10T07:59:38.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.816+0000 7f17b2ffd640 1 --2- 172.21.15.22:0/2063540213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 0x7f17b410a4e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009820 tx=0x7f17a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b7bb4479f3a64b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:38.089 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.817+0000 7f17b1ffb640 1 -- 172.21.15.22:0/2063540213 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a4037070 con 0x7f17b41080f0 2024-09-10T07:59:38.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.817+0000 7f17b1ffb640 1 -- 172.21.15.22:0/2063540213 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f17a4032900 con 0x7f17b41080f0 2024-09-10T07:59:38.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.817+0000 7f17b1ffb640 1 -- 172.21.15.22:0/2063540213 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a4030850 con 0x7f17b41080f0 2024-09-10T07:59:38.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.817+0000 7f17b9438640 1 -- 172.21.15.22:0/2063540213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 msgr2=0x7f17b410a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:38.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.817+0000 7f17b9438640 1 --2- 172.21.15.22:0/2063540213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 0x7f17b410a4e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009820 tx=0x7f17a402a270 comp rx=0 tx=0).stop 2024-09-10T07:59:38.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.817+0000 7f17b9438640 1 -- 172.21.15.22:0/2063540213 shutdown_connections 2024-09-10T07:59:38.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.817+0000 7f17b9438640 1 --2- 172.21.15.22:0/2063540213 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 0x7f17b410a4e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.817+0000 7f17b9438640 1 -- 172.21.15.22:0/2063540213 >> 172.21.15.22:0/2063540213 conn(0x7f17b4101d10 msgr2=0x7f17b4104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:38.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.817+0000 7f17b9438640 1 -- 172.21.15.22:0/2063540213 shutdown_connections 2024-09-10T07:59:38.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.817+0000 7f17b9438640 1 -- 172.21.15.22:0/2063540213 wait complete. 2024-09-10T07:59:38.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.818+0000 7f17b9438640 1 Processor -- start 2024-09-10T07:59:38.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.818+0000 7f17b9438640 1 -- start start 2024-09-10T07:59:38.090 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.818+0000 7f17b9438640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 0x7f17b4107970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.818+0000 7f17b9438640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f17b410ba00 con 0x7f17b41080f0 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.819+0000 7f17b2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 0x7f17b4107970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.819+0000 7f17b2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 0x7f17b4107970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46586/0 (socket says 172.21.15.22:46586) 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.819+0000 7f17b2ffd640 1 -- 172.21.15.22:0/2613563286 learned_addr learned my addr 172.21.15.22:0/2613563286 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.819+0000 7f17b2ffd640 1 -- 172.21.15.22:0/2613563286 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b4107eb0 con 0x7f17b41080f0 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.819+0000 7f17b2ffd640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 0x7f17b4107970 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f17a4032ce0 tx=0x7f17a4032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.819+0000 7f179bfff640 1 -- 172.21.15.22:0/2613563286 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a4042070 con 0x7f17b41080f0 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.819+0000 7f179bfff640 1 -- 172.21.15.22:0/2613563286 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f17a40308c0 con 0x7f17b41080f0 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.819+0000 7f17b9438640 1 -- 172.21.15.22:0/2613563286 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b41060a0 con 0x7f17b41080f0 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.819+0000 7f179bfff640 1 -- 172.21.15.22:0/2613563286 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17a4037040 con 0x7f17b41080f0 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.819+0000 7f17b9438640 1 -- 172.21.15.22:0/2613563286 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b41065e0 con 0x7f17b41080f0 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.820+0000 7f179bfff640 1 -- 172.21.15.22:0/2613563286 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f17a4045070 con 0x7f17b41080f0 2024-09-10T07:59:38.091 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.821+0000 7f179bfff640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f179c038fc0 0x7f179c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:38.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.821+0000 7f179bfff640 1 -- 172.21.15.22:0/2613563286 --> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f179c03bb90 con 0x7f179c038fc0 2024-09-10T07:59:38.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.821+0000 7f179bfff640 1 -- 172.21.15.22:0/2613563286 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f17a406c000 con 0x7f17b41080f0 2024-09-10T07:59:38.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.821+0000 7f17b27fc640 1 -- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f179c038fc0 msgr2=0x7f179c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3970835433 2024-09-10T07:59:38.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:33.821+0000 7f17b27fc640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f179c038fc0 0x7f179c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:59:38.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:34.022+0000 7f17b27fc640 1 -- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f179c038fc0 msgr2=0x7f179c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3970835433 2024-09-10T07:59:38.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:34.022+0000 7f17b27fc640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f179c038fc0 0x7f179c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T07:59:38.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:34.423+0000 7f17b27fc640 1 -- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f179c038fc0 msgr2=0x7f179c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3970835433 2024-09-10T07:59:38.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:34.423+0000 7f17b27fc640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f179c038fc0 0x7f179c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T07:59:38.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:35.224+0000 7f17b27fc640 1 -- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f179c038fc0 msgr2=0x7f179c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/3970835433 2024-09-10T07:59:38.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:35.224+0000 7f17b27fc640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f179c038fc0 0x7f179c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T07:59:38.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:36.507+0000 7f179bfff640 1 -- 172.21.15.22:0/2613563286 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7f17a406af90 con 0x7f17b41080f0 2024-09-10T07:59:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:36.507+0000 7f179bfff640 1 -- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f179c038fc0 msgr2=0x7f179c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:59:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:36.507+0000 7f179bfff640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f179c038fc0 0x7f179c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.508+0000 7f179bfff640 1 -- 172.21.15.22:0/2613563286 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f17a403ccd0 con 0x7f17b41080f0 2024-09-10T07:59:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.508+0000 7f179bfff640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f179c03c8f0 0x7f179c03ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.508+0000 7f179bfff640 1 -- 172.21.15.22:0/2613563286 --> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f17a400af30 con 0x7f179c03c8f0 2024-09-10T07:59:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.508+0000 7f17b27fc640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f179c03c8f0 0x7f179c03ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.509+0000 7f17b27fc640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f179c03c8f0 0x7f179c03ece0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f17a8003980 tx=0x7f17a80092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.509+0000 7f179bfff640 1 -- 172.21.15.22:0/2613563286 <== mgr.14118 v2:172.21.15.22:6800/17773609 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f17a400af30 con 0x7f179c03c8f0 2024-09-10T07:59:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.516+0000 7f17b9438640 1 -- 172.21.15.22:0/2613563286 --> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f17b4108550 con 0x7f179c03c8f0 2024-09-10T07:59:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.517+0000 7f179bfff640 1 -- 172.21.15.22:0/2613563286 <== mgr.14118 v2:172.21.15.22:6800/17773609 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f17b4108550 con 0x7f179c03c8f0 2024-09-10T07:59:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.517+0000 7f17b9438640 1 -- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f179c03c8f0 msgr2=0x7f179c03ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.517+0000 7f17b9438640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f179c03c8f0 0x7f179c03ece0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f17a8003980 tx=0x7f17a80092b0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.517+0000 7f17b9438640 1 -- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 msgr2=0x7f17b4107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:38.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.517+0000 7f17b9438640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 0x7f17b4107970 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f17a4032ce0 tx=0x7f17a4032d10 comp rx=0 tx=0).stop 2024-09-10T07:59:38.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.517+0000 7f17b9438640 1 -- 172.21.15.22:0/2613563286 shutdown_connections 2024-09-10T07:59:38.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.517+0000 7f17b9438640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f179c03c8f0 0x7f179c03ece0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.517+0000 7f17b9438640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:6800/3970835433,v1:172.21.15.22:6801/3970835433] conn(0x7f179c038fc0 0x7f179c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.517+0000 7f17b9438640 1 --2- 172.21.15.22:0/2613563286 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17b41080f0 0x7f17b4107970 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:38.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.517+0000 7f17b9438640 1 -- 172.21.15.22:0/2613563286 >> 172.21.15.22:0/2613563286 conn(0x7f17b4101d10 msgr2=0x7f17b4102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:38.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.517+0000 7f17b9438640 1 -- 172.21.15.22:0/2613563286 shutdown_connections 2024-09-10T07:59:38.094 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:37.517+0000 7f17b9438640 1 -- 172.21.15.22:0/2613563286 wait complete. 2024-09-10T07:59:38.094 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 5 is available 2024-09-10T07:59:38.094 INFO:teuthology.orchestra.run.smithi022.stdout:Setting orchestrator backend to cephadm... 2024-09-10T07:59:38.976 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:38 smithi022 ceph-mon[30854]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-10T07:59:38.976 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:38 smithi022 ceph-mon[30854]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-10T07:59:38.976 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:38 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:38.976 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:38 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:38.976 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:38 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:38.976 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:38 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:59:39.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.487+0000 7f29b5e11640 1 Processor -- start 2024-09-10T07:59:39.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.487+0000 7f29b5e11640 1 -- start start 2024-09-10T07:59:39.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.487+0000 7f29b5e11640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 0x7f29b0106910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:39.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.487+0000 7f29b5e11640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0106ee0 con 0x7f29b0106510 2024-09-10T07:59:39.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.487+0000 7f29af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 0x7f29b0106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:39.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.487+0000 7f29af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 0x7f29b0106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46660/0 (socket says 172.21.15.22:46660) 2024-09-10T07:59:39.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.487+0000 7f29af7fe640 1 -- 172.21.15.22:0/467209755 learned_addr learned my addr 172.21.15.22:0/467209755 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:39.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.488+0000 7f29af7fe640 1 -- 172.21.15.22:0/467209755 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b01076c0 con 0x7f29b0106510 2024-09-10T07:59:39.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.488+0000 7f29af7fe640 1 --2- 172.21.15.22:0/467209755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 0x7f29b0106910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2998009820 tx=0x7f299802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d71905f7fc9b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:39.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.488+0000 7f29ae7fc640 1 -- 172.21.15.22:0/467209755 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2998037070 con 0x7f29b0106510 2024-09-10T07:59:39.275 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.488+0000 7f29ae7fc640 1 -- 172.21.15.22:0/467209755 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2998032900 con 0x7f29b0106510 2024-09-10T07:59:39.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.488+0000 7f29ae7fc640 1 -- 172.21.15.22:0/467209755 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2998030850 con 0x7f29b0106510 2024-09-10T07:59:39.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.489+0000 7f29b5e11640 1 -- 172.21.15.22:0/467209755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 msgr2=0x7f29b0106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:39.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.489+0000 7f29b5e11640 1 --2- 172.21.15.22:0/467209755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 0x7f29b0106910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2998009820 tx=0x7f299802a270 comp rx=0 tx=0).stop 2024-09-10T07:59:39.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.489+0000 7f29b5e11640 1 -- 172.21.15.22:0/467209755 shutdown_connections 2024-09-10T07:59:39.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.489+0000 7f29b5e11640 1 --2- 172.21.15.22:0/467209755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 0x7f29b0106910 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:39.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.489+0000 7f29b5e11640 1 -- 172.21.15.22:0/467209755 >> 172.21.15.22:0/467209755 conn(0x7f29b0101ca0 msgr2=0x7f29b01040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:39.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.489+0000 7f29b5e11640 1 -- 172.21.15.22:0/467209755 shutdown_connections 2024-09-10T07:59:39.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.489+0000 7f29b5e11640 1 -- 172.21.15.22:0/467209755 wait complete. 2024-09-10T07:59:39.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.490+0000 7f29b5e11640 1 Processor -- start 2024-09-10T07:59:39.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.490+0000 7f29b5e11640 1 -- start start 2024-09-10T07:59:39.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.490+0000 7f29b5e11640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 0x7f29b01916f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:39.276 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.490+0000 7f29b5e11640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f29b010aa70 con 0x7f29b0106510 2024-09-10T07:59:39.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.490+0000 7f29af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 0x7f29b01916f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:39.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.490+0000 7f29af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 0x7f29b01916f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46662/0 (socket says 172.21.15.22:46662) 2024-09-10T07:59:39.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.490+0000 7f29af7fe640 1 -- 172.21.15.22:0/3514503779 learned_addr learned my addr 172.21.15.22:0/3514503779 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:39.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.490+0000 7f29af7fe640 1 -- 172.21.15.22:0/3514503779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b0191c30 con 0x7f29b0106510 2024-09-10T07:59:39.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.491+0000 7f29af7fe640 1 --2- 172.21.15.22:0/3514503779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 0x7f29b01916f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2998009940 tx=0x7f29980326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:39.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.491+0000 7f29acff9640 1 -- 172.21.15.22:0/3514503779 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2998042070 con 0x7f29b0106510 2024-09-10T07:59:39.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.491+0000 7f29acff9640 1 -- 172.21.15.22:0/3514503779 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2998032be0 con 0x7f29b0106510 2024-09-10T07:59:39.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.491+0000 7f29b5e11640 1 -- 172.21.15.22:0/3514503779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b018fe20 con 0x7f29b0106510 2024-09-10T07:59:39.277 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.491+0000 7f29acff9640 1 -- 172.21.15.22:0/3514503779 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2998037040 con 0x7f29b0106510 2024-09-10T07:59:39.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.491+0000 7f29b5e11640 1 -- 172.21.15.22:0/3514503779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b0190360 con 0x7f29b0106510 2024-09-10T07:59:39.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.492+0000 7f29acff9640 1 -- 172.21.15.22:0/3514503779 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7f2998045070 con 0x7f29b0106510 2024-09-10T07:59:39.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.492+0000 7f29b5e11640 1 -- 172.21.15.22:0/3514503779 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b010abf0 con 0x7f29b0106510 2024-09-10T07:59:39.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.492+0000 7f29acff9640 1 --2- 172.21.15.22:0/3514503779 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f299c038eb0 0x7f299c03b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:39.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.492+0000 7f29acff9640 1 -- 172.21.15.22:0/3514503779 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f299806bd20 con 0x7f29b0106510 2024-09-10T07:59:39.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.492+0000 7f29aeffd640 1 --2- 172.21.15.22:0/3514503779 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f299c038eb0 0x7f299c03b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:39.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.493+0000 7f29aeffd640 1 --2- 172.21.15.22:0/3514503779 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f299c038eb0 0x7f299c03b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f29a00098c0 tx=0x7f29a0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:39.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.497+0000 7f29acff9640 1 -- 172.21.15.22:0/3514503779 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2998045360 con 0x7f29b0106510 2024-09-10T07:59:39.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.690+0000 7f29b5e11640 1 -- 172.21.15.22:0/3514503779 --> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f29b0195510 con 0x7f299c038eb0 2024-09-10T07:59:39.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.695+0000 7f29acff9640 1 -- 172.21.15.22:0/3514503779 <== mgr.14118 v2:172.21.15.22:6800/17773609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f29b0195510 con 0x7f299c038eb0 2024-09-10T07:59:39.278 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.697+0000 7f29b5e11640 1 -- 172.21.15.22:0/3514503779 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f299c038eb0 msgr2=0x7f299c03b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:39.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.697+0000 7f29b5e11640 1 --2- 172.21.15.22:0/3514503779 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f299c038eb0 0x7f299c03b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f29a00098c0 tx=0x7f29a0006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:39.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.697+0000 7f29b5e11640 1 -- 172.21.15.22:0/3514503779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 msgr2=0x7f29b01916f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:39.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.697+0000 7f29b5e11640 1 --2- 172.21.15.22:0/3514503779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 0x7f29b01916f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2998009940 tx=0x7f29980326e0 comp rx=0 tx=0).stop 2024-09-10T07:59:39.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.697+0000 7f29b5e11640 1 -- 172.21.15.22:0/3514503779 shutdown_connections 2024-09-10T07:59:39.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.697+0000 7f29b5e11640 1 --2- 172.21.15.22:0/3514503779 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f299c038eb0 0x7f299c03b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:39.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.697+0000 7f29b5e11640 1 --2- 172.21.15.22:0/3514503779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29b0106510 0x7f29b01916f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:39.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.697+0000 7f29b5e11640 1 -- 172.21.15.22:0/3514503779 >> 172.21.15.22:0/3514503779 conn(0x7f29b0101ca0 msgr2=0x7f29b0102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:39.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.698+0000 7f29b5e11640 1 -- 172.21.15.22:0/3514503779 shutdown_connections 2024-09-10T07:59:39.279 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:38.698+0000 7f29b5e11640 1 -- 172.21.15.22:0/3514503779 wait complete. 2024-09-10T07:59:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-mon[30854]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-mon[30854]: mgrmap e8: x(active, since 2s) 2024-09-10T07:59:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-mon[30854]: [10/Sep/2024:07:59:39] ENGINE Bus STARTING 2024-09-10T07:59:39.870 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:59:39.871 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:39.708+0000 7fc632d54640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:07:59:39] ENGINE Error in HTTPServer.serve 2024-09-10T07:59:39.871 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: Traceback (most recent call last): 2024-09-10T07:59:39.871 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T07:59:39.871 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: self._connections.run(self.expiration_interval) 2024-09-10T07:59:39.872 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T07:59:39.872 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: self._run(expiration_interval) 2024-09-10T07:59:39.872 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T07:59:39.872 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T07:59:39.872 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T07:59:39.873 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T07:59:39.873 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T07:59:39.873 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: s = self.context.wrap_socket( 2024-09-10T07:59:39.873 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T07:59:39.873 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: return self.sslsocket_class._create( 2024-09-10T07:59:39.873 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T07:59:39.874 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: self.do_handshake() 2024-09-10T07:59:39.874 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T07:59:39.874 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: self._sslobj.do_handshake() 2024-09-10T07:59:39.874 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T07:59:39.874 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:40.406 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T07:59:40.406 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.683+0000 7efe2e0bc640 1 Processor -- start 2024-09-10T07:59:40.406 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.683+0000 7efe2e0bc640 1 -- start start 2024-09-10T07:59:40.406 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.684+0000 7efe2e0bc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 0x7efe28106900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:40.406 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.684+0000 7efe2e0bc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efe28106ed0 con 0x7efe28106500 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.684+0000 7efe277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 0x7efe28106900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.684+0000 7efe277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 0x7efe28106900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46670/0 (socket says 172.21.15.22:46670) 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.684+0000 7efe277fe640 1 -- 172.21.15.22:0/401289784 learned_addr learned my addr 172.21.15.22:0/401289784 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.684+0000 7efe277fe640 1 -- 172.21.15.22:0/401289784 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe28107700 con 0x7efe28106500 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.685+0000 7efe277fe640 1 --2- 172.21.15.22:0/401289784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 0x7efe28106900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe18009820 tx=0x7efe1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6bb806aa51978a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.685+0000 7efe267fc640 1 -- 172.21.15.22:0/401289784 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe18037070 con 0x7efe28106500 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.685+0000 7efe267fc640 1 -- 172.21.15.22:0/401289784 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe18032900 con 0x7efe28106500 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.685+0000 7efe267fc640 1 -- 172.21.15.22:0/401289784 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe18030850 con 0x7efe28106500 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.685+0000 7efe2e0bc640 1 -- 172.21.15.22:0/401289784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 msgr2=0x7efe28106900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.685+0000 7efe2e0bc640 1 --2- 172.21.15.22:0/401289784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 0x7efe28106900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe18009820 tx=0x7efe1802a270 comp rx=0 tx=0).stop 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.686+0000 7efe2e0bc640 1 -- 172.21.15.22:0/401289784 shutdown_connections 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.686+0000 7efe2e0bc640 1 --2- 172.21.15.22:0/401289784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 0x7efe28106900 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.407 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.686+0000 7efe2e0bc640 1 -- 172.21.15.22:0/401289784 >> 172.21.15.22:0/401289784 conn(0x7efe28101d10 msgr2=0x7efe28104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.686+0000 7efe2e0bc640 1 -- 172.21.15.22:0/401289784 shutdown_connections 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.686+0000 7efe2e0bc640 1 -- 172.21.15.22:0/401289784 wait complete. 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.686+0000 7efe2e0bc640 1 Processor -- start 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.686+0000 7efe2e0bc640 1 -- start start 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.686+0000 7efe2e0bc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 0x7efe2819b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.687+0000 7efe2e0bc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efe2810aab0 con 0x7efe28106500 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.687+0000 7efe277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 0x7efe2819b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.687+0000 7efe277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 0x7efe2819b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46674/0 (socket says 172.21.15.22:46674) 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.687+0000 7efe277fe640 1 -- 172.21.15.22:0/2145901723 learned_addr learned my addr 172.21.15.22:0/2145901723 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.687+0000 7efe277fe640 1 -- 172.21.15.22:0/2145901723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2819bb50 con 0x7efe28106500 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.687+0000 7efe277fe640 1 --2- 172.21.15.22:0/2145901723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 0x7efe2819b610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe18009940 tx=0x7efe18032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.687+0000 7efe24ff9640 1 -- 172.21.15.22:0/2145901723 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe18042070 con 0x7efe28106500 2024-09-10T07:59:40.408 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.687+0000 7efe24ff9640 1 -- 172.21.15.22:0/2145901723 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe180308c0 con 0x7efe28106500 2024-09-10T07:59:40.409 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.687+0000 7efe2e0bc640 1 -- 172.21.15.22:0/2145901723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe2819bde0 con 0x7efe28106500 2024-09-10T07:59:40.409 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.687+0000 7efe24ff9640 1 -- 172.21.15.22:0/2145901723 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe18037040 con 0x7efe28106500 2024-09-10T07:59:40.409 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.687+0000 7efe2e0bc640 1 -- 172.21.15.22:0/2145901723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe2819ead0 con 0x7efe28106500 2024-09-10T07:59:40.409 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.688+0000 7efe24ff9640 1 -- 172.21.15.22:0/2145901723 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7efe18045070 con 0x7efe28106500 2024-09-10T07:59:40.409 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.688+0000 7efe2e0bc640 1 -- 172.21.15.22:0/2145901723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe2810ac30 con 0x7efe28106500 2024-09-10T07:59:40.409 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.688+0000 7efe24ff9640 1 --2- 172.21.15.22:0/2145901723 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7efe10038fc0 0x7efe1003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:40.409 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.688+0000 7efe24ff9640 1 -- 172.21.15.22:0/2145901723 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efe1806c010 con 0x7efe28106500 2024-09-10T07:59:40.409 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.689+0000 7efe26ffd640 1 --2- 172.21.15.22:0/2145901723 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7efe10038fc0 0x7efe1003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:40.409 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.689+0000 7efe26ffd640 1 --2- 172.21.15.22:0/2145901723 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7efe10038fc0 0x7efe1003b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe1c0098c0 tx=0x7efe1c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:40.409 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.693+0000 7efe24ff9640 1 -- 172.21.15.22:0/2145901723 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe1804b170 con 0x7efe28106500 2024-09-10T07:59:40.409 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.870+0000 7efe2e0bc640 1 -- 172.21.15.22:0/2145901723 --> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7efe2802daa0 con 0x7efe10038fc0 2024-09-10T07:59:40.409 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.871+0000 7efe24ff9640 1 -- 172.21.15.22:0/2145901723 <== mgr.14118 v2:172.21.15.22:6800/17773609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7efe2802daa0 con 0x7efe10038fc0 2024-09-10T07:59:40.410 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.873+0000 7efe2e0bc640 1 -- 172.21.15.22:0/2145901723 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7efe10038fc0 msgr2=0x7efe1003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:40.410 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.873+0000 7efe2e0bc640 1 --2- 172.21.15.22:0/2145901723 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7efe10038fc0 0x7efe1003b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe1c0098c0 tx=0x7efe1c006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.410 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.873+0000 7efe2e0bc640 1 -- 172.21.15.22:0/2145901723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 msgr2=0x7efe2819b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:40.410 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.873+0000 7efe2e0bc640 1 --2- 172.21.15.22:0/2145901723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 0x7efe2819b610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe18009940 tx=0x7efe18032ce0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.410 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.873+0000 7efe2e0bc640 1 -- 172.21.15.22:0/2145901723 shutdown_connections 2024-09-10T07:59:40.410 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.873+0000 7efe2e0bc640 1 --2- 172.21.15.22:0/2145901723 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7efe10038fc0 0x7efe1003b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.410 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.873+0000 7efe2e0bc640 1 --2- 172.21.15.22:0/2145901723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe28106500 0x7efe2819b610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:40.410 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.873+0000 7efe2e0bc640 1 -- 172.21.15.22:0/2145901723 >> 172.21.15.22:0/2145901723 conn(0x7efe28101d10 msgr2=0x7efe28102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:40.410 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.873+0000 7efe2e0bc640 1 -- 172.21.15.22:0/2145901723 shutdown_connections 2024-09-10T07:59:40.410 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:39.873+0000 7efe2e0bc640 1 -- 172.21.15.22:0/2145901723 wait complete. 2024-09-10T07:59:40.410 INFO:teuthology.orchestra.run.smithi022.stdout:Generating ssh key... 2024-09-10T07:59:41.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:40 smithi022 ceph-mon[30854]: [10/Sep/2024:07:59:39] ENGINE Serving on http://172.21.15.22:8765 2024-09-10T07:59:41.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:40 smithi022 ceph-mon[30854]: [10/Sep/2024:07:59:39] ENGINE Serving on https://172.21.15.22:7150 2024-09-10T07:59:41.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:40 smithi022 ceph-mon[30854]: [10/Sep/2024:07:59:39] ENGINE Bus STARTED 2024-09-10T07:59:41.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:40 smithi022 ceph-mon[30854]: [10/Sep/2024:07:59:39] ENGINE Error in HTTPServer.serve 2024-09-10T07:59:41.256 INFO:journalctl@ceph.mon.a.smithi022.stdout: Traceback (most recent call last): 2024-09-10T07:59:41.256 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T07:59:41.256 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._connections.run(self.expiration_interval) 2024-09-10T07:59:41.256 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T07:59:41.256 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._run(expiration_interval) 2024-09-10T07:59:41.256 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T07:59:41.256 INFO:journalctl@ceph.mon.a.smithi022.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T07:59:41.256 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T07:59:41.257 INFO:journalctl@ceph.mon.a.smithi022.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T07:59:41.257 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T07:59:41.257 INFO:journalctl@ceph.mon.a.smithi022.stdout: s = self.context.wrap_socket( 2024-09-10T07:59:41.257 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T07:59:41.257 INFO:journalctl@ceph.mon.a.smithi022.stdout: return self.sslsocket_class._create( 2024-09-10T07:59:41.257 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T07:59:41.257 INFO:journalctl@ceph.mon.a.smithi022.stdout: self.do_handshake() 2024-09-10T07:59:41.257 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T07:59:41.257 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._sslobj.do_handshake() 2024-09-10T07:59:41.257 INFO:journalctl@ceph.mon.a.smithi022.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T07:59:41.257 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:40 smithi022 ceph-mon[30854]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:42.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-mon[30854]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:42.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-mon[30854]: Generating ssh key... 2024-09-10T07:59:42.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:42.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:42.253 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: Generating public/private rsa key pair. 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: Your identification has been saved in /tmp/tmpppyotkni/key 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: Your public key has been saved in /tmp/tmpppyotkni/key.pub 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: The key fingerprint is: 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: SHA256:xW6w5Q8vTtRVlFLKXeVQPXq+u7l2iJPJnGS0U4k/f2M ceph-71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: The key's randomart image is: 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: +---[RSA 3072]----+ 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: | o+X| 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: | . ..o*o| 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: | . + ++oo| 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: | B .ooo. | 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: | S *..+o | 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: | o += o. | 2024-09-10T07:59:42.254 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: | o=o* +.| 2024-09-10T07:59:42.255 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: | o .O .E=| 2024-09-10T07:59:42.255 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: | . .o=B| 2024-09-10T07:59:42.255 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: +----[SHA256]-----+ 2024-09-10T07:59:42.479 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.828+0000 7fd4e7315640 1 Processor -- start 2024-09-10T07:59:42.480 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.828+0000 7fd4e7315640 1 -- start start 2024-09-10T07:59:42.480 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.828+0000 7fd4e7315640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 0x7fd4e0107a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:42.480 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.828+0000 7fd4e7315640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e0108000 con 0x7fd4e0107630 2024-09-10T07:59:42.480 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.829+0000 7fd4e50b1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 0x7fd4e0107a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.829+0000 7fd4e50b1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 0x7fd4e0107a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46686/0 (socket says 172.21.15.22:46686) 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.829+0000 7fd4e50b1640 1 -- 172.21.15.22:0/2804090228 learned_addr learned my addr 172.21.15.22:0/2804090228 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.829+0000 7fd4e50b1640 1 -- 172.21.15.22:0/2804090228 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e01087e0 con 0x7fd4e0107630 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.830+0000 7fd4e50b1640 1 --2- 172.21.15.22:0/2804090228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 0x7fd4e0107a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009820 tx=0x7fd4dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85879ce17e7d1232 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.830+0000 7fd4d7fff640 1 -- 172.21.15.22:0/2804090228 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4dc037070 con 0x7fd4e0107630 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.830+0000 7fd4d7fff640 1 -- 172.21.15.22:0/2804090228 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4dc032900 con 0x7fd4e0107630 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.830+0000 7fd4d7fff640 1 -- 172.21.15.22:0/2804090228 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4dc030850 con 0x7fd4e0107630 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.830+0000 7fd4e7315640 1 -- 172.21.15.22:0/2804090228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 msgr2=0x7fd4e0107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.830+0000 7fd4e7315640 1 --2- 172.21.15.22:0/2804090228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 0x7fd4e0107a30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc009820 tx=0x7fd4dc02a270 comp rx=0 tx=0).stop 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.830+0000 7fd4e7315640 1 -- 172.21.15.22:0/2804090228 shutdown_connections 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.830+0000 7fd4e7315640 1 --2- 172.21.15.22:0/2804090228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 0x7fd4e0107a30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.830+0000 7fd4e7315640 1 -- 172.21.15.22:0/2804090228 >> 172.21.15.22:0/2804090228 conn(0x7fd4e0102da0 msgr2=0x7fd4e0105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:42.481 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.831+0000 7fd4e7315640 1 -- 172.21.15.22:0/2804090228 shutdown_connections 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.831+0000 7fd4e7315640 1 -- 172.21.15.22:0/2804090228 wait complete. 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.831+0000 7fd4e7315640 1 Processor -- start 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.831+0000 7fd4e7315640 1 -- start start 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.831+0000 7fd4e7315640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 0x7fd4e007db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.831+0000 7fd4e7315640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e010bb90 con 0x7fd4e0107630 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.832+0000 7fd4e50b1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 0x7fd4e007db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.832+0000 7fd4e50b1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 0x7fd4e007db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46700/0 (socket says 172.21.15.22:46700) 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.832+0000 7fd4e50b1640 1 -- 172.21.15.22:0/1461735298 learned_addr learned my addr 172.21.15.22:0/1461735298 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.832+0000 7fd4e50b1640 1 -- 172.21.15.22:0/1461735298 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e007e080 con 0x7fd4e0107630 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.832+0000 7fd4e50b1640 1 --2- 172.21.15.22:0/1461735298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 0x7fd4e007db40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0097f0 tx=0x7fd4dc030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.832+0000 7fd4d67fc640 1 -- 172.21.15.22:0/1461735298 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4dc042070 con 0x7fd4e0107630 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.832+0000 7fd4d67fc640 1 -- 172.21.15.22:0/1461735298 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4dc032ca0 con 0x7fd4e0107630 2024-09-10T07:59:42.482 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.832+0000 7fd4e7315640 1 -- 172.21.15.22:0/1461735298 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e007c270 con 0x7fd4e0107630 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.832+0000 7fd4d67fc640 1 -- 172.21.15.22:0/1461735298 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4dc037040 con 0x7fd4e0107630 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.832+0000 7fd4e7315640 1 -- 172.21.15.22:0/1461735298 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e007c7b0 con 0x7fd4e0107630 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.833+0000 7fd4d67fc640 1 -- 172.21.15.22:0/1461735298 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fd4dc045070 con 0x7fd4e0107630 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.833+0000 7fd4e7315640 1 -- 172.21.15.22:0/1461735298 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e0107ab0 con 0x7fd4e0107630 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.834+0000 7fd4d67fc640 1 --2- 172.21.15.22:0/1461735298 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7fd4cc038fc0 0x7fd4cc03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.834+0000 7fd4d67fc640 1 -- 172.21.15.22:0/1461735298 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd4dc06c010 con 0x7fd4e0107630 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.834+0000 7fd4e48b0640 1 --2- 172.21.15.22:0/1461735298 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7fd4cc038fc0 0x7fd4cc03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.834+0000 7fd4e48b0640 1 --2- 172.21.15.22:0/1461735298 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7fd4cc038fc0 0x7fd4cc03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00098c0 tx=0x7fd4d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:40.838+0000 7fd4d67fc640 1 -- 172.21.15.22:0/1461735298 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4dc03ac60 con 0x7fd4e0107630 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:41.015+0000 7fd4e7315640 1 -- 172.21.15.22:0/1461735298 --> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fd4e0104060 con 0x7fd4cc038fc0 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:41.804+0000 7fd4d67fc640 1 -- 172.21.15.22:0/1461735298 <== mgr.14118 v2:172.21.15.22:6800/17773609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd4e0104060 con 0x7fd4cc038fc0 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:41.806+0000 7fd4e7315640 1 -- 172.21.15.22:0/1461735298 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7fd4cc038fc0 msgr2=0x7fd4cc03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:41.806+0000 7fd4e7315640 1 --2- 172.21.15.22:0/1461735298 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7fd4cc038fc0 0x7fd4cc03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00098c0 tx=0x7fd4d0006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:42.483 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:41.806+0000 7fd4e7315640 1 -- 172.21.15.22:0/1461735298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 msgr2=0x7fd4e007db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:42.484 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:41.806+0000 7fd4e7315640 1 --2- 172.21.15.22:0/1461735298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 0x7fd4e007db40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0097f0 tx=0x7fd4dc030ec0 comp rx=0 tx=0).stop 2024-09-10T07:59:42.484 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:41.806+0000 7fd4e7315640 1 -- 172.21.15.22:0/1461735298 shutdown_connections 2024-09-10T07:59:42.484 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:41.806+0000 7fd4e7315640 1 --2- 172.21.15.22:0/1461735298 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7fd4cc038fc0 0x7fd4cc03b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:42.484 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:41.806+0000 7fd4e7315640 1 --2- 172.21.15.22:0/1461735298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd4e0107630 0x7fd4e007db40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:42.484 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:41.806+0000 7fd4e7315640 1 -- 172.21.15.22:0/1461735298 >> 172.21.15.22:0/1461735298 conn(0x7fd4e0102da0 msgr2=0x7fd4e0103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:42.484 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:41.806+0000 7fd4e7315640 1 -- 172.21.15.22:0/1461735298 shutdown_connections 2024-09-10T07:59:42.484 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:41.806+0000 7fd4e7315640 1 -- 172.21.15.22:0/1461735298 wait complete. 2024-09-10T07:59:43.653 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:43 smithi022 ceph-mon[30854]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:43.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCcDW4/CUHRk7y9GgXowmlgK8RCCn/vNWPkSqDuvWz0PruIxIwABZaLJlgVKKe/NSIIyKwjk0Ef+fT3F5fPscj7tFsnU1iM4GH57d57xkjMvjDgXFVB8mkhgYE64ZZnRswKYD/qwW8Ig0/bcyr+UknoEQ/ICunX+i6kjQVYOt0UNPRwd68YbwXvusWSr7dq4c59OVXBwKXrY6V5VbmWTpDBHfbAASUOEgELSPnM6RcMhVjM8XNYcO7l8vTz3xVr2L2OTg/+SkgLNcUhfZnMct78LXHFMsahxJ5UZr5H5WgWluAp9smk6f4DtoPeB759fLdJ3VCg0u7hXvXzmrVVtJY7zIRULYP7yXOMRgLydA9tvNqV/uvUrUoIjRYLFowSLek5MqYh++7DCb+3eCbgC/YdEBLrt+pVC1WJd+oUprzLoXYDcYwrS9hUIjBgah0POzei/FPlfDppJ1t7idL3CPGJ4o6VmaiSP35SKCfsZ9+euy/PyBX9FsyGkaJJD+/ydU= ceph-71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T07:59:43.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.876+0000 7f6494821640 1 Processor -- start 2024-09-10T07:59:43.660 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.876+0000 7f6494821640 1 -- start start 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.876+0000 7f6494821640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 0x7f649010a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.876+0000 7f6494821640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f649007be00 con 0x7f6490108110 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.876+0000 7f648e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 0x7f649010a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.876+0000 7f648e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 0x7f649010a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46716/0 (socket says 172.21.15.22:46716) 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.876+0000 7f648e59c640 1 -- 172.21.15.22:0/3494185401 learned_addr learned my addr 172.21.15.22:0/3494185401 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.877+0000 7f648e59c640 1 -- 172.21.15.22:0/3494185401 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649010aa40 con 0x7f6490108110 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.877+0000 7f648e59c640 1 --2- 172.21.15.22:0/3494185401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 0x7f649010a500 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6480009820 tx=0x7f648002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75e63682e2ab386 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.878+0000 7f648d59a640 1 -- 172.21.15.22:0/3494185401 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6480037070 con 0x7f6490108110 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.878+0000 7f648d59a640 1 -- 172.21.15.22:0/3494185401 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6480032900 con 0x7f6490108110 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.878+0000 7f648d59a640 1 -- 172.21.15.22:0/3494185401 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6480030850 con 0x7f6490108110 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.878+0000 7f6494821640 1 -- 172.21.15.22:0/3494185401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 msgr2=0x7f649010a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.878+0000 7f6494821640 1 --2- 172.21.15.22:0/3494185401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 0x7f649010a500 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6480009820 tx=0x7f648002a270 comp rx=0 tx=0).stop 2024-09-10T07:59:43.661 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.878+0000 7f6494821640 1 -- 172.21.15.22:0/3494185401 shutdown_connections 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.878+0000 7f6494821640 1 --2- 172.21.15.22:0/3494185401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 0x7f649010a500 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.878+0000 7f6494821640 1 -- 172.21.15.22:0/3494185401 >> 172.21.15.22:0/3494185401 conn(0x7f6490101cb0 msgr2=0x7f64901040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.878+0000 7f6494821640 1 -- 172.21.15.22:0/3494185401 shutdown_connections 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.878+0000 7f6494821640 1 -- 172.21.15.22:0/3494185401 wait complete. 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.879+0000 7f6494821640 1 Processor -- start 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.879+0000 7f6494821640 1 -- start start 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.879+0000 7f6494821640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 0x7f6490107990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.879+0000 7f6494821640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f649010ba20 con 0x7f6490108110 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.879+0000 7f648e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 0x7f6490107990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.879+0000 7f648e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 0x7f6490107990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46726/0 (socket says 172.21.15.22:46726) 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.879+0000 7f648e59c640 1 -- 172.21.15.22:0/788839570 learned_addr learned my addr 172.21.15.22:0/788839570 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.880+0000 7f648e59c640 1 -- 172.21.15.22:0/788839570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6490107ed0 con 0x7f6490108110 2024-09-10T07:59:43.662 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.880+0000 7f648e59c640 1 --2- 172.21.15.22:0/788839570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 0x7f6490107990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64800097f0 tx=0x7f6480030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.880+0000 7f647f7fe640 1 -- 172.21.15.22:0/788839570 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6480042070 con 0x7f6490108110 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.880+0000 7f647f7fe640 1 -- 172.21.15.22:0/788839570 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6480032ca0 con 0x7f6490108110 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.880+0000 7f6494821640 1 -- 172.21.15.22:0/788839570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64901060c0 con 0x7f6490108110 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.880+0000 7f647f7fe640 1 -- 172.21.15.22:0/788839570 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6480037040 con 0x7f6490108110 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.880+0000 7f6494821640 1 -- 172.21.15.22:0/788839570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6490106600 con 0x7f6490108110 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.881+0000 7f647f7fe640 1 -- 172.21.15.22:0/788839570 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6480045070 con 0x7f6490108110 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.881+0000 7f6494821640 1 -- 172.21.15.22:0/788839570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6490108570 con 0x7f6490108110 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.881+0000 7f647f7fe640 1 --2- 172.21.15.22:0/788839570 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f6478038f70 0x7f647803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.881+0000 7f647f7fe640 1 -- 172.21.15.22:0/788839570 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f648006c1b0 con 0x7f6490108110 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.882+0000 7f648dd9b640 1 --2- 172.21.15.22:0/788839570 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f6478038f70 0x7f647803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.882+0000 7f648dd9b640 1 --2- 172.21.15.22:0/788839570 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f6478038f70 0x7f647803b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f64840098c0 tx=0x7f6484006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:42.886+0000 7f647f7fe640 1 -- 172.21.15.22:0/788839570 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6480045520 con 0x7f6490108110 2024-09-10T07:59:43.663 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:43.063+0000 7f6494821640 1 -- 172.21.15.22:0/788839570 --> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f6490106e40 con 0x7f6478038f70 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:43.064+0000 7f647f7fe640 1 -- 172.21.15.22:0/788839570 <== mgr.14118 v2:172.21.15.22:6800/17773609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f6490106e40 con 0x7f6478038f70 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:43.066+0000 7f6494821640 1 -- 172.21.15.22:0/788839570 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f6478038f70 msgr2=0x7f647803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:43.066+0000 7f6494821640 1 --2- 172.21.15.22:0/788839570 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f6478038f70 0x7f647803b430 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f64840098c0 tx=0x7f6484006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:43.066+0000 7f6494821640 1 -- 172.21.15.22:0/788839570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 msgr2=0x7f6490107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:43.066+0000 7f6494821640 1 --2- 172.21.15.22:0/788839570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 0x7f6490107990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64800097f0 tx=0x7f6480030ec0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:43.066+0000 7f6494821640 1 -- 172.21.15.22:0/788839570 shutdown_connections 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:43.066+0000 7f6494821640 1 --2- 172.21.15.22:0/788839570 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f6478038f70 0x7f647803b430 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:43.066+0000 7f6494821640 1 --2- 172.21.15.22:0/788839570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6490108110 0x7f6490107990 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:43.066+0000 7f6494821640 1 -- 172.21.15.22:0/788839570 >> 172.21.15.22:0/788839570 conn(0x7f6490101cb0 msgr2=0x7f64901028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:43.066+0000 7f6494821640 1 -- 172.21.15.22:0/788839570 shutdown_connections 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:43.066+0000 7f6494821640 1 -- 172.21.15.22:0/788839570 wait complete. 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T07:59:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T07:59:43.668 INFO:teuthology.orchestra.run.smithi022.stdout:Adding host smithi022... 2024-09-10T07:59:44.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:44 smithi022 ceph-mon[30854]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi022", "addr": "172.21.15.22", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:45.883 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:45 smithi022 ceph-mon[30854]: Deploying cephadm binary to smithi022 2024-09-10T07:59:48.752 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Added host 'smithi022' with addr '172.21.15.22' 2024-09-10T07:59:48.752 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.049+0000 7f98268aa640 1 Processor -- start 2024-09-10T07:59:48.752 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.049+0000 7f98268aa640 1 -- start start 2024-09-10T07:59:48.752 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.049+0000 7f98268aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 0x7f9820107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:48.752 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.049+0000 7f98268aa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9820107ff0 con 0x7f9820107620 2024-09-10T07:59:48.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.049+0000 7f981ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 0x7f9820107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:48.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.049+0000 7f981ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 0x7f9820107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48520/0 (socket says 172.21.15.22:48520) 2024-09-10T07:59:48.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.049+0000 7f981ffff640 1 -- 172.21.15.22:0/697664336 learned_addr learned my addr 172.21.15.22:0/697664336 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:48.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.049+0000 7f981ffff640 1 -- 172.21.15.22:0/697664336 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9820108820 con 0x7f9820107620 2024-09-10T07:59:48.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.050+0000 7f981ffff640 1 --2- 172.21.15.22:0/697664336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 0x7f9820107a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9810009820 tx=0x7f981002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8d5f130487639 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:48.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.050+0000 7f981f7fe640 1 -- 172.21.15.22:0/697664336 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9810037070 con 0x7f9820107620 2024-09-10T07:59:48.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.050+0000 7f981f7fe640 1 -- 172.21.15.22:0/697664336 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9810032900 con 0x7f9820107620 2024-09-10T07:59:48.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.050+0000 7f981f7fe640 1 -- 172.21.15.22:0/697664336 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9810030850 con 0x7f9820107620 2024-09-10T07:59:48.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.051+0000 7f98268aa640 1 -- 172.21.15.22:0/697664336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 msgr2=0x7f9820107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:48.753 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.051+0000 7f98268aa640 1 --2- 172.21.15.22:0/697664336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 0x7f9820107a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9810009820 tx=0x7f981002a270 comp rx=0 tx=0).stop 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.051+0000 7f98268aa640 1 -- 172.21.15.22:0/697664336 shutdown_connections 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.051+0000 7f98268aa640 1 --2- 172.21.15.22:0/697664336 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 0x7f9820107a20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.051+0000 7f98268aa640 1 -- 172.21.15.22:0/697664336 >> 172.21.15.22:0/697664336 conn(0x7f9820102db0 msgr2=0x7f98201051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.051+0000 7f98268aa640 1 -- 172.21.15.22:0/697664336 shutdown_connections 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.051+0000 7f98268aa640 1 -- 172.21.15.22:0/697664336 wait complete. 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.052+0000 7f98268aa640 1 Processor -- start 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.052+0000 7f98268aa640 1 -- start start 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.052+0000 7f98268aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 0x7f982019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.052+0000 7f98268aa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f982010bbd0 con 0x7f9820107620 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.052+0000 7f981ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 0x7f982019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.052+0000 7f981ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 0x7f982019b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48526/0 (socket says 172.21.15.22:48526) 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.052+0000 7f981ffff640 1 -- 172.21.15.22:0/3503960165 learned_addr learned my addr 172.21.15.22:0/3503960165 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:48.754 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.052+0000 7f981ffff640 1 -- 172.21.15.22:0/3503960165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982019bb90 con 0x7f9820107620 2024-09-10T07:59:48.755 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.052+0000 7f981ffff640 1 --2- 172.21.15.22:0/3503960165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 0x7f982019b650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f98100097f0 tx=0x7f9810030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:48.755 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.053+0000 7f981dffb640 1 -- 172.21.15.22:0/3503960165 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9810042070 con 0x7f9820107620 2024-09-10T07:59:48.755 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.053+0000 7f98268aa640 1 -- 172.21.15.22:0/3503960165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982019be20 con 0x7f9820107620 2024-09-10T07:59:48.755 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.053+0000 7f981dffb640 1 -- 172.21.15.22:0/3503960165 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9810032ca0 con 0x7f9820107620 2024-09-10T07:59:48.755 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.053+0000 7f981dffb640 1 -- 172.21.15.22:0/3503960165 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9810037040 con 0x7f9820107620 2024-09-10T07:59:48.755 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.053+0000 7f98268aa640 1 -- 172.21.15.22:0/3503960165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982019eb10 con 0x7f9820107620 2024-09-10T07:59:48.756 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.054+0000 7f981dffb640 1 -- 172.21.15.22:0/3503960165 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f9810045070 con 0x7f9820107620 2024-09-10T07:59:48.756 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.054+0000 7f981dffb640 1 --2- 172.21.15.22:0/3503960165 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f980c038f70 0x7f980c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:48.756 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.054+0000 7f981dffb640 1 -- 172.21.15.22:0/3503960165 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f981006c010 con 0x7f9820107620 2024-09-10T07:59:48.756 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.054+0000 7f98268aa640 1 -- 172.21.15.22:0/3503960165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982010bd50 con 0x7f9820107620 2024-09-10T07:59:48.756 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.054+0000 7f9817fff640 1 --2- 172.21.15.22:0/3503960165 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f980c038f70 0x7f980c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:48.756 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.054+0000 7f9817fff640 1 --2- 172.21.15.22:0/3503960165 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f980c038f70 0x7f980c03b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f98080098c0 tx=0x7f9808006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:48.756 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.059+0000 7f981dffb640 1 -- 172.21.15.22:0/3503960165 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f981003db40 con 0x7f9820107620 2024-09-10T07:59:48.756 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:44.242+0000 7f98268aa640 1 -- 172.21.15.22:0/3503960165 --> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi022", "addr": "172.21.15.22", "target": ["mon-mgr", ""]}) -- 0x7f9820104070 con 0x7f980c038f70 2024-09-10T07:59:48.757 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:48.145+0000 7f981dffb640 1 -- 172.21.15.22:0/3503960165 <== mgr.14118 v2:172.21.15.22:6800/17773609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f9820104070 con 0x7f980c038f70 2024-09-10T07:59:48.757 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:48.148+0000 7f98268aa640 1 -- 172.21.15.22:0/3503960165 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f980c038f70 msgr2=0x7f980c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:48.757 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:48.148+0000 7f98268aa640 1 --2- 172.21.15.22:0/3503960165 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f980c038f70 0x7f980c03b430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f98080098c0 tx=0x7f9808006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:48.757 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:48.148+0000 7f98268aa640 1 -- 172.21.15.22:0/3503960165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 msgr2=0x7f982019b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:48.757 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:48.148+0000 7f98268aa640 1 --2- 172.21.15.22:0/3503960165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 0x7f982019b650 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f98100097f0 tx=0x7f9810030ec0 comp rx=0 tx=0).stop 2024-09-10T07:59:48.757 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:48.148+0000 7f98268aa640 1 -- 172.21.15.22:0/3503960165 shutdown_connections 2024-09-10T07:59:48.757 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:48.148+0000 7f98268aa640 1 --2- 172.21.15.22:0/3503960165 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f980c038f70 0x7f980c03b430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:48.757 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:48.148+0000 7f98268aa640 1 --2- 172.21.15.22:0/3503960165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9820107620 0x7f982019b650 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:48.757 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:48.148+0000 7f98268aa640 1 -- 172.21.15.22:0/3503960165 >> 172.21.15.22:0/3503960165 conn(0x7f9820102db0 msgr2=0x7f9820103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:48.757 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:48.148+0000 7f98268aa640 1 -- 172.21.15.22:0/3503960165 shutdown_connections 2024-09-10T07:59:48.757 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:48.148+0000 7f98268aa640 1 -- 172.21.15.22:0/3503960165 wait complete. 2024-09-10T07:59:48.757 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mon service... 2024-09-10T07:59:49.393 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:49 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:49.393 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:49 smithi022 ceph-mon[30854]: Added host smithi022 2024-09-10T07:59:49.393 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:49 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T07:59:50.186 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T07:59:50.187 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.189+0000 7faa1edb5640 1 Processor -- start 2024-09-10T07:59:50.187 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.190+0000 7faa1edb5640 1 -- start start 2024-09-10T07:59:50.187 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.190+0000 7faa1edb5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 0x7faa18107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:50.187 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.190+0000 7faa1edb5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa18107ff0 con 0x7faa18107620 2024-09-10T07:59:50.187 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.190+0000 7faa1cb51640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 0x7faa18107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:50.187 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.190+0000 7faa1cb51640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 0x7faa18107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48530/0 (socket says 172.21.15.22:48530) 2024-09-10T07:59:50.187 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.190+0000 7faa1cb51640 1 -- 172.21.15.22:0/2938110312 learned_addr learned my addr 172.21.15.22:0/2938110312 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:50.187 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.191+0000 7faa1cb51640 1 -- 172.21.15.22:0/2938110312 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa18108820 con 0x7faa18107620 2024-09-10T07:59:50.187 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.191+0000 7faa1cb51640 1 --2- 172.21.15.22:0/2938110312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 0x7faa18107a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009820 tx=0x7faa0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6fbeed07033593 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:50.188 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.191+0000 7faa177fe640 1 -- 172.21.15.22:0/2938110312 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa0c037070 con 0x7faa18107620 2024-09-10T07:59:50.188 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.191+0000 7faa177fe640 1 -- 172.21.15.22:0/2938110312 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa0c032900 con 0x7faa18107620 2024-09-10T07:59:50.188 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.191+0000 7faa177fe640 1 -- 172.21.15.22:0/2938110312 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa0c030850 con 0x7faa18107620 2024-09-10T07:59:50.188 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.192+0000 7faa1edb5640 1 -- 172.21.15.22:0/2938110312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 msgr2=0x7faa18107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:50.188 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.192+0000 7faa1edb5640 1 --2- 172.21.15.22:0/2938110312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 0x7faa18107a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009820 tx=0x7faa0c02a270 comp rx=0 tx=0).stop 2024-09-10T07:59:50.188 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.192+0000 7faa1edb5640 1 -- 172.21.15.22:0/2938110312 shutdown_connections 2024-09-10T07:59:50.188 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.192+0000 7faa1edb5640 1 --2- 172.21.15.22:0/2938110312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 0x7faa18107a20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:50.188 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.192+0000 7faa1edb5640 1 -- 172.21.15.22:0/2938110312 >> 172.21.15.22:0/2938110312 conn(0x7faa18102db0 msgr2=0x7faa181051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:50.188 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.192+0000 7faa1edb5640 1 -- 172.21.15.22:0/2938110312 shutdown_connections 2024-09-10T07:59:50.188 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.192+0000 7faa1edb5640 1 -- 172.21.15.22:0/2938110312 wait complete. 2024-09-10T07:59:50.188 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.193+0000 7faa1edb5640 1 Processor -- start 2024-09-10T07:59:50.189 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.193+0000 7faa1edb5640 1 -- start start 2024-09-10T07:59:50.189 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.193+0000 7faa1edb5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 0x7faa1807db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:50.189 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.193+0000 7faa1edb5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa1810bbd0 con 0x7faa18107620 2024-09-10T07:59:50.189 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.193+0000 7faa1cb51640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 0x7faa1807db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:50.189 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.193+0000 7faa1cb51640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 0x7faa1807db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48538/0 (socket says 172.21.15.22:48538) 2024-09-10T07:59:50.189 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.193+0000 7faa1cb51640 1 -- 172.21.15.22:0/3743578829 learned_addr learned my addr 172.21.15.22:0/3743578829 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:50.189 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.193+0000 7faa1cb51640 1 -- 172.21.15.22:0/3743578829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa1807e080 con 0x7faa18107620 2024-09-10T07:59:50.189 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.193+0000 7faa1cb51640 1 --2- 172.21.15.22:0/3743578829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 0x7faa1807db40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009940 tx=0x7faa0c0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:50.189 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.194+0000 7faa15ffb640 1 -- 172.21.15.22:0/3743578829 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa0c042070 con 0x7faa18107620 2024-09-10T07:59:50.189 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.194+0000 7faa15ffb640 1 -- 172.21.15.22:0/3743578829 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa0c032be0 con 0x7faa18107620 2024-09-10T07:59:50.189 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.194+0000 7faa1edb5640 1 -- 172.21.15.22:0/3743578829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa1807c270 con 0x7faa18107620 2024-09-10T07:59:50.189 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.194+0000 7faa15ffb640 1 -- 172.21.15.22:0/3743578829 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa0c037040 con 0x7faa18107620 2024-09-10T07:59:50.190 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.194+0000 7faa1edb5640 1 -- 172.21.15.22:0/3743578829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa1807c7b0 con 0x7faa18107620 2024-09-10T07:59:50.190 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.195+0000 7faa15ffb640 1 -- 172.21.15.22:0/3743578829 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7faa0c045070 con 0x7faa18107620 2024-09-10T07:59:50.190 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.195+0000 7faa15ffb640 1 --2- 172.21.15.22:0/3743578829 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7faa08038fc0 0x7faa0803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:50.190 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.195+0000 7faa15ffb640 1 -- 172.21.15.22:0/3743578829 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faa0c06bef0 con 0x7faa18107620 2024-09-10T07:59:50.190 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.195+0000 7faa1edb5640 1 -- 172.21.15.22:0/3743578829 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa1810bd50 con 0x7faa18107620 2024-09-10T07:59:50.190 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.195+0000 7faa17fff640 1 --2- 172.21.15.22:0/3743578829 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7faa08038fc0 0x7faa0803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:50.190 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.195+0000 7faa17fff640 1 --2- 172.21.15.22:0/3743578829 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7faa08038fc0 0x7faa0803b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faa040098c0 tx=0x7faa04006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:50.190 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.200+0000 7faa15ffb640 1 -- 172.21.15.22:0/3743578829 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa0c045360 con 0x7faa18107620 2024-09-10T07:59:50.190 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.393+0000 7faa1edb5640 1 -- 172.21.15.22:0/3743578829 --> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7faa18104460 con 0x7faa08038fc0 2024-09-10T07:59:50.190 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.398+0000 7faa15ffb640 1 -- 172.21.15.22:0/3743578829 <== mgr.14118 v2:172.21.15.22:6800/17773609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7faa18104460 con 0x7faa08038fc0 2024-09-10T07:59:50.190 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.400+0000 7faa1edb5640 1 -- 172.21.15.22:0/3743578829 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7faa08038fc0 msgr2=0x7faa0803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:50.190 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.400+0000 7faa1edb5640 1 --2- 172.21.15.22:0/3743578829 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7faa08038fc0 0x7faa0803b480 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7faa040098c0 tx=0x7faa04006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:50.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.400+0000 7faa1edb5640 1 -- 172.21.15.22:0/3743578829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 msgr2=0x7faa1807db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:50.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.400+0000 7faa1edb5640 1 --2- 172.21.15.22:0/3743578829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 0x7faa1807db40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009940 tx=0x7faa0c0326e0 comp rx=0 tx=0).stop 2024-09-10T07:59:50.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.400+0000 7faa1edb5640 1 -- 172.21.15.22:0/3743578829 shutdown_connections 2024-09-10T07:59:50.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.400+0000 7faa1edb5640 1 --2- 172.21.15.22:0/3743578829 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7faa08038fc0 0x7faa0803b480 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:50.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.400+0000 7faa1edb5640 1 --2- 172.21.15.22:0/3743578829 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa18107620 0x7faa1807db40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:50.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.400+0000 7faa1edb5640 1 -- 172.21.15.22:0/3743578829 >> 172.21.15.22:0/3743578829 conn(0x7faa18102db0 msgr2=0x7faa18103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:50.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.400+0000 7faa1edb5640 1 -- 172.21.15.22:0/3743578829 shutdown_connections 2024-09-10T07:59:50.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:49.400+0000 7faa1edb5640 1 -- 172.21.15.22:0/3743578829 wait complete. 2024-09-10T07:59:50.191 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mgr service... 2024-09-10T07:59:50.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:50 smithi022 ceph-mon[30854]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:50.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:50 smithi022 ceph-mon[30854]: Saving service mon spec with placement count:5 2024-09-10T07:59:50.454 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:50 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:51.714 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.641+0000 7f425be2e640 1 Processor -- start 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.641+0000 7f425be2e640 1 -- start start 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.641+0000 7f425be2e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 0x7f4254107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.641+0000 7f425be2e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4254107ff0 con 0x7f4254107620 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.641+0000 7f4259bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 0x7f4254107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.641+0000 7f4259bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 0x7f4254107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48552/0 (socket says 172.21.15.22:48552) 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.641+0000 7f4259bca640 1 -- 172.21.15.22:0/3388619650 learned_addr learned my addr 172.21.15.22:0/3388619650 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.641+0000 7f4259bca640 1 -- 172.21.15.22:0/3388619650 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4254108820 con 0x7f4254107620 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.642+0000 7f4259bca640 1 --2- 172.21.15.22:0/3388619650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 0x7f4254107a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4250009820 tx=0x7f425002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50f85ae27e764cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.642+0000 7f4258bc8640 1 -- 172.21.15.22:0/3388619650 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4250037070 con 0x7f4254107620 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.642+0000 7f4258bc8640 1 -- 172.21.15.22:0/3388619650 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4250032900 con 0x7f4254107620 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.642+0000 7f4258bc8640 1 -- 172.21.15.22:0/3388619650 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4250030850 con 0x7f4254107620 2024-09-10T07:59:51.715 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.643+0000 7f425be2e640 1 -- 172.21.15.22:0/3388619650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 msgr2=0x7f4254107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:51.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.643+0000 7f425be2e640 1 --2- 172.21.15.22:0/3388619650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 0x7f4254107a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4250009820 tx=0x7f425002a270 comp rx=0 tx=0).stop 2024-09-10T07:59:51.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.643+0000 7f425be2e640 1 -- 172.21.15.22:0/3388619650 shutdown_connections 2024-09-10T07:59:51.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.643+0000 7f425be2e640 1 --2- 172.21.15.22:0/3388619650 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 0x7f4254107a20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:51.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.643+0000 7f425be2e640 1 -- 172.21.15.22:0/3388619650 >> 172.21.15.22:0/3388619650 conn(0x7f4254102db0 msgr2=0x7f42541051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:51.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.643+0000 7f425be2e640 1 -- 172.21.15.22:0/3388619650 shutdown_connections 2024-09-10T07:59:51.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.643+0000 7f425be2e640 1 -- 172.21.15.22:0/3388619650 wait complete. 2024-09-10T07:59:51.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.644+0000 7f425be2e640 1 Processor -- start 2024-09-10T07:59:51.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.644+0000 7f425be2e640 1 -- start start 2024-09-10T07:59:51.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.644+0000 7f425be2e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 0x7f425407db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:51.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.644+0000 7f425be2e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f425410bbd0 con 0x7f4254107620 2024-09-10T07:59:51.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.644+0000 7f4259bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 0x7f425407db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:51.716 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.644+0000 7f4259bca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 0x7f425407db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48566/0 (socket says 172.21.15.22:48566) 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.644+0000 7f4259bca640 1 -- 172.21.15.22:0/2459799653 learned_addr learned my addr 172.21.15.22:0/2459799653 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.644+0000 7f4259bca640 1 -- 172.21.15.22:0/2459799653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425407e080 con 0x7f4254107620 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.644+0000 7f4259bca640 1 --2- 172.21.15.22:0/2459799653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 0x7f425407db40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f42500097f0 tx=0x7f4250030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.645+0000 7f424affd640 1 -- 172.21.15.22:0/2459799653 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4250042070 con 0x7f4254107620 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.645+0000 7f424affd640 1 -- 172.21.15.22:0/2459799653 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4250032ca0 con 0x7f4254107620 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.645+0000 7f425be2e640 1 -- 172.21.15.22:0/2459799653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f425407c270 con 0x7f4254107620 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.645+0000 7f424affd640 1 -- 172.21.15.22:0/2459799653 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4250037040 con 0x7f4254107620 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.645+0000 7f425be2e640 1 -- 172.21.15.22:0/2459799653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f425407c7b0 con 0x7f4254107620 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.646+0000 7f425be2e640 1 -- 172.21.15.22:0/2459799653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f425410bd50 con 0x7f4254107620 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.646+0000 7f424affd640 1 -- 172.21.15.22:0/2459799653 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f4250045070 con 0x7f4254107620 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.646+0000 7f424affd640 1 --2- 172.21.15.22:0/2459799653 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f4240038f70 0x7f424003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.646+0000 7f424affd640 1 -- 172.21.15.22:0/2459799653 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f425006beb0 con 0x7f4254107620 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.646+0000 7f42593c9640 1 --2- 172.21.15.22:0/2459799653 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f4240038f70 0x7f424003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:51.717 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.646+0000 7f42593c9640 1 --2- 172.21.15.22:0/2459799653 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f4240038f70 0x7f424003b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f42440098c0 tx=0x7f4244006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.651+0000 7f424affd640 1 -- 172.21.15.22:0/2459799653 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f425004b170 con 0x7f4254107620 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.837+0000 7f425be2e640 1 -- 172.21.15.22:0/2459799653 --> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f425407d040 con 0x7f4240038f70 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.842+0000 7f424affd640 1 -- 172.21.15.22:0/2459799653 <== mgr.14118 v2:172.21.15.22:6800/17773609 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f425407d040 con 0x7f4240038f70 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.843+0000 7f425be2e640 1 -- 172.21.15.22:0/2459799653 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f4240038f70 msgr2=0x7f424003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.843+0000 7f425be2e640 1 --2- 172.21.15.22:0/2459799653 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f4240038f70 0x7f424003b430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f42440098c0 tx=0x7f4244006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.843+0000 7f425be2e640 1 -- 172.21.15.22:0/2459799653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 msgr2=0x7f425407db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.843+0000 7f425be2e640 1 --2- 172.21.15.22:0/2459799653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 0x7f425407db40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f42500097f0 tx=0x7f4250030ec0 comp rx=0 tx=0).stop 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.844+0000 7f425be2e640 1 -- 172.21.15.22:0/2459799653 shutdown_connections 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.844+0000 7f425be2e640 1 --2- 172.21.15.22:0/2459799653 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f4240038f70 0x7f424003b430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.844+0000 7f425be2e640 1 --2- 172.21.15.22:0/2459799653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4254107620 0x7f425407db40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.844+0000 7f425be2e640 1 -- 172.21.15.22:0/2459799653 >> 172.21.15.22:0/2459799653 conn(0x7f4254102db0 msgr2=0x7f4254103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.844+0000 7f425be2e640 1 -- 172.21.15.22:0/2459799653 shutdown_connections 2024-09-10T07:59:51.718 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:50.844+0000 7f425be2e640 1 -- 172.21.15.22:0/2459799653 wait complete. 2024-09-10T07:59:52.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:51 smithi022 ceph-mon[30854]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T07:59:52.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:51 smithi022 ceph-mon[30854]: Saving service mgr spec with placement count:2 2024-09-10T07:59:52.135 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:51 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:53.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.140+0000 7fe628b95640 1 Processor -- start 2024-09-10T07:59:53.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.140+0000 7fe628b95640 1 -- start start 2024-09-10T07:59:53.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.140+0000 7fe628b95640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 0x7fe62410a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:53.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.140+0000 7fe628b95640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe62407bdb0 con 0x7fe624108100 2024-09-10T07:59:53.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.141+0000 7fe62259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 0x7fe62410a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:53.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.141+0000 7fe62259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 0x7fe62410a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48582/0 (socket says 172.21.15.22:48582) 2024-09-10T07:59:53.191 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.141+0000 7fe62259c640 1 -- 172.21.15.22:0/138712542 learned_addr learned my addr 172.21.15.22:0/138712542 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:53.192 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.141+0000 7fe62259c640 1 -- 172.21.15.22:0/138712542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62410aa30 con 0x7fe624108100 2024-09-10T07:59:53.192 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.142+0000 7fe62259c640 1 --2- 172.21.15.22:0/138712542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 0x7fe62410a4f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009e80 tx=0x7fe61c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1484efde752c8884 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:53.192 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.142+0000 7fe62159a640 1 -- 172.21.15.22:0/138712542 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe61c036070 con 0x7fe624108100 2024-09-10T07:59:53.192 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.142+0000 7fe62159a640 1 -- 172.21.15.22:0/138712542 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe61c0318c0 con 0x7fe624108100 2024-09-10T07:59:53.192 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.142+0000 7fe62159a640 1 -- 172.21.15.22:0/138712542 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe61c007ab0 con 0x7fe624108100 2024-09-10T07:59:53.192 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.142+0000 7fe628b95640 1 -- 172.21.15.22:0/138712542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 msgr2=0x7fe62410a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:53.192 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.142+0000 7fe628b95640 1 --2- 172.21.15.22:0/138712542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 0x7fe62410a4f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009e80 tx=0x7fe61c02a7a0 comp rx=0 tx=0).stop 2024-09-10T07:59:53.192 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.143+0000 7fe628b95640 1 -- 172.21.15.22:0/138712542 shutdown_connections 2024-09-10T07:59:53.192 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.143+0000 7fe628b95640 1 --2- 172.21.15.22:0/138712542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 0x7fe62410a4f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:53.192 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.143+0000 7fe628b95640 1 -- 172.21.15.22:0/138712542 >> 172.21.15.22:0/138712542 conn(0x7fe624101ca0 msgr2=0x7fe6241040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:53.192 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.143+0000 7fe628b95640 1 -- 172.21.15.22:0/138712542 shutdown_connections 2024-09-10T07:59:53.192 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.143+0000 7fe628b95640 1 -- 172.21.15.22:0/138712542 wait complete. 2024-09-10T07:59:53.193 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.143+0000 7fe628b95640 1 Processor -- start 2024-09-10T07:59:53.193 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.144+0000 7fe628b95640 1 -- start start 2024-09-10T07:59:53.193 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.144+0000 7fe628b95640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 0x7fe62419b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:53.193 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.144+0000 7fe628b95640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe62410b9b0 con 0x7fe624108100 2024-09-10T07:59:53.193 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.144+0000 7fe62259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 0x7fe62419b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:53.193 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.144+0000 7fe62259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 0x7fe62419b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48586/0 (socket says 172.21.15.22:48586) 2024-09-10T07:59:53.193 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.144+0000 7fe62259c640 1 -- 172.21.15.22:0/980906424 learned_addr learned my addr 172.21.15.22:0/980906424 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:53.193 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.144+0000 7fe62259c640 1 -- 172.21.15.22:0/980906424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62419bb70 con 0x7fe624108100 2024-09-10T07:59:53.193 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.144+0000 7fe62259c640 1 --2- 172.21.15.22:0/980906424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 0x7fe62419b630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe61c031ca0 tx=0x7fe61c031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:53.193 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.144+0000 7fe61b7fe640 1 -- 172.21.15.22:0/980906424 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe61c036050 con 0x7fe624108100 2024-09-10T07:59:53.193 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.145+0000 7fe61b7fe640 1 -- 172.21.15.22:0/980906424 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe61c042070 con 0x7fe624108100 2024-09-10T07:59:53.193 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.145+0000 7fe628b95640 1 -- 172.21.15.22:0/980906424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62419be00 con 0x7fe624108100 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.145+0000 7fe61b7fe640 1 -- 172.21.15.22:0/980906424 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe61c03d940 con 0x7fe624108100 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.145+0000 7fe628b95640 1 -- 172.21.15.22:0/980906424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62419eaf0 con 0x7fe624108100 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.145+0000 7fe61b7fe640 1 -- 172.21.15.22:0/980906424 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe61c03dbf0 con 0x7fe624108100 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.146+0000 7fe628b95640 1 -- 172.21.15.22:0/980906424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe624108560 con 0x7fe624108100 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.146+0000 7fe61b7fe640 1 --2- 172.21.15.22:0/980906424 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7fe610038fc0 0x7fe61003b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.146+0000 7fe61b7fe640 1 -- 172.21.15.22:0/980906424 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe61c007e00 con 0x7fe624108100 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.146+0000 7fe621d9b640 1 --2- 172.21.15.22:0/980906424 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7fe610038fc0 0x7fe61003b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.146+0000 7fe621d9b640 1 --2- 172.21.15.22:0/980906424 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7fe610038fc0 0x7fe61003b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0098c0 tx=0x7fe60c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.151+0000 7fe61b7fe640 1 -- 172.21.15.22:0/980906424 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe61c047510 con 0x7fe624108100 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.331+0000 7fe628b95640 1 -- 172.21.15.22:0/980906424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fe62419f100 con 0x7fe624108100 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.333+0000 7fe61b7fe640 1 -- 172.21.15.22:0/980906424 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7fe61c007310 con 0x7fe624108100 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.335+0000 7fe628b95640 1 -- 172.21.15.22:0/980906424 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7fe610038fc0 msgr2=0x7fe61003b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:53.194 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.335+0000 7fe628b95640 1 --2- 172.21.15.22:0/980906424 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7fe610038fc0 0x7fe61003b480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe60c0098c0 tx=0x7fe60c006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:53.195 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.335+0000 7fe628b95640 1 -- 172.21.15.22:0/980906424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 msgr2=0x7fe62419b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:53.195 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.335+0000 7fe628b95640 1 --2- 172.21.15.22:0/980906424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 0x7fe62419b630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe61c031ca0 tx=0x7fe61c031cd0 comp rx=0 tx=0).stop 2024-09-10T07:59:53.195 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.335+0000 7fe628b95640 1 -- 172.21.15.22:0/980906424 shutdown_connections 2024-09-10T07:59:53.195 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.335+0000 7fe628b95640 1 --2- 172.21.15.22:0/980906424 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7fe610038fc0 0x7fe61003b480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:53.195 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.335+0000 7fe628b95640 1 --2- 172.21.15.22:0/980906424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe624108100 0x7fe62419b630 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:53.195 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.335+0000 7fe628b95640 1 -- 172.21.15.22:0/980906424 >> 172.21.15.22:0/980906424 conn(0x7fe624101ca0 msgr2=0x7fe6241028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:53.195 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.336+0000 7fe628b95640 1 -- 172.21.15.22:0/980906424 shutdown_connections 2024-09-10T07:59:53.195 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:52.336+0000 7fe628b95640 1 -- 172.21.15.22:0/980906424 wait complete. 2024-09-10T07:59:53.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:53 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/980906424' entity='client.admin' 2024-09-10T07:59:53.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:53 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:54.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.630+0000 7f753f2be640 1 Processor -- start 2024-09-10T07:59:54.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.631+0000 7f753f2be640 1 -- start start 2024-09-10T07:59:54.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.631+0000 7f753f2be640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 0x7f753810a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:54.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.631+0000 7f753f2be640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f753807be40 con 0x7f75381080d0 2024-09-10T07:59:54.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.631+0000 7f753d05a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 0x7f753810a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:54.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.631+0000 7f753d05a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 0x7f753810a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41688/0 (socket says 172.21.15.22:41688) 2024-09-10T07:59:54.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.631+0000 7f753d05a640 1 -- 172.21.15.22:0/550222062 learned_addr learned my addr 172.21.15.22:0/550222062 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:54.356 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.631+0000 7f753d05a640 1 -- 172.21.15.22:0/550222062 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753810aa00 con 0x7f75381080d0 2024-09-10T07:59:54.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.632+0000 7f753d05a640 1 --2- 172.21.15.22:0/550222062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 0x7f753810a4c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7534009820 tx=0x7f753402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d8ac84d2ea426e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:54.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.632+0000 7f752ffff640 1 -- 172.21.15.22:0/550222062 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7534037070 con 0x7f75381080d0 2024-09-10T07:59:54.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.632+0000 7f752ffff640 1 -- 172.21.15.22:0/550222062 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7534032920 con 0x7f75381080d0 2024-09-10T07:59:54.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.632+0000 7f752ffff640 1 -- 172.21.15.22:0/550222062 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7534030810 con 0x7f75381080d0 2024-09-10T07:59:54.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.633+0000 7f753f2be640 1 -- 172.21.15.22:0/550222062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 msgr2=0x7f753810a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:54.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.633+0000 7f753f2be640 1 --2- 172.21.15.22:0/550222062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 0x7f753810a4c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7534009820 tx=0x7f753402a270 comp rx=0 tx=0).stop 2024-09-10T07:59:54.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.633+0000 7f753f2be640 1 -- 172.21.15.22:0/550222062 shutdown_connections 2024-09-10T07:59:54.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.633+0000 7f753f2be640 1 --2- 172.21.15.22:0/550222062 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 0x7f753810a4c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:54.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.633+0000 7f753f2be640 1 -- 172.21.15.22:0/550222062 >> 172.21.15.22:0/550222062 conn(0x7f7538101cb0 msgr2=0x7f75381040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:54.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.633+0000 7f753f2be640 1 -- 172.21.15.22:0/550222062 shutdown_connections 2024-09-10T07:59:54.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.633+0000 7f753f2be640 1 -- 172.21.15.22:0/550222062 wait complete. 2024-09-10T07:59:54.357 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.634+0000 7f753f2be640 1 Processor -- start 2024-09-10T07:59:54.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.634+0000 7f753f2be640 1 -- start start 2024-09-10T07:59:54.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.634+0000 7f753f2be640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 0x7f753819b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:54.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.634+0000 7f753f2be640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f753810ba80 con 0x7f75381080d0 2024-09-10T07:59:54.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.634+0000 7f753d05a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 0x7f753819b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:54.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.634+0000 7f753d05a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 0x7f753819b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41702/0 (socket says 172.21.15.22:41702) 2024-09-10T07:59:54.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.634+0000 7f753d05a640 1 -- 172.21.15.22:0/2415204015 learned_addr learned my addr 172.21.15.22:0/2415204015 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:54.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.634+0000 7f753d05a640 1 -- 172.21.15.22:0/2415204015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753819bbc0 con 0x7f75381080d0 2024-09-10T07:59:54.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.634+0000 7f753d05a640 1 --2- 172.21.15.22:0/2415204015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 0x7f753819b680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7534030420 tx=0x7f7534032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:54.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.634+0000 7f752e7fc640 1 -- 172.21.15.22:0/2415204015 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7534037040 con 0x7f75381080d0 2024-09-10T07:59:54.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.635+0000 7f753f2be640 1 -- 172.21.15.22:0/2415204015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753819be50 con 0x7f75381080d0 2024-09-10T07:59:54.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.635+0000 7f752e7fc640 1 -- 172.21.15.22:0/2415204015 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7534040070 con 0x7f75381080d0 2024-09-10T07:59:54.358 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.635+0000 7f752e7fc640 1 -- 172.21.15.22:0/2415204015 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f753403a6e0 con 0x7f75381080d0 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.635+0000 7f753f2be640 1 -- 172.21.15.22:0/2415204015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f753819eb40 con 0x7f75381080d0 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.635+0000 7f752e7fc640 1 -- 172.21.15.22:0/2415204015 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f753403b420 con 0x7f75381080d0 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.635+0000 7f753f2be640 1 -- 172.21.15.22:0/2415204015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7538108530 con 0x7f75381080d0 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.636+0000 7f752e7fc640 1 --2- 172.21.15.22:0/2415204015 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f7524038f70 0x7f752403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.636+0000 7f752e7fc640 1 -- 172.21.15.22:0/2415204015 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f753406c5b0 con 0x7f75381080d0 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.636+0000 7f753c859640 1 --2- 172.21.15.22:0/2415204015 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f7524038f70 0x7f752403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.636+0000 7f753c859640 1 --2- 172.21.15.22:0/2415204015 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f7524038f70 0x7f752403b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f75280098c0 tx=0x7f7528006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.640+0000 7f752e7fc640 1 -- 172.21.15.22:0/2415204015 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f753403b710 con 0x7f75381080d0 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.832+0000 7f753f2be640 1 -- 172.21.15.22:0/2415204015 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f753819ed10 con 0x7f75381080d0 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.834+0000 7f752e7fc640 1 -- 172.21.15.22:0/2415204015 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f7534044e10 con 0x7f75381080d0 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.836+0000 7f753f2be640 1 -- 172.21.15.22:0/2415204015 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f7524038f70 msgr2=0x7f752403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.836+0000 7f753f2be640 1 --2- 172.21.15.22:0/2415204015 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f7524038f70 0x7f752403b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f75280098c0 tx=0x7f7528006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:54.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.836+0000 7f753f2be640 1 -- 172.21.15.22:0/2415204015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 msgr2=0x7f753819b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:54.360 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.836+0000 7f753f2be640 1 --2- 172.21.15.22:0/2415204015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 0x7f753819b680 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7534030420 tx=0x7f7534032670 comp rx=0 tx=0).stop 2024-09-10T07:59:54.360 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.837+0000 7f753f2be640 1 -- 172.21.15.22:0/2415204015 shutdown_connections 2024-09-10T07:59:54.360 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.837+0000 7f753f2be640 1 --2- 172.21.15.22:0/2415204015 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f7524038f70 0x7f752403b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:54.360 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.837+0000 7f753f2be640 1 --2- 172.21.15.22:0/2415204015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75381080d0 0x7f753819b680 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:54.360 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.837+0000 7f753f2be640 1 -- 172.21.15.22:0/2415204015 >> 172.21.15.22:0/2415204015 conn(0x7f7538101cb0 msgr2=0x7f75381028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:54.360 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.837+0000 7f753f2be640 1 -- 172.21.15.22:0/2415204015 shutdown_connections 2024-09-10T07:59:54.360 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:53.837+0000 7f753f2be640 1 -- 172.21.15.22:0/2415204015 wait complete. 2024-09-10T07:59:54.360 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling the dashboard module... 2024-09-10T07:59:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:54 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:54 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2415204015' entity='client.admin' 2024-09-10T07:59:56.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:55 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1148804167' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-10T07:59:56.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:55 smithi022 ceph-mon[30854]: from='mgr.14118 172.21.15.22:0/3733157137' entity='mgr.x' 2024-09-10T07:59:56.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:55 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: ignoring --setuser ceph since I am not root 2024-09-10T07:59:56.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:55 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: ignoring --setgroup ceph since I am not root 2024-09-10T07:59:56.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:55 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:55.887+0000 7f8f7c131040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T07:59:56.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:55 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:55.946+0000 7f8f7c131040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T07:59:56.329 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:56 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:56.105+0000 7f8f7c131040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T07:59:56.329 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:56 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:56.174+0000 7f8f7c131040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T07:59:56.329 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:56 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:56.328+0000 7f8f7c131040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:59:56.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.815+0000 7f8826030640 1 Processor -- start 2024-09-10T07:59:56.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.815+0000 7f8826030640 1 -- start start 2024-09-10T07:59:56.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.816+0000 7f8826030640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 0x7f882010a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:56.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.816+0000 7f8826030640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f882007be30 con 0x7f8820108080 2024-09-10T07:59:56.397 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.816+0000 7f881f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 0x7f882010a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:56.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.816+0000 7f881f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 0x7f882010a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41712/0 (socket says 172.21.15.22:41712) 2024-09-10T07:59:56.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.816+0000 7f881f7fe640 1 -- 172.21.15.22:0/2760611659 learned_addr learned my addr 172.21.15.22:0/2760611659 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:56.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.816+0000 7f881f7fe640 1 -- 172.21.15.22:0/2760611659 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882010a9b0 con 0x7f8820108080 2024-09-10T07:59:56.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.817+0000 7f881f7fe640 1 --2- 172.21.15.22:0/2760611659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 0x7f882010a470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8810009820 tx=0x7f881002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21bb995abfde999 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:56.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.817+0000 7f881e7fc640 1 -- 172.21.15.22:0/2760611659 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8810037070 con 0x7f8820108080 2024-09-10T07:59:56.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.817+0000 7f881e7fc640 1 -- 172.21.15.22:0/2760611659 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8810032920 con 0x7f8820108080 2024-09-10T07:59:56.398 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.817+0000 7f881e7fc640 1 -- 172.21.15.22:0/2760611659 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8810030810 con 0x7f8820108080 2024-09-10T07:59:56.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.818+0000 7f8826030640 1 -- 172.21.15.22:0/2760611659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 msgr2=0x7f882010a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:56.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.818+0000 7f8826030640 1 --2- 172.21.15.22:0/2760611659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 0x7f882010a470 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8810009820 tx=0x7f881002a270 comp rx=0 tx=0).stop 2024-09-10T07:59:56.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.818+0000 7f8826030640 1 -- 172.21.15.22:0/2760611659 shutdown_connections 2024-09-10T07:59:56.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.818+0000 7f8826030640 1 --2- 172.21.15.22:0/2760611659 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 0x7f882010a470 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:56.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.818+0000 7f8826030640 1 -- 172.21.15.22:0/2760611659 >> 172.21.15.22:0/2760611659 conn(0x7f8820101ca0 msgr2=0x7f88201040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:56.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.818+0000 7f8826030640 1 -- 172.21.15.22:0/2760611659 shutdown_connections 2024-09-10T07:59:56.399 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.818+0000 7f8826030640 1 -- 172.21.15.22:0/2760611659 wait complete. 2024-09-10T07:59:56.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.819+0000 7f8826030640 1 Processor -- start 2024-09-10T07:59:56.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.819+0000 7f8826030640 1 -- start start 2024-09-10T07:59:56.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.819+0000 7f8826030640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 0x7f882019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:56.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.819+0000 7f8826030640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f882010ba30 con 0x7f8820108080 2024-09-10T07:59:56.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.819+0000 7f881f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 0x7f882019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:56.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.819+0000 7f881f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 0x7f882019b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41726/0 (socket says 172.21.15.22:41726) 2024-09-10T07:59:56.400 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.819+0000 7f881f7fe640 1 -- 172.21.15.22:0/1148804167 learned_addr learned my addr 172.21.15.22:0/1148804167 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:56.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.820+0000 7f881f7fe640 1 -- 172.21.15.22:0/1148804167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882019bb90 con 0x7f8820108080 2024-09-10T07:59:56.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.820+0000 7f881f7fe640 1 --2- 172.21.15.22:0/1148804167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 0x7f882019b650 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88100097f0 tx=0x7f88100327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:56.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.820+0000 7f881cff9640 1 -- 172.21.15.22:0/1148804167 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8810037040 con 0x7f8820108080 2024-09-10T07:59:56.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.820+0000 7f881cff9640 1 -- 172.21.15.22:0/1148804167 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8810030c40 con 0x7f8820108080 2024-09-10T07:59:56.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.820+0000 7f8826030640 1 -- 172.21.15.22:0/1148804167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882019be20 con 0x7f8820108080 2024-09-10T07:59:56.401 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.820+0000 7f881cff9640 1 -- 172.21.15.22:0/1148804167 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f881003a5d0 con 0x7f8820108080 2024-09-10T07:59:56.402 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.820+0000 7f8826030640 1 -- 172.21.15.22:0/1148804167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882019eb10 con 0x7f8820108080 2024-09-10T07:59:56.402 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.821+0000 7f881cff9640 1 -- 172.21.15.22:0/1148804167 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f881003a810 con 0x7f8820108080 2024-09-10T07:59:56.402 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.821+0000 7f8826030640 1 -- 172.21.15.22:0/1148804167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88201084e0 con 0x7f8820108080 2024-09-10T07:59:56.402 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.822+0000 7f881cff9640 1 --2- 172.21.15.22:0/1148804167 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f880c038f70 0x7f880c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:56.402 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.822+0000 7f881cff9640 1 -- 172.21.15.22:0/1148804167 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f881006c4a0 con 0x7f8820108080 2024-09-10T07:59:56.402 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.822+0000 7f881effd640 1 --2- 172.21.15.22:0/1148804167 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f880c038f70 0x7f880c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:56.403 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.822+0000 7f881effd640 1 --2- 172.21.15.22:0/1148804167 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f880c038f70 0x7f880c03b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f88080098c0 tx=0x7f8808006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:56.403 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:54.827+0000 7f881cff9640 1 -- 172.21.15.22:0/1148804167 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8810030df0 con 0x7f8820108080 2024-09-10T07:59:56.403 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.065+0000 7f8826030640 1 -- 172.21.15.22:0/1148804167 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f882019ece0 con 0x7f8820108080 2024-09-10T07:59:56.403 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.727+0000 7f881cff9640 1 -- 172.21.15.22:0/1148804167 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f8810031c00 con 0x7f8820108080 2024-09-10T07:59:56.403 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.729+0000 7f881cff9640 1 -- 172.21.15.22:0/1148804167 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f881002fd60 con 0x7f8820108080 2024-09-10T07:59:56.403 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.730+0000 7f8826030640 1 -- 172.21.15.22:0/1148804167 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f880c038f70 msgr2=0x7f880c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:56.403 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.730+0000 7f8826030640 1 --2- 172.21.15.22:0/1148804167 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f880c038f70 0x7f880c03b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f88080098c0 tx=0x7f8808006db0 comp rx=0 tx=0).stop 2024-09-10T07:59:56.404 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.730+0000 7f8826030640 1 -- 172.21.15.22:0/1148804167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 msgr2=0x7f882019b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:56.404 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.730+0000 7f8826030640 1 --2- 172.21.15.22:0/1148804167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 0x7f882019b650 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88100097f0 tx=0x7f88100327b0 comp rx=0 tx=0).stop 2024-09-10T07:59:56.404 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.730+0000 7f8826030640 1 -- 172.21.15.22:0/1148804167 shutdown_connections 2024-09-10T07:59:56.404 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.730+0000 7f8826030640 1 --2- 172.21.15.22:0/1148804167 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f880c038f70 0x7f880c03b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:56.404 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.730+0000 7f8826030640 1 --2- 172.21.15.22:0/1148804167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8820108080 0x7f882019b650 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:56.404 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.731+0000 7f8826030640 1 -- 172.21.15.22:0/1148804167 >> 172.21.15.22:0/1148804167 conn(0x7f8820101ca0 msgr2=0x7f8820102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:56.404 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.731+0000 7f8826030640 1 -- 172.21.15.22:0/1148804167 shutdown_connections 2024-09-10T07:59:56.405 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:55.731+0000 7f8826030640 1 -- 172.21.15.22:0/1148804167 wait complete. 2024-09-10T07:59:56.585 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:56 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:56.486+0000 7f8f7c131040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T07:59:56.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:56 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1148804167' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T07:59:56.886 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:56 smithi022 ceph-mon[30854]: mgrmap e9: x(active, since 19s) 2024-09-10T07:59:56.887 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:56 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:56.823+0000 7f8f7c131040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T07:59:57.152 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:56 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:56.888+0000 7f8f7c131040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T07:59:57.152 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:57 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:57.086+0000 7f8f7c131040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T07:59:57.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-10T07:59:57.650 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T07:59:57.651 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T07:59:57.651 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T07:59:57.651 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T07:59:57.651 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-10T07:59:57.651 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.885+0000 7f2090244640 1 Processor -- start 2024-09-10T07:59:57.651 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.885+0000 7f2090244640 1 -- start start 2024-09-10T07:59:57.651 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.886+0000 7f2090244640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 0x7f208810a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:57.651 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.886+0000 7f2090244640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f208807bd90 con 0x7f2088108120 2024-09-10T07:59:57.651 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.886+0000 7f208dfe0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 0x7f208810a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:57.651 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.886+0000 7f208dfe0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 0x7f208810a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41752/0 (socket says 172.21.15.22:41752) 2024-09-10T07:59:57.651 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.886+0000 7f208dfe0640 1 -- 172.21.15.22:0/574519950 learned_addr learned my addr 172.21.15.22:0/574519950 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:57.651 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.886+0000 7f208dfe0640 1 -- 172.21.15.22:0/574519950 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f208810aa50 con 0x7f2088108120 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.887+0000 7f208dfe0640 1 --2- 172.21.15.22:0/574519950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 0x7f208810a510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2084009820 tx=0x7f208402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74631e76dd3f7307 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.887+0000 7f208cfde640 1 -- 172.21.15.22:0/574519950 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2084037070 con 0x7f2088108120 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.888+0000 7f208cfde640 1 -- 172.21.15.22:0/574519950 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2084032920 con 0x7f2088108120 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.888+0000 7f208cfde640 1 -- 172.21.15.22:0/574519950 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2084030810 con 0x7f2088108120 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.888+0000 7f2090244640 1 -- 172.21.15.22:0/574519950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 msgr2=0x7f208810a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.888+0000 7f2090244640 1 --2- 172.21.15.22:0/574519950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 0x7f208810a510 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2084009820 tx=0x7f208402a270 comp rx=0 tx=0).stop 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.888+0000 7f2090244640 1 -- 172.21.15.22:0/574519950 shutdown_connections 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.888+0000 7f2090244640 1 --2- 172.21.15.22:0/574519950 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 0x7f208810a510 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.888+0000 7f2090244640 1 -- 172.21.15.22:0/574519950 >> 172.21.15.22:0/574519950 conn(0x7f2088101ca0 msgr2=0x7f20881040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.889+0000 7f2090244640 1 -- 172.21.15.22:0/574519950 shutdown_connections 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.889+0000 7f2090244640 1 -- 172.21.15.22:0/574519950 wait complete. 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.889+0000 7f2090244640 1 Processor -- start 2024-09-10T07:59:57.652 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.889+0000 7f2090244640 1 -- start start 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.889+0000 7f2090244640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 0x7f20881079a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.889+0000 7f2090244640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f208810ba10 con 0x7f2088108120 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.889+0000 7f208dfe0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 0x7f20881079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.889+0000 7f208dfe0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 0x7f20881079a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41756/0 (socket says 172.21.15.22:41756) 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.889+0000 7f208dfe0640 1 -- 172.21.15.22:0/748934654 learned_addr learned my addr 172.21.15.22:0/748934654 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.890+0000 7f208dfe0640 1 -- 172.21.15.22:0/748934654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2088107ee0 con 0x7f2088108120 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.890+0000 7f208dfe0640 1 --2- 172.21.15.22:0/748934654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 0x7f20881079a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20840097f0 tx=0x7f20840327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.890+0000 7f207effd640 1 -- 172.21.15.22:0/748934654 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2084037040 con 0x7f2088108120 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.890+0000 7f2090244640 1 -- 172.21.15.22:0/748934654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20881060d0 con 0x7f2088108120 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.890+0000 7f207effd640 1 -- 172.21.15.22:0/748934654 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2084030c40 con 0x7f2088108120 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.890+0000 7f207effd640 1 -- 172.21.15.22:0/748934654 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f208403a5d0 con 0x7f2088108120 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.890+0000 7f2090244640 1 -- 172.21.15.22:0/748934654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2088106610 con 0x7f2088108120 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.891+0000 7f207effd640 1 -- 172.21.15.22:0/748934654 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f208403a810 con 0x7f2088108120 2024-09-10T07:59:57.653 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.891+0000 7f2090244640 1 -- 172.21.15.22:0/748934654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2088108580 con 0x7f2088108120 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.891+0000 7f207effd640 1 --2- 172.21.15.22:0/748934654 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f2074038fc0 0x7f207403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.891+0000 7f208d7df640 1 -- 172.21.15.22:0/748934654 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f2074038fc0 msgr2=0x7f207403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/17773609 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.891+0000 7f207effd640 1 -- 172.21.15.22:0/748934654 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f208406c590 con 0x7f2088108120 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.891+0000 7f208d7df640 1 --2- 172.21.15.22:0/748934654 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f2074038fc0 0x7f207403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:56.896+0000 7f207effd640 1 -- 172.21.15.22:0/748934654 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f20840371e0 con 0x7f2088108120 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.092+0000 7f208d7df640 1 -- 172.21.15.22:0/748934654 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f2074038fc0 msgr2=0x7f207403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/17773609 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.092+0000 7f208d7df640 1 --2- 172.21.15.22:0/748934654 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f2074038fc0 0x7f207403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.119+0000 7f2090244640 1 -- 172.21.15.22:0/748934654 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f2088106890 con 0x7f2088108120 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.119+0000 7f207effd640 1 -- 172.21.15.22:0/748934654 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f208406bf20 con 0x7f2088108120 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.121+0000 7f2090244640 1 -- 172.21.15.22:0/748934654 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f2074038fc0 msgr2=0x7f207403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.121+0000 7f2090244640 1 --2- 172.21.15.22:0/748934654 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f2074038fc0 0x7f207403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.121+0000 7f2090244640 1 -- 172.21.15.22:0/748934654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 msgr2=0x7f20881079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T07:59:57.654 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.121+0000 7f2090244640 1 --2- 172.21.15.22:0/748934654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 0x7f20881079a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f20840097f0 tx=0x7f20840327b0 comp rx=0 tx=0).stop 2024-09-10T07:59:57.655 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.122+0000 7f2090244640 1 -- 172.21.15.22:0/748934654 shutdown_connections 2024-09-10T07:59:57.655 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.122+0000 7f2090244640 1 --2- 172.21.15.22:0/748934654 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f2074038fc0 0x7f207403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:57.655 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.122+0000 7f2090244640 1 --2- 172.21.15.22:0/748934654 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2088108120 0x7f20881079a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T07:59:57.655 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.122+0000 7f2090244640 1 -- 172.21.15.22:0/748934654 >> 172.21.15.22:0/748934654 conn(0x7f2088101ca0 msgr2=0x7f2088102860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T07:59:57.655 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.122+0000 7f2090244640 1 -- 172.21.15.22:0/748934654 shutdown_connections 2024-09-10T07:59:57.655 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:57.122+0000 7f2090244640 1 -- 172.21.15.22:0/748934654 wait complete. 2024-09-10T07:59:57.655 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2024-09-10T07:59:57.655 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 9... 2024-09-10T07:59:57.978 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 07:59:57 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/748934654' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-10T07:59:58.253 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:58 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:58.057+0000 7f8f7c131040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T07:59:58.253 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:58 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:58.131+0000 7f8f7c131040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T07:59:59.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:58 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:58.885+0000 7f8f7c131040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T07:59:59.377 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:59.006+0000 7f8f7c131040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T07:59:59.377 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:59.156+0000 7f8f7c131040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T07:59:59.377 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:59.220+0000 7f8f7c131040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T07:59:59.377 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:59.376+0000 7f8f7c131040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T07:59:59.677 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:59.447+0000 7f8f7c131040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T07:59:59.677 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:59.511+0000 7f8f7c131040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T07:59:59.677 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:59.676+0000 7f8f7c131040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T07:59:59.963 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:59.744+0000 7f8f7c131040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T07:59:59.963 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:59.814+0000 7f8f7c131040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T07:59:59.963 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:59.901+0000 7f8f7c131040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T07:59:59.963 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 07:59:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T07:59:59.963+0000 7f8f7c131040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:00:00.253 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:00:00.024+0000 7f8f7c131040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:00:01.116 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:00:00.855+0000 7f8f7c131040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: Active manager daemon x restarted 2024-09-10T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: Activating manager daemon x 2024-09-10T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: mgrmap e10: x(active, starting, since 0.0037702s) 2024-09-10T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: Manager daemon x is now available 2024-09-10T08:00:01.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:00:01.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T08:00:01.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:00 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T08:00:02.502 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:00:02.449+0000 7f8ee7445640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:08:00:02] ENGINE Error in HTTPServer.serve 2024-09-10T08:00:02.502 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: Traceback (most recent call last): 2024-09-10T08:00:02.502 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T08:00:02.502 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: self._connections.run(self.expiration_interval) 2024-09-10T08:00:02.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T08:00:02.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: self._run(expiration_interval) 2024-09-10T08:00:02.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T08:00:02.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T08:00:02.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T08:00:02.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T08:00:02.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T08:00:02.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: s = self.context.wrap_socket( 2024-09-10T08:00:02.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T08:00:02.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: return self.sslsocket_class._create( 2024-09-10T08:00:02.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T08:00:02.504 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: self.do_handshake() 2024-09-10T08:00:02.504 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T08:00:02.504 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: self._sslobj.do_handshake() 2024-09-10T08:00:02.504 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T08:00:02.504 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:00:02.787 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-10T08:00:02.787 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T08:00:02.787 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T08:00:02.787 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-10T08:00:02.787 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.061+0000 7f9a686e4640 1 Processor -- start 2024-09-10T08:00:02.787 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.062+0000 7f9a686e4640 1 -- start start 2024-09-10T08:00:02.787 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.062+0000 7f9a686e4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 0x7f9a6010a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:02.787 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.062+0000 7f9a686e4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6007be00 con 0x7f9a601080f0 2024-09-10T08:00:02.788 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.062+0000 7f9a66480640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 0x7f9a6010a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:02.788 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.062+0000 7f9a66480640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 0x7f9a6010a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41768/0 (socket says 172.21.15.22:41768) 2024-09-10T08:00:02.788 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.062+0000 7f9a66480640 1 -- 172.21.15.22:0/1728188643 learned_addr learned my addr 172.21.15.22:0/1728188643 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:02.788 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.063+0000 7f9a66480640 1 -- 172.21.15.22:0/1728188643 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6010aa20 con 0x7f9a601080f0 2024-09-10T08:00:02.788 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.064+0000 7f9a66480640 1 --2- 172.21.15.22:0/1728188643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 0x7f9a6010a4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009820 tx=0x7f9a5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed86c51d9fd6d8ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:02.788 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.064+0000 7f9a6547e640 1 -- 172.21.15.22:0/1728188643 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c037070 con 0x7f9a601080f0 2024-09-10T08:00:02.788 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.064+0000 7f9a6547e640 1 -- 172.21.15.22:0/1728188643 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a5c032920 con 0x7f9a601080f0 2024-09-10T08:00:02.788 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.064+0000 7f9a6547e640 1 -- 172.21.15.22:0/1728188643 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c030810 con 0x7f9a601080f0 2024-09-10T08:00:02.788 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.065+0000 7f9a686e4640 1 -- 172.21.15.22:0/1728188643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 msgr2=0x7f9a6010a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:02.788 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.065+0000 7f9a686e4640 1 --2- 172.21.15.22:0/1728188643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 0x7f9a6010a4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009820 tx=0x7f9a5c02a270 comp rx=0 tx=0).stop 2024-09-10T08:00:02.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.065+0000 7f9a686e4640 1 -- 172.21.15.22:0/1728188643 shutdown_connections 2024-09-10T08:00:02.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.065+0000 7f9a686e4640 1 --2- 172.21.15.22:0/1728188643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 0x7f9a6010a4e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:02.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.065+0000 7f9a686e4640 1 -- 172.21.15.22:0/1728188643 >> 172.21.15.22:0/1728188643 conn(0x7f9a60101d10 msgr2=0x7f9a60104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:02.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.065+0000 7f9a686e4640 1 -- 172.21.15.22:0/1728188643 shutdown_connections 2024-09-10T08:00:02.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.065+0000 7f9a686e4640 1 -- 172.21.15.22:0/1728188643 wait complete. 2024-09-10T08:00:02.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.066+0000 7f9a686e4640 1 Processor -- start 2024-09-10T08:00:02.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.066+0000 7f9a686e4640 1 -- start start 2024-09-10T08:00:02.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.066+0000 7f9a686e4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 0x7f9a6019b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:02.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.066+0000 7f9a686e4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6010ba40 con 0x7f9a601080f0 2024-09-10T08:00:02.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.066+0000 7f9a66480640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 0x7f9a6019b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:02.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.066+0000 7f9a66480640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 0x7f9a6019b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41782/0 (socket says 172.21.15.22:41782) 2024-09-10T08:00:02.789 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.066+0000 7f9a66480640 1 -- 172.21.15.22:0/3976622243 learned_addr learned my addr 172.21.15.22:0/3976622243 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:02.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.066+0000 7f9a66480640 1 -- 172.21.15.22:0/3976622243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6019bb10 con 0x7f9a601080f0 2024-09-10T08:00:02.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.066+0000 7f9a66480640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 0x7f9a6019b5d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0097f0 tx=0x7f9a5c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:02.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.067+0000 7f9a577fe640 1 -- 172.21.15.22:0/3976622243 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c037040 con 0x7f9a601080f0 2024-09-10T08:00:02.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.067+0000 7f9a577fe640 1 -- 172.21.15.22:0/3976622243 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a5c030cc0 con 0x7f9a601080f0 2024-09-10T08:00:02.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.067+0000 7f9a686e4640 1 -- 172.21.15.22:0/3976622243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6019bda0 con 0x7f9a601080f0 2024-09-10T08:00:02.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.067+0000 7f9a577fe640 1 -- 172.21.15.22:0/3976622243 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c03a6b0 con 0x7f9a601080f0 2024-09-10T08:00:02.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.067+0000 7f9a686e4640 1 -- 172.21.15.22:0/3976622243 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a6019ea90 con 0x7f9a601080f0 2024-09-10T08:00:02.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.068+0000 7f9a577fe640 1 -- 172.21.15.22:0/3976622243 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f9a5c03b3f0 con 0x7f9a601080f0 2024-09-10T08:00:02.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.068+0000 7f9a577fe640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f9a4c039020 0x7f9a4c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:02.790 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.068+0000 7f9a577fe640 1 -- 172.21.15.22:0/3976622243 --> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9a4c03bbf0 con 0x7f9a4c039020 2024-09-10T08:00:02.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.068+0000 7f9a577fe640 1 -- 172.21.15.22:0/3976622243 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9a5c06c4e0 con 0x7f9a601080f0 2024-09-10T08:00:02.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.068+0000 7f9a65c7f640 1 -- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f9a4c039020 msgr2=0x7f9a4c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/17773609 2024-09-10T08:00:02.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.068+0000 7f9a65c7f640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f9a4c039020 0x7f9a4c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:00:02.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.269+0000 7f9a65c7f640 1 -- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f9a4c039020 msgr2=0x7f9a4c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/17773609 2024-09-10T08:00:02.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.269+0000 7f9a65c7f640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f9a4c039020 0x7f9a4c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:00:02.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.670+0000 7f9a65c7f640 1 -- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f9a4c039020 msgr2=0x7f9a4c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/17773609 2024-09-10T08:00:02.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:58.670+0000 7f9a65c7f640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f9a4c039020 0x7f9a4c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:00:02.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:59.471+0000 7f9a65c7f640 1 -- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f9a4c039020 msgr2=0x7f9a4c03b4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/17773609 2024-09-10T08:00:02.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T07:59:59.471+0000 7f9a65c7f640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f9a4c039020 0x7f9a4c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:00:02.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:00.858+0000 7f9a577fe640 1 -- 172.21.15.22:0/3976622243 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7f9a5c06af90 con 0x7f9a601080f0 2024-09-10T08:00:02.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:00.858+0000 7f9a577fe640 1 -- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f9a4c039020 msgr2=0x7f9a4c03b4e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:00:02.791 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:00.858+0000 7f9a577fe640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f9a4c039020 0x7f9a4c03b4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:02.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.860+0000 7f9a577fe640 1 -- 172.21.15.22:0/3976622243 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7f9a5c06b2b0 con 0x7f9a601080f0 2024-09-10T08:00:02.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.860+0000 7f9a577fe640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9a4c03cae0 0x7f9a4c03eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:02.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.860+0000 7f9a577fe640 1 -- 172.21.15.22:0/3976622243 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9a5c03eec0 con 0x7f9a4c03cae0 2024-09-10T08:00:02.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.861+0000 7f9a65c7f640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9a4c03cae0 0x7f9a4c03eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:02.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.862+0000 7f9a65c7f640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9a4c03cae0 0x7f9a4c03eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9a50003980 tx=0x7f9a500092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:02.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.862+0000 7f9a577fe640 1 -- 172.21.15.22:0/3976622243 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f9a5c03eec0 con 0x7f9a4c03cae0 2024-09-10T08:00:02.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.869+0000 7f9a686e4640 1 -- 172.21.15.22:0/3976622243 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f9a60108550 con 0x7f9a4c03cae0 2024-09-10T08:00:02.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.869+0000 7f9a577fe640 1 -- 172.21.15.22:0/3976622243 <== mgr.14150 v2:172.21.15.22:6800/1767260330 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f9a60108550 con 0x7f9a4c03cae0 2024-09-10T08:00:02.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.870+0000 7f9a686e4640 1 -- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9a4c03cae0 msgr2=0x7f9a4c03eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:02.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.870+0000 7f9a686e4640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9a4c03cae0 0x7f9a4c03eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9a50003980 tx=0x7f9a500092b0 comp rx=0 tx=0).stop 2024-09-10T08:00:02.792 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.870+0000 7f9a686e4640 1 -- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 msgr2=0x7f9a6019b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:02.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.870+0000 7f9a686e4640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 0x7f9a6019b5d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0097f0 tx=0x7f9a5c0327b0 comp rx=0 tx=0).stop 2024-09-10T08:00:02.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.870+0000 7f9a686e4640 1 -- 172.21.15.22:0/3976622243 shutdown_connections 2024-09-10T08:00:02.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.870+0000 7f9a686e4640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9a4c03cae0 0x7f9a4c03eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:02.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.870+0000 7f9a686e4640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:6800/17773609,v1:172.21.15.22:6801/17773609] conn(0x7f9a4c039020 0x7f9a4c03b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:02.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.870+0000 7f9a686e4640 1 --2- 172.21.15.22:0/3976622243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a601080f0 0x7f9a6019b5d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:02.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.870+0000 7f9a686e4640 1 -- 172.21.15.22:0/3976622243 >> 172.21.15.22:0/3976622243 conn(0x7f9a60101d10 msgr2=0x7f9a60102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:02.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.870+0000 7f9a686e4640 1 -- 172.21.15.22:0/3976622243 shutdown_connections 2024-09-10T08:00:02.793 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:01.870+0000 7f9a686e4640 1 -- 172.21.15.22:0/3976622243 wait complete. 2024-09-10T08:00:02.793 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 9 is available 2024-09-10T08:00:02.793 INFO:teuthology.orchestra.run.smithi022.stdout:Generating a dashboard self-signed certificate... 2024-09-10T08:00:03.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-mon[30854]: mgrmap e11: x(active, since 1.00606s) 2024-09-10T08:00:03.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:03.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-mon[30854]: [10/Sep/2024:08:00:02] ENGINE Bus STARTING 2024-09-10T08:00:03.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-mon[30854]: [10/Sep/2024:08:00:02] ENGINE Serving on https://172.21.15.22:7150 2024-09-10T08:00:03.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-mon[30854]: [10/Sep/2024:08:00:02] ENGINE Error in HTTPServer.serve 2024-09-10T08:00:03.089 INFO:journalctl@ceph.mon.a.smithi022.stdout: Traceback (most recent call last): 2024-09-10T08:00:03.089 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T08:00:03.089 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._connections.run(self.expiration_interval) 2024-09-10T08:00:03.089 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T08:00:03.089 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._run(expiration_interval) 2024-09-10T08:00:03.089 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout: s = self.context.wrap_socket( 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout: return self.sslsocket_class._create( 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout: self.do_handshake() 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._sslobj.do_handshake() 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T08:00:03.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-mon[30854]: [10/Sep/2024:08:00:02] ENGINE Serving on http://172.21.15.22:8765 2024-09-10T08:00:03.091 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:02 smithi022 ceph-mon[30854]: [10/Sep/2024:08:00:02] ENGINE Bus STARTED 2024-09-10T08:00:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-10T08:00:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.168+0000 7fbaf1862640 1 Processor -- start 2024-09-10T08:00:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.169+0000 7fbaf1862640 1 -- start start 2024-09-10T08:00:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.169+0000 7fbaf1862640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 0x7fbaec107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.169+0000 7fbaf1862640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbaec107ff0 con 0x7fbaec107620 2024-09-10T08:00:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.169+0000 7fbaeaffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 0x7fbaec107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.169+0000 7fbaeaffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 0x7fbaec107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41842/0 (socket says 172.21.15.22:41842) 2024-09-10T08:00:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.169+0000 7fbaeaffd640 1 -- 172.21.15.22:0/1055796548 learned_addr learned my addr 172.21.15.22:0/1055796548 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.170+0000 7fbaeaffd640 1 -- 172.21.15.22:0/1055796548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaec108820 con 0x7fbaec107620 2024-09-10T08:00:04.075 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.170+0000 7fbaeaffd640 1 --2- 172.21.15.22:0/1055796548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 0x7fbaec107a20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009820 tx=0x7fbadc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d84ce8ffe17c58e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.170+0000 7fbaea7fc640 1 -- 172.21.15.22:0/1055796548 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbadc037070 con 0x7fbaec107620 2024-09-10T08:00:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.170+0000 7fbaea7fc640 1 -- 172.21.15.22:0/1055796548 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbadc032920 con 0x7fbaec107620 2024-09-10T08:00:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.170+0000 7fbaea7fc640 1 -- 172.21.15.22:0/1055796548 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbadc030810 con 0x7fbaec107620 2024-09-10T08:00:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.171+0000 7fbaf1862640 1 -- 172.21.15.22:0/1055796548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 msgr2=0x7fbaec107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.171+0000 7fbaf1862640 1 --2- 172.21.15.22:0/1055796548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 0x7fbaec107a20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009820 tx=0x7fbadc02a270 comp rx=0 tx=0).stop 2024-09-10T08:00:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.171+0000 7fbaf1862640 1 -- 172.21.15.22:0/1055796548 shutdown_connections 2024-09-10T08:00:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.171+0000 7fbaf1862640 1 --2- 172.21.15.22:0/1055796548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 0x7fbaec107a20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.171+0000 7fbaf1862640 1 -- 172.21.15.22:0/1055796548 >> 172.21.15.22:0/1055796548 conn(0x7fbaec102db0 msgr2=0x7fbaec1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.171+0000 7fbaf1862640 1 -- 172.21.15.22:0/1055796548 shutdown_connections 2024-09-10T08:00:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.171+0000 7fbaf1862640 1 -- 172.21.15.22:0/1055796548 wait complete. 2024-09-10T08:00:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.172+0000 7fbaf1862640 1 Processor -- start 2024-09-10T08:00:04.076 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.172+0000 7fbaf1862640 1 -- start start 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.172+0000 7fbaf1862640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 0x7fbaec07db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.172+0000 7fbaf1862640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbaec10bbd0 con 0x7fbaec107620 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.172+0000 7fbaeaffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 0x7fbaec07db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.172+0000 7fbaeaffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 0x7fbaec07db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41848/0 (socket says 172.21.15.22:41848) 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.172+0000 7fbaeaffd640 1 -- 172.21.15.22:0/2819073133 learned_addr learned my addr 172.21.15.22:0/2819073133 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.172+0000 7fbaeaffd640 1 -- 172.21.15.22:0/2819073133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaec07e080 con 0x7fbaec107620 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.172+0000 7fbaeaffd640 1 --2- 172.21.15.22:0/2819073133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 0x7fbaec07db40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbadc030560 tx=0x7fbadc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.173+0000 7fbaf0860640 1 -- 172.21.15.22:0/2819073133 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbadc037040 con 0x7fbaec107620 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.173+0000 7fbaf0860640 1 -- 172.21.15.22:0/2819073133 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbadc040070 con 0x7fbaec107620 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.173+0000 7fbaf1862640 1 -- 172.21.15.22:0/2819073133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaec07c270 con 0x7fbaec107620 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.173+0000 7fbaf0860640 1 -- 172.21.15.22:0/2819073133 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbadc03a6d0 con 0x7fbaec107620 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.173+0000 7fbaf1862640 1 -- 172.21.15.22:0/2819073133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaec07c7b0 con 0x7fbaec107620 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.173+0000 7fbaf0860640 1 -- 172.21.15.22:0/2819073133 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7fbadc03a870 con 0x7fbaec107620 2024-09-10T08:00:04.077 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.174+0000 7fbaf1862640 1 -- 172.21.15.22:0/2819073133 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaec107aa0 con 0x7fbaec107620 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.174+0000 7fbaf0860640 1 --2- 172.21.15.22:0/2819073133 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbad8038f00 0x7fbad803b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.174+0000 7fbaf0860640 1 -- 172.21.15.22:0/2819073133 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbadc06c5c0 con 0x7fbaec107620 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.174+0000 7fbae3fff640 1 --2- 172.21.15.22:0/2819073133 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbad8038f00 0x7fbad803b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.174+0000 7fbae3fff640 1 --2- 172.21.15.22:0/2819073133 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbad8038f00 0x7fbad803b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbad40098c0 tx=0x7fbad4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.179+0000 7fbaf0860640 1 -- 172.21.15.22:0/2819073133 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbadc032920 con 0x7fbaec107620 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.200+0000 7fbaf0860640 1 -- 172.21.15.22:0/2819073133 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fbadc045980 con 0x7fbaec107620 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.360+0000 7fbaf1862640 1 -- 172.21.15.22:0/2819073133 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fbaec07d0c0 con 0x7fbad8038f00 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.454+0000 7fbaf0860640 1 -- 172.21.15.22:0/2819073133 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fbaec07d0c0 con 0x7fbad8038f00 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.456+0000 7fbaf1862640 1 -- 172.21.15.22:0/2819073133 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbad8038f00 msgr2=0x7fbad803b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.456+0000 7fbaf1862640 1 --2- 172.21.15.22:0/2819073133 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbad8038f00 0x7fbad803b3c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbad40098c0 tx=0x7fbad4006db0 comp rx=0 tx=0).stop 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.456+0000 7fbaf1862640 1 -- 172.21.15.22:0/2819073133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 msgr2=0x7fbaec07db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.456+0000 7fbaf1862640 1 --2- 172.21.15.22:0/2819073133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 0x7fbaec07db40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbadc030560 tx=0x7fbadc032670 comp rx=0 tx=0).stop 2024-09-10T08:00:04.078 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.456+0000 7fbaf1862640 1 -- 172.21.15.22:0/2819073133 shutdown_connections 2024-09-10T08:00:04.079 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.456+0000 7fbaf1862640 1 --2- 172.21.15.22:0/2819073133 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbad8038f00 0x7fbad803b3c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:04.079 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.456+0000 7fbaf1862640 1 --2- 172.21.15.22:0/2819073133 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbaec107620 0x7fbaec07db40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:04.079 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.456+0000 7fbaf1862640 1 -- 172.21.15.22:0/2819073133 >> 172.21.15.22:0/2819073133 conn(0x7fbaec102db0 msgr2=0x7fbaec103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:04.079 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.456+0000 7fbaf1862640 1 -- 172.21.15.22:0/2819073133 shutdown_connections 2024-09-10T08:00:04.079 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:03.456+0000 7fbaf1862640 1 -- 172.21.15.22:0/2819073133 wait complete. 2024-09-10T08:00:04.079 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial admin user... 2024-09-10T08:00:04.446 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:04 smithi022 ceph-mon[30854]: mgrmap e12: x(active, since 2s) 2024-09-10T08:00:04.446 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:04 smithi022 ceph-mon[30854]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:00:04.446 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:04 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:04.446 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:04 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:05.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:05 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:05.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:05 smithi022 ceph-mon[30854]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:00:05.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:05 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:06.472 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$kF8mSXkYZiMRD3CEE2Cm3eGkBgfJ0KR9nc6dRuuOXX4bRxtvYjMQq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1725955204, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T08:00:06.472 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.534+0000 7fb6471e1640 1 Processor -- start 2024-09-10T08:00:06.472 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.534+0000 7fb6471e1640 1 -- start start 2024-09-10T08:00:06.472 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.534+0000 7fb6471e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 0x7fb64010a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:06.472 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.534+0000 7fb6471e1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb64007be00 con 0x7fb640108110 2024-09-10T08:00:06.472 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.535+0000 7fb644f7d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 0x7fb64010a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:06.472 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.535+0000 7fb644f7d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 0x7fb64010a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39636/0 (socket says 172.21.15.22:39636) 2024-09-10T08:00:06.472 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.535+0000 7fb644f7d640 1 -- 172.21.15.22:0/3844104670 learned_addr learned my addr 172.21.15.22:0/3844104670 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:06.472 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.535+0000 7fb644f7d640 1 -- 172.21.15.22:0/3844104670 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64010aa40 con 0x7fb640108110 2024-09-10T08:00:06.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.536+0000 7fb644f7d640 1 --2- 172.21.15.22:0/3844104670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 0x7fb64010a500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb630009820 tx=0x7fb63002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a8fe86b51a12cc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:06.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.536+0000 7fb63f7fe640 1 -- 172.21.15.22:0/3844104670 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb630037070 con 0x7fb640108110 2024-09-10T08:00:06.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.536+0000 7fb63f7fe640 1 -- 172.21.15.22:0/3844104670 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb630032920 con 0x7fb640108110 2024-09-10T08:00:06.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.536+0000 7fb63f7fe640 1 -- 172.21.15.22:0/3844104670 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb630030810 con 0x7fb640108110 2024-09-10T08:00:06.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.536+0000 7fb6471e1640 1 -- 172.21.15.22:0/3844104670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 msgr2=0x7fb64010a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:06.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.536+0000 7fb6471e1640 1 --2- 172.21.15.22:0/3844104670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 0x7fb64010a500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb630009820 tx=0x7fb63002a270 comp rx=0 tx=0).stop 2024-09-10T08:00:06.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.536+0000 7fb6471e1640 1 -- 172.21.15.22:0/3844104670 shutdown_connections 2024-09-10T08:00:06.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.536+0000 7fb6471e1640 1 --2- 172.21.15.22:0/3844104670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 0x7fb64010a500 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:06.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.536+0000 7fb6471e1640 1 -- 172.21.15.22:0/3844104670 >> 172.21.15.22:0/3844104670 conn(0x7fb640101cb0 msgr2=0x7fb6401040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:06.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.536+0000 7fb6471e1640 1 -- 172.21.15.22:0/3844104670 shutdown_connections 2024-09-10T08:00:06.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.536+0000 7fb6471e1640 1 -- 172.21.15.22:0/3844104670 wait complete. 2024-09-10T08:00:06.473 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.537+0000 7fb6471e1640 1 Processor -- start 2024-09-10T08:00:06.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.537+0000 7fb6471e1640 1 -- start start 2024-09-10T08:00:06.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.537+0000 7fb6471e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 0x7fb640107990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:06.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.537+0000 7fb6471e1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb64010ba60 con 0x7fb640108110 2024-09-10T08:00:06.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.537+0000 7fb644f7d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 0x7fb640107990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:06.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.537+0000 7fb644f7d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 0x7fb640107990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39644/0 (socket says 172.21.15.22:39644) 2024-09-10T08:00:06.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.537+0000 7fb644f7d640 1 -- 172.21.15.22:0/3038954227 learned_addr learned my addr 172.21.15.22:0/3038954227 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:06.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.538+0000 7fb644f7d640 1 -- 172.21.15.22:0/3038954227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb640107ed0 con 0x7fb640108110 2024-09-10T08:00:06.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.538+0000 7fb644f7d640 1 --2- 172.21.15.22:0/3038954227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 0x7fb640107990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb630030420 tx=0x7fb630032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:06.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.538+0000 7fb63dffb640 1 -- 172.21.15.22:0/3038954227 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb630037040 con 0x7fb640108110 2024-09-10T08:00:06.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.538+0000 7fb63dffb640 1 -- 172.21.15.22:0/3038954227 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb630040070 con 0x7fb640108110 2024-09-10T08:00:06.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.538+0000 7fb6471e1640 1 -- 172.21.15.22:0/3038954227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6401060c0 con 0x7fb640108110 2024-09-10T08:00:06.474 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.538+0000 7fb63dffb640 1 -- 172.21.15.22:0/3038954227 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb63003a6e0 con 0x7fb640108110 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.538+0000 7fb6471e1640 1 -- 172.21.15.22:0/3038954227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb640106600 con 0x7fb640108110 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.539+0000 7fb63dffb640 1 -- 172.21.15.22:0/3038954227 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fb63003bb20 con 0x7fb640108110 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.539+0000 7fb63dffb640 1 --2- 172.21.15.22:0/3038954227 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb628039020 0x7fb62803b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.539+0000 7fb6471e1640 1 -- 172.21.15.22:0/3038954227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb640108570 con 0x7fb640108110 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.539+0000 7fb63dffb640 1 -- 172.21.15.22:0/3038954227 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb63006c730 con 0x7fb640108110 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.540+0000 7fb63ffff640 1 --2- 172.21.15.22:0/3038954227 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb628039020 0x7fb62803b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.540+0000 7fb63ffff640 1 --2- 172.21.15.22:0/3038954227 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb628039020 0x7fb62803b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb6340098c0 tx=0x7fb634006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.544+0000 7fb63dffb640 1 -- 172.21.15.22:0/3038954227 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb63004a200 con 0x7fb640108110 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.741+0000 7fb6471e1640 1 -- 172.21.15.22:0/3038954227 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fb640106eb0 con 0x7fb628039020 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.993+0000 7fb63dffb640 1 -- 172.21.15.22:0/3038954227 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fb640106eb0 con 0x7fb628039020 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.996+0000 7fb6471e1640 1 -- 172.21.15.22:0/3038954227 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb628039020 msgr2=0x7fb62803b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.996+0000 7fb6471e1640 1 --2- 172.21.15.22:0/3038954227 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb628039020 0x7fb62803b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb6340098c0 tx=0x7fb634006db0 comp rx=0 tx=0).stop 2024-09-10T08:00:06.475 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.996+0000 7fb6471e1640 1 -- 172.21.15.22:0/3038954227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 msgr2=0x7fb640107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:06.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.996+0000 7fb6471e1640 1 --2- 172.21.15.22:0/3038954227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 0x7fb640107990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb630030420 tx=0x7fb630032670 comp rx=0 tx=0).stop 2024-09-10T08:00:06.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.996+0000 7fb6471e1640 1 -- 172.21.15.22:0/3038954227 shutdown_connections 2024-09-10T08:00:06.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.996+0000 7fb6471e1640 1 --2- 172.21.15.22:0/3038954227 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb628039020 0x7fb62803b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:06.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.996+0000 7fb6471e1640 1 --2- 172.21.15.22:0/3038954227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb640108110 0x7fb640107990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:06.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.996+0000 7fb6471e1640 1 -- 172.21.15.22:0/3038954227 >> 172.21.15.22:0/3038954227 conn(0x7fb640101cb0 msgr2=0x7fb6401028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:06.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.996+0000 7fb6471e1640 1 -- 172.21.15.22:0/3038954227 shutdown_connections 2024-09-10T08:00:06.476 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:04.996+0000 7fb6471e1640 1 -- 172.21.15.22:0/3038954227 wait complete. 2024-09-10T08:00:06.476 INFO:teuthology.orchestra.run.smithi022.stdout:Fetching dashboard port number... 2024-09-10T08:00:07.637 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T08:00:07.637 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.891+0000 7fda9c5ab640 1 Processor -- start 2024-09-10T08:00:07.637 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.891+0000 7fda9c5ab640 1 -- start start 2024-09-10T08:00:07.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.891+0000 7fda9c5ab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 0x7fda94107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:07.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.891+0000 7fda9c5ab640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fda94107ff0 con 0x7fda94107620 2024-09-10T08:00:07.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.891+0000 7fda9a347640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 0x7fda94107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:07.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.891+0000 7fda9a347640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 0x7fda94107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39646/0 (socket says 172.21.15.22:39646) 2024-09-10T08:00:07.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.891+0000 7fda9a347640 1 -- 172.21.15.22:0/1154449168 learned_addr learned my addr 172.21.15.22:0/1154449168 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:07.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.892+0000 7fda9a347640 1 -- 172.21.15.22:0/1154449168 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda94108820 con 0x7fda94107620 2024-09-10T08:00:07.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.892+0000 7fda9a347640 1 --2- 172.21.15.22:0/1154449168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 0x7fda94107a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fda90009820 tx=0x7fda9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d964498d2b5422 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:07.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.893+0000 7fda99345640 1 -- 172.21.15.22:0/1154449168 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda90037070 con 0x7fda94107620 2024-09-10T08:00:07.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.893+0000 7fda99345640 1 -- 172.21.15.22:0/1154449168 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda90032920 con 0x7fda94107620 2024-09-10T08:00:07.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.893+0000 7fda99345640 1 -- 172.21.15.22:0/1154449168 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda90030810 con 0x7fda94107620 2024-09-10T08:00:07.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.893+0000 7fda9c5ab640 1 -- 172.21.15.22:0/1154449168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 msgr2=0x7fda94107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:07.638 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.893+0000 7fda9c5ab640 1 --2- 172.21.15.22:0/1154449168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 0x7fda94107a20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fda90009820 tx=0x7fda9002a270 comp rx=0 tx=0).stop 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.893+0000 7fda9c5ab640 1 -- 172.21.15.22:0/1154449168 shutdown_connections 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.893+0000 7fda9c5ab640 1 --2- 172.21.15.22:0/1154449168 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 0x7fda94107a20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.893+0000 7fda9c5ab640 1 -- 172.21.15.22:0/1154449168 >> 172.21.15.22:0/1154449168 conn(0x7fda94102db0 msgr2=0x7fda941051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.893+0000 7fda9c5ab640 1 -- 172.21.15.22:0/1154449168 shutdown_connections 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.893+0000 7fda9c5ab640 1 -- 172.21.15.22:0/1154449168 wait complete. 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.894+0000 7fda9c5ab640 1 Processor -- start 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.894+0000 7fda9c5ab640 1 -- start start 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.894+0000 7fda9c5ab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 0x7fda9407db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.894+0000 7fda9c5ab640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fda9410bbd0 con 0x7fda94107620 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.894+0000 7fda9a347640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 0x7fda9407db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.894+0000 7fda9a347640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 0x7fda9407db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39658/0 (socket says 172.21.15.22:39658) 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.894+0000 7fda9a347640 1 -- 172.21.15.22:0/71333830 learned_addr learned my addr 172.21.15.22:0/71333830 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:07.639 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.895+0000 7fda9a347640 1 -- 172.21.15.22:0/71333830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9407e080 con 0x7fda94107620 2024-09-10T08:00:07.640 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.895+0000 7fda9a347640 1 --2- 172.21.15.22:0/71333830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 0x7fda9407db40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda90030560 tx=0x7fda90032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:07.640 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.895+0000 7fda8b7fe640 1 -- 172.21.15.22:0/71333830 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda90037040 con 0x7fda94107620 2024-09-10T08:00:07.640 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.895+0000 7fda9c5ab640 1 -- 172.21.15.22:0/71333830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda9407c270 con 0x7fda94107620 2024-09-10T08:00:07.641 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.895+0000 7fda8b7fe640 1 -- 172.21.15.22:0/71333830 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda90040070 con 0x7fda94107620 2024-09-10T08:00:07.641 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.895+0000 7fda8b7fe640 1 -- 172.21.15.22:0/71333830 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda9003a6d0 con 0x7fda94107620 2024-09-10T08:00:07.641 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.895+0000 7fda9c5ab640 1 -- 172.21.15.22:0/71333830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9407c7b0 con 0x7fda94107620 2024-09-10T08:00:07.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.896+0000 7fda8b7fe640 1 -- 172.21.15.22:0/71333830 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7fda9003bb20 con 0x7fda94107620 2024-09-10T08:00:07.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.896+0000 7fda9c5ab640 1 -- 172.21.15.22:0/71333830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda94107aa0 con 0x7fda94107620 2024-09-10T08:00:07.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.896+0000 7fda8b7fe640 1 --2- 172.21.15.22:0/71333830 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fda80039020 0x7fda8003b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:07.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.896+0000 7fda8b7fe640 1 -- 172.21.15.22:0/71333830 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fda9006c5e0 con 0x7fda94107620 2024-09-10T08:00:07.644 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.897+0000 7fda99b46640 1 --2- 172.21.15.22:0/71333830 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fda80039020 0x7fda8003b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:07.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.897+0000 7fda99b46640 1 --2- 172.21.15.22:0/71333830 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fda80039020 0x7fda8003b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fda840098c0 tx=0x7fda84006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:07.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.901+0000 7fda8b7fe640 1 -- 172.21.15.22:0/71333830 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda9004a200 con 0x7fda94107620 2024-09-10T08:00:07.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:06.911+0000 7fda8b7fe640 1 -- 172.21.15.22:0/71333830 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fda9003a870 con 0x7fda94107620 2024-09-10T08:00:07.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:07.078+0000 7fda9c5ab640 1 -- 172.21.15.22:0/71333830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fda9407ca30 con 0x7fda94107620 2024-09-10T08:00:07.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:07.078+0000 7fda8b7fe640 1 -- 172.21.15.22:0/71333830 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fda90031e80 con 0x7fda94107620 2024-09-10T08:00:07.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:07.082+0000 7fda9c5ab640 1 -- 172.21.15.22:0/71333830 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fda80039020 msgr2=0x7fda8003b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:07.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:07.082+0000 7fda9c5ab640 1 --2- 172.21.15.22:0/71333830 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fda80039020 0x7fda8003b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fda840098c0 tx=0x7fda84006db0 comp rx=0 tx=0).stop 2024-09-10T08:00:07.645 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:07.082+0000 7fda9c5ab640 1 -- 172.21.15.22:0/71333830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 msgr2=0x7fda9407db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:07.082+0000 7fda9c5ab640 1 --2- 172.21.15.22:0/71333830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 0x7fda9407db40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fda90030560 tx=0x7fda90032670 comp rx=0 tx=0).stop 2024-09-10T08:00:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:07.082+0000 7fda9c5ab640 1 -- 172.21.15.22:0/71333830 shutdown_connections 2024-09-10T08:00:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:07.082+0000 7fda9c5ab640 1 --2- 172.21.15.22:0/71333830 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fda80039020 0x7fda8003b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:07.082+0000 7fda9c5ab640 1 --2- 172.21.15.22:0/71333830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda94107620 0x7fda9407db40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:07.082+0000 7fda9c5ab640 1 -- 172.21.15.22:0/71333830 >> 172.21.15.22:0/71333830 conn(0x7fda94102db0 msgr2=0x7fda941039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:07.082+0000 7fda9c5ab640 1 -- 172.21.15.22:0/71333830 shutdown_connections 2024-09-10T08:00:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:07.082+0000 7fda9c5ab640 1 -- 172.21.15.22:0/71333830 wait complete. 2024-09-10T08:00:07.646 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T08:00:07.647 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-10T08:00:07.654 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T08:00:07.655 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-10T08:00:07.655 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-10T08:00:07.655 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T08:00:07.656 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph Dashboard is now available at: 2024-09-10T08:00:07.656 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:07.656 INFO:teuthology.orchestra.run.smithi022.stdout: URL: https://smithi022.front.sepia.ceph.com:8443/ 2024-09-10T08:00:07.657 INFO:teuthology.orchestra.run.smithi022.stdout: User: admin 2024-09-10T08:00:07.657 INFO:teuthology.orchestra.run.smithi022.stdout: Password: ym5034lid6 2024-09-10T08:00:07.657 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:07.657 INFO:teuthology.orchestra.run.smithi022.stdout:Saving cluster configuration to /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config directory 2024-09-10T08:00:08.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:07 smithi022 ceph-mon[30854]: mgrmap e13: x(active, since 6s) 2024-09-10T08:00:08.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:07 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/71333830' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-10T08:00:08.953 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.048+0000 7fdccfbdb640 1 Processor -- start 2024-09-10T08:00:08.953 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.048+0000 7fdccfbdb640 1 -- start start 2024-09-10T08:00:08.953 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.048+0000 7fdccfbdb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 0x7fdcc8107a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:08.953 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.048+0000 7fdccfbdb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc8107ff0 con 0x7fdcc8107620 2024-09-10T08:00:08.953 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.048+0000 7fdccd977640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 0x7fdcc8107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:08.953 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.048+0000 7fdccd977640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 0x7fdcc8107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39672/0 (socket says 172.21.15.22:39672) 2024-09-10T08:00:08.953 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.048+0000 7fdccd977640 1 -- 172.21.15.22:0/4109841299 learned_addr learned my addr 172.21.15.22:0/4109841299 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:08.953 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.049+0000 7fdccd977640 1 -- 172.21.15.22:0/4109841299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc8108820 con 0x7fdcc8107620 2024-09-10T08:00:08.953 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.049+0000 7fdccd977640 1 --2- 172.21.15.22:0/4109841299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 0x7fdcc8107a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009820 tx=0x7fdcc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99aeb6aed3fec4c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:08.953 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.050+0000 7fdccc975640 1 -- 172.21.15.22:0/4109841299 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc4037070 con 0x7fdcc8107620 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.050+0000 7fdccc975640 1 -- 172.21.15.22:0/4109841299 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcc4032920 con 0x7fdcc8107620 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.050+0000 7fdccc975640 1 -- 172.21.15.22:0/4109841299 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc4030810 con 0x7fdcc8107620 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.050+0000 7fdccfbdb640 1 -- 172.21.15.22:0/4109841299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 msgr2=0x7fdcc8107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.050+0000 7fdccfbdb640 1 --2- 172.21.15.22:0/4109841299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 0x7fdcc8107a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009820 tx=0x7fdcc402a270 comp rx=0 tx=0).stop 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.050+0000 7fdccfbdb640 1 -- 172.21.15.22:0/4109841299 shutdown_connections 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.050+0000 7fdccfbdb640 1 --2- 172.21.15.22:0/4109841299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 0x7fdcc8107a20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.050+0000 7fdccfbdb640 1 -- 172.21.15.22:0/4109841299 >> 172.21.15.22:0/4109841299 conn(0x7fdcc8102db0 msgr2=0x7fdcc81051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.050+0000 7fdccfbdb640 1 -- 172.21.15.22:0/4109841299 shutdown_connections 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.051+0000 7fdccfbdb640 1 -- 172.21.15.22:0/4109841299 wait complete. 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.051+0000 7fdccfbdb640 1 Processor -- start 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.051+0000 7fdccfbdb640 1 -- start start 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.051+0000 7fdccfbdb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 0x7fdcc819b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.051+0000 7fdccfbdb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdcc810bbd0 con 0x7fdcc8107620 2024-09-10T08:00:08.954 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.051+0000 7fdccd977640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 0x7fdcc819b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.051+0000 7fdccd977640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 0x7fdcc819b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39684/0 (socket says 172.21.15.22:39684) 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.051+0000 7fdccd977640 1 -- 172.21.15.22:0/3365684681 learned_addr learned my addr 172.21.15.22:0/3365684681 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.052+0000 7fdccd977640 1 -- 172.21.15.22:0/3365684681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc819bbd0 con 0x7fdcc8107620 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.052+0000 7fdccd977640 1 --2- 172.21.15.22:0/3365684681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 0x7fdcc819b690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4030560 tx=0x7fdcc4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.052+0000 7fdcbeffd640 1 -- 172.21.15.22:0/3365684681 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc4037040 con 0x7fdcc8107620 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.052+0000 7fdcbeffd640 1 -- 172.21.15.22:0/3365684681 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcc4040070 con 0x7fdcc8107620 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.052+0000 7fdccfbdb640 1 -- 172.21.15.22:0/3365684681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc819be60 con 0x7fdcc8107620 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.052+0000 7fdcbeffd640 1 -- 172.21.15.22:0/3365684681 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc403a6d0 con 0x7fdcc8107620 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.052+0000 7fdccfbdb640 1 -- 172.21.15.22:0/3365684681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcc819eb50 con 0x7fdcc8107620 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.053+0000 7fdcbeffd640 1 -- 172.21.15.22:0/3365684681 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fdcc403bb20 con 0x7fdcc8107620 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.053+0000 7fdccfbdb640 1 -- 172.21.15.22:0/3365684681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc810bd50 con 0x7fdcc8107620 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.053+0000 7fdcbeffd640 1 --2- 172.21.15.22:0/3365684681 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdcb40390c0 0x7fdcb403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:08.955 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.053+0000 7fdcbeffd640 1 -- 172.21.15.22:0/3365684681 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdcc406c6e0 con 0x7fdcc8107620 2024-09-10T08:00:08.956 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.053+0000 7fdccd176640 1 --2- 172.21.15.22:0/3365684681 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdcb40390c0 0x7fdcb403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:08.956 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.054+0000 7fdccd176640 1 --2- 172.21.15.22:0/3365684681 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdcb40390c0 0x7fdcb403b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80098c0 tx=0x7fdcb8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:08.956 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.058+0000 7fdcbeffd640 1 -- 172.21.15.22:0/3365684681 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdcc4042940 con 0x7fdcc8107620 2024-09-10T08:00:08.956 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.321+0000 7fdccfbdb640 1 -- 172.21.15.22:0/3365684681 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fdcc819ed20 con 0x7fdcc8107620 2024-09-10T08:00:08.956 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.324+0000 7fdcbeffd640 1 -- 172.21.15.22:0/3365684681 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7fdcc404a200 con 0x7fdcc8107620 2024-09-10T08:00:08.956 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T08:00:08.956 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.326+0000 7fdccfbdb640 1 -- 172.21.15.22:0/3365684681 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdcb40390c0 msgr2=0x7fdcb403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:08.956 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.326+0000 7fdccfbdb640 1 --2- 172.21.15.22:0/3365684681 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdcb40390c0 0x7fdcb403b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80098c0 tx=0x7fdcb8006db0 comp rx=0 tx=0).stop 2024-09-10T08:00:08.956 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.326+0000 7fdccfbdb640 1 -- 172.21.15.22:0/3365684681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 msgr2=0x7fdcc819b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:08.956 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.326+0000 7fdccfbdb640 1 --2- 172.21.15.22:0/3365684681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 0x7fdcc819b690 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4030560 tx=0x7fdcc4032670 comp rx=0 tx=0).stop 2024-09-10T08:00:08.956 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.326+0000 7fdccfbdb640 1 -- 172.21.15.22:0/3365684681 shutdown_connections 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.326+0000 7fdccfbdb640 1 --2- 172.21.15.22:0/3365684681 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdcb40390c0 0x7fdcb403b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.326+0000 7fdccfbdb640 1 --2- 172.21.15.22:0/3365684681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdcc8107620 0x7fdcc819b690 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.326+0000 7fdccfbdb640 1 -- 172.21.15.22:0/3365684681 >> 172.21.15.22:0/3365684681 conn(0x7fdcc8102db0 msgr2=0x7fdcc81039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.326+0000 7fdccfbdb640 1 -- 172.21.15.22:0/3365684681 shutdown_connections 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr 2024-09-10T08:00:08.326+0000 7fdccfbdb640 1 -- 172.21.15.22:0/3365684681 wait complete. 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:08.957 INFO:teuthology.orchestra.run.smithi022.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T08:00:08.958 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:08.958 INFO:teuthology.orchestra.run.smithi022.stdout: ceph telemetry on 2024-09-10T08:00:08.958 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:08.958 INFO:teuthology.orchestra.run.smithi022.stdout:For more information see: 2024-09-10T08:00:08.958 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:08.958 INFO:teuthology.orchestra.run.smithi022.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T08:00:08.958 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:08.958 INFO:teuthology.orchestra.run.smithi022.stdout:Bootstrap complete. 2024-09-10T08:00:08.989 INFO:tasks.cephadm:Fetching config... 2024-09-10T08:00:08.990 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T08:00:08.990 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T08:00:09.006 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T08:00:09.007 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T08:00:09.007 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T08:00:09.064 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T08:00:09.064 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T08:00:09.064 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T08:00:09.131 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T08:00:09.131 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T08:00:09.131 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T08:00:09.187 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T08:00:09.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCcDW4/CUHRk7y9GgXowmlgK8RCCn/vNWPkSqDuvWz0PruIxIwABZaLJlgVKKe/NSIIyKwjk0Ef+fT3F5fPscj7tFsnU1iM4GH57d57xkjMvjDgXFVB8mkhgYE64ZZnRswKYD/qwW8Ig0/bcyr+UknoEQ/ICunX+i6kjQVYOt0UNPRwd68YbwXvusWSr7dq4c59OVXBwKXrY6V5VbmWTpDBHfbAASUOEgELSPnM6RcMhVjM8XNYcO7l8vTz3xVr2L2OTg/+SkgLNcUhfZnMct78LXHFMsahxJ5UZr5H5WgWluAp9smk6f4DtoPeB759fLdJ3VCg0u7hXvXzmrVVtJY7zIRULYP7yXOMRgLydA9tvNqV/uvUrUoIjRYLFowSLek5MqYh++7DCb+3eCbgC/YdEBLrt+pVC1WJd+oUprzLoXYDcYwrS9hUIjBgah0POzei/FPlfDppJ1t7idL3CPGJ4o6VmaiSP35SKCfsZ9+euy/PyBX9FsyGkaJJD+/ydU= ceph-71bf679e-6f4a-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T08:00:09.263 INFO:teuthology.orchestra.run.smithi022.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCcDW4/CUHRk7y9GgXowmlgK8RCCn/vNWPkSqDuvWz0PruIxIwABZaLJlgVKKe/NSIIyKwjk0Ef+fT3F5fPscj7tFsnU1iM4GH57d57xkjMvjDgXFVB8mkhgYE64ZZnRswKYD/qwW8Ig0/bcyr+UknoEQ/ICunX+i6kjQVYOt0UNPRwd68YbwXvusWSr7dq4c59OVXBwKXrY6V5VbmWTpDBHfbAASUOEgELSPnM6RcMhVjM8XNYcO7l8vTz3xVr2L2OTg/+SkgLNcUhfZnMct78LXHFMsahxJ5UZr5H5WgWluAp9smk6f4DtoPeB759fLdJ3VCg0u7hXvXzmrVVtJY7zIRULYP7yXOMRgLydA9tvNqV/uvUrUoIjRYLFowSLek5MqYh++7DCb+3eCbgC/YdEBLrt+pVC1WJd+oUprzLoXYDcYwrS9hUIjBgah0POzei/FPlfDppJ1t7idL3CPGJ4o6VmaiSP35SKCfsZ9+euy/PyBX9FsyGkaJJD+/ydU= ceph-71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:00:09.275 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCcDW4/CUHRk7y9GgXowmlgK8RCCn/vNWPkSqDuvWz0PruIxIwABZaLJlgVKKe/NSIIyKwjk0Ef+fT3F5fPscj7tFsnU1iM4GH57d57xkjMvjDgXFVB8mkhgYE64ZZnRswKYD/qwW8Ig0/bcyr+UknoEQ/ICunX+i6kjQVYOt0UNPRwd68YbwXvusWSr7dq4c59OVXBwKXrY6V5VbmWTpDBHfbAASUOEgELSPnM6RcMhVjM8XNYcO7l8vTz3xVr2L2OTg/+SkgLNcUhfZnMct78LXHFMsahxJ5UZr5H5WgWluAp9smk6f4DtoPeB759fLdJ3VCg0u7hXvXzmrVVtJY7zIRULYP7yXOMRgLydA9tvNqV/uvUrUoIjRYLFowSLek5MqYh++7DCb+3eCbgC/YdEBLrt+pVC1WJd+oUprzLoXYDcYwrS9hUIjBgah0POzei/FPlfDppJ1t7idL3CPGJ4o6VmaiSP35SKCfsZ9+euy/PyBX9FsyGkaJJD+/ydU= ceph-71bf679e-6f4a-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T08:00:09.318 INFO:teuthology.orchestra.run.smithi100.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCcDW4/CUHRk7y9GgXowmlgK8RCCn/vNWPkSqDuvWz0PruIxIwABZaLJlgVKKe/NSIIyKwjk0Ef+fT3F5fPscj7tFsnU1iM4GH57d57xkjMvjDgXFVB8mkhgYE64ZZnRswKYD/qwW8Ig0/bcyr+UknoEQ/ICunX+i6kjQVYOt0UNPRwd68YbwXvusWSr7dq4c59OVXBwKXrY6V5VbmWTpDBHfbAASUOEgELSPnM6RcMhVjM8XNYcO7l8vTz3xVr2L2OTg/+SkgLNcUhfZnMct78LXHFMsahxJ5UZr5H5WgWluAp9smk6f4DtoPeB759fLdJ3VCg0u7hXvXzmrVVtJY7zIRULYP7yXOMRgLydA9tvNqV/uvUrUoIjRYLFowSLek5MqYh++7DCb+3eCbgC/YdEBLrt+pVC1WJd+oUprzLoXYDcYwrS9hUIjBgah0POzei/FPlfDppJ1t7idL3CPGJ4o6VmaiSP35SKCfsZ9+euy/PyBX9FsyGkaJJD+/ydU= ceph-71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:00:09.333 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCcDW4/CUHRk7y9GgXowmlgK8RCCn/vNWPkSqDuvWz0PruIxIwABZaLJlgVKKe/NSIIyKwjk0Ef+fT3F5fPscj7tFsnU1iM4GH57d57xkjMvjDgXFVB8mkhgYE64ZZnRswKYD/qwW8Ig0/bcyr+UknoEQ/ICunX+i6kjQVYOt0UNPRwd68YbwXvusWSr7dq4c59OVXBwKXrY6V5VbmWTpDBHfbAASUOEgELSPnM6RcMhVjM8XNYcO7l8vTz3xVr2L2OTg/+SkgLNcUhfZnMct78LXHFMsahxJ5UZr5H5WgWluAp9smk6f4DtoPeB759fLdJ3VCg0u7hXvXzmrVVtJY7zIRULYP7yXOMRgLydA9tvNqV/uvUrUoIjRYLFowSLek5MqYh++7DCb+3eCbgC/YdEBLrt+pVC1WJd+oUprzLoXYDcYwrS9hUIjBgah0POzei/FPlfDppJ1t7idL3CPGJ4o6VmaiSP35SKCfsZ9+euy/PyBX9FsyGkaJJD+/ydU= ceph-71bf679e-6f4a-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T08:00:09.376 INFO:teuthology.orchestra.run.smithi153.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCcDW4/CUHRk7y9GgXowmlgK8RCCn/vNWPkSqDuvWz0PruIxIwABZaLJlgVKKe/NSIIyKwjk0Ef+fT3F5fPscj7tFsnU1iM4GH57d57xkjMvjDgXFVB8mkhgYE64ZZnRswKYD/qwW8Ig0/bcyr+UknoEQ/ICunX+i6kjQVYOt0UNPRwd68YbwXvusWSr7dq4c59OVXBwKXrY6V5VbmWTpDBHfbAASUOEgELSPnM6RcMhVjM8XNYcO7l8vTz3xVr2L2OTg/+SkgLNcUhfZnMct78LXHFMsahxJ5UZr5H5WgWluAp9smk6f4DtoPeB759fLdJ3VCg0u7hXvXzmrVVtJY7zIRULYP7yXOMRgLydA9tvNqV/uvUrUoIjRYLFowSLek5MqYh++7DCb+3eCbgC/YdEBLrt+pVC1WJd+oUprzLoXYDcYwrS9hUIjBgah0POzei/FPlfDppJ1t7idL3CPGJ4o6VmaiSP35SKCfsZ9+euy/PyBX9FsyGkaJJD+/ydU= ceph-71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:00:09.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T08:00:09.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:09 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3365684681' entity='client.admin' 2024-09-10T08:00:09.644 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:00:10.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.111+0000 7f03310e0640 1 -- 172.21.15.22:0/650400676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f032c100540 msgr2=0x7f032c100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:10.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.111+0000 7f03310e0640 1 --2- 172.21.15.22:0/650400676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f032c100540 0x7f032c100940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f031c009880 tx=0x7f031c02a5d0 comp rx=0 tx=0).stop 2024-09-10T08:00:10.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.111+0000 7f03310e0640 1 -- 172.21.15.22:0/650400676 shutdown_connections 2024-09-10T08:00:10.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.111+0000 7f03310e0640 1 --2- 172.21.15.22:0/650400676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f032c100540 0x7f032c100940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:10.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.111+0000 7f03310e0640 1 -- 172.21.15.22:0/650400676 >> 172.21.15.22:0/650400676 conn(0x7f032c0fbcd0 msgr2=0x7f032c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:10.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.111+0000 7f03310e0640 1 -- 172.21.15.22:0/650400676 shutdown_connections 2024-09-10T08:00:10.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.111+0000 7f03310e0640 1 -- 172.21.15.22:0/650400676 wait complete. 2024-09-10T08:00:10.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.112+0000 7f03310e0640 1 Processor -- start 2024-09-10T08:00:10.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.112+0000 7f03310e0640 1 -- start start 2024-09-10T08:00:10.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.112+0000 7f03310e0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f032c100540 0x7f032c195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:10.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.112+0000 7f03310e0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f032c1065f0 con 0x7f032c100540 2024-09-10T08:00:10.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.113+0000 7f032ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f032c100540 0x7f032c195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.113+0000 7f032ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f032c100540 0x7f032c195c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39702/0 (socket says 172.21.15.22:39702) 2024-09-10T08:00:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.113+0000 7f032ad9d640 1 -- 172.21.15.22:0/3889555640 learned_addr learned my addr 172.21.15.22:0/3889555640 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.113+0000 7f032ad9d640 1 -- 172.21.15.22:0/3889555640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032c1961a0 con 0x7f032c100540 2024-09-10T08:00:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.113+0000 7f032ad9d640 1 --2- 172.21.15.22:0/3889555640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f032c100540 0x7f032c195c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f031c004f60 tx=0x7f031c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.113+0000 7f0313fff640 1 -- 172.21.15.22:0/3889555640 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c03f070 con 0x7f032c100540 2024-09-10T08:00:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.113+0000 7f03310e0640 1 -- 172.21.15.22:0/3889555640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032c196430 con 0x7f032c100540 2024-09-10T08:00:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.114+0000 7f0313fff640 1 -- 172.21.15.22:0/3889555640 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f031c004d40 con 0x7f032c100540 2024-09-10T08:00:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.114+0000 7f0313fff640 1 -- 172.21.15.22:0/3889555640 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031c035030 con 0x7f032c100540 2024-09-10T08:00:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.114+0000 7f03310e0640 1 -- 172.21.15.22:0/3889555640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f032c199120 con 0x7f032c100540 2024-09-10T08:00:10.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.114+0000 7f0313fff640 1 -- 172.21.15.22:0/3889555640 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f031c042070 con 0x7f032c100540 2024-09-10T08:00:10.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.115+0000 7f0313fff640 1 --2- 172.21.15.22:0/3889555640 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f03140390c0 0x7f031403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:10.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.115+0000 7f03310e0640 1 -- 172.21.15.22:0/3889555640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f032c196910 con 0x7f032c100540 2024-09-10T08:00:10.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.115+0000 7f0313fff640 1 -- 172.21.15.22:0/3889555640 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f031c06dd30 con 0x7f032c100540 2024-09-10T08:00:10.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.115+0000 7f032a59c640 1 --2- 172.21.15.22:0/3889555640 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f03140390c0 0x7f031403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:10.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.115+0000 7f032a59c640 1 --2- 172.21.15.22:0/3889555640 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f03140390c0 0x7f031403b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03200098c0 tx=0x7f0320006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:10.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.120+0000 7f0313fff640 1 -- 172.21.15.22:0/3889555640 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f032c196910 con 0x7f032c100540 2024-09-10T08:00:10.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.299+0000 7f03310e0640 1 -- 172.21.15.22:0/3889555640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f032c02d830 con 0x7f032c100540 2024-09-10T08:00:10.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.301+0000 7f0313fff640 1 -- 172.21.15.22:0/3889555640 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f031c074080 con 0x7f032c100540 2024-09-10T08:00:10.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.304+0000 7f03310e0640 1 -- 172.21.15.22:0/3889555640 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f03140390c0 msgr2=0x7f031403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:10.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.304+0000 7f03310e0640 1 --2- 172.21.15.22:0/3889555640 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f03140390c0 0x7f031403b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f03200098c0 tx=0x7f0320006db0 comp rx=0 tx=0).stop 2024-09-10T08:00:10.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.304+0000 7f03310e0640 1 -- 172.21.15.22:0/3889555640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f032c100540 msgr2=0x7f032c195c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:10.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.304+0000 7f03310e0640 1 --2- 172.21.15.22:0/3889555640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f032c100540 0x7f032c195c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f031c004f60 tx=0x7f031c0048f0 comp rx=0 tx=0).stop 2024-09-10T08:00:10.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.304+0000 7f03310e0640 1 -- 172.21.15.22:0/3889555640 shutdown_connections 2024-09-10T08:00:10.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.304+0000 7f03310e0640 1 --2- 172.21.15.22:0/3889555640 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f03140390c0 0x7f031403b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:10.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.304+0000 7f03310e0640 1 --2- 172.21.15.22:0/3889555640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f032c100540 0x7f032c195c60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:10.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.304+0000 7f03310e0640 1 -- 172.21.15.22:0/3889555640 >> 172.21.15.22:0/3889555640 conn(0x7f032c0fbcd0 msgr2=0x7f032c0fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:10.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.305+0000 7f03310e0640 1 -- 172.21.15.22:0/3889555640 shutdown_connections 2024-09-10T08:00:10.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:10.305+0000 7f03310e0640 1 -- 172.21.15.22:0/3889555640 wait complete. 2024-09-10T08:00:11.383 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T08:00:11.383 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T08:00:11.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:11 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3889555640' entity='client.admin' 2024-09-10T08:00:11.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:11.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:11.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi022", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:00:11.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:11.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:00:11.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:11.635 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:00:12.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.061+0000 7fddb78f3640 1 -- 172.21.15.22:0/3184733129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb01015e0 msgr2=0x7fddb01019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:12.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.061+0000 7fddb78f3640 1 --2- 172.21.15.22:0/3184733129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb01015e0 0x7fddb01019e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fddac009880 tx=0x7fddac02a5d0 comp rx=0 tx=0).stop 2024-09-10T08:00:12.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.061+0000 7fddb78f3640 1 -- 172.21.15.22:0/3184733129 shutdown_connections 2024-09-10T08:00:12.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.061+0000 7fddb78f3640 1 --2- 172.21.15.22:0/3184733129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb01015e0 0x7fddb01019e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:12.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.061+0000 7fddb78f3640 1 -- 172.21.15.22:0/3184733129 >> 172.21.15.22:0/3184733129 conn(0x7fddb00fcd70 msgr2=0x7fddb00ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:12.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.061+0000 7fddb78f3640 1 -- 172.21.15.22:0/3184733129 shutdown_connections 2024-09-10T08:00:12.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.061+0000 7fddb78f3640 1 -- 172.21.15.22:0/3184733129 wait complete. 2024-09-10T08:00:12.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.062+0000 7fddb78f3640 1 Processor -- start 2024-09-10T08:00:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.062+0000 7fddb78f3640 1 -- start start 2024-09-10T08:00:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.062+0000 7fddb78f3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb01015e0 0x7fddb0196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.062+0000 7fddb78f3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fddb01076f0 con 0x7fddb01015e0 2024-09-10T08:00:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.062+0000 7fddb568f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb01015e0 0x7fddb0196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.062+0000 7fddb568f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb01015e0 0x7fddb0196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39720/0 (socket says 172.21.15.22:39720) 2024-09-10T08:00:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.062+0000 7fddb568f640 1 -- 172.21.15.22:0/1142527173 learned_addr learned my addr 172.21.15.22:0/1142527173 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.062+0000 7fddb568f640 1 -- 172.21.15.22:0/1142527173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb01972d0 con 0x7fddb01015e0 2024-09-10T08:00:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.062+0000 7fddb568f640 1 --2- 172.21.15.22:0/1142527173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb01015e0 0x7fddb0196d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fddac004f60 tx=0x7fddac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.063+0000 7fdda67fc640 1 -- 172.21.15.22:0/1142527173 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddac03f070 con 0x7fddb01015e0 2024-09-10T08:00:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.063+0000 7fdda67fc640 1 -- 172.21.15.22:0/1142527173 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddac004d40 con 0x7fddb01015e0 2024-09-10T08:00:12.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.063+0000 7fddb78f3640 1 -- 172.21.15.22:0/1142527173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb0197560 con 0x7fddb01015e0 2024-09-10T08:00:12.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.063+0000 7fdda67fc640 1 -- 172.21.15.22:0/1142527173 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddac035030 con 0x7fddb01015e0 2024-09-10T08:00:12.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.063+0000 7fddb78f3640 1 -- 172.21.15.22:0/1142527173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb019a210 con 0x7fddb01015e0 2024-09-10T08:00:12.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.064+0000 7fdda67fc640 1 -- 172.21.15.22:0/1142527173 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fddac042070 con 0x7fddb01015e0 2024-09-10T08:00:12.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.064+0000 7fddb78f3640 1 -- 172.21.15.22:0/1142527173 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb0107e70 con 0x7fddb01015e0 2024-09-10T08:00:12.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.064+0000 7fdda67fc640 1 --2- 172.21.15.22:0/1142527173 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdd9c039060 0x7fdd9c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:12.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.064+0000 7fdda67fc640 1 -- 172.21.15.22:0/1142527173 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fddac06cd10 con 0x7fddb01015e0 2024-09-10T08:00:12.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.064+0000 7fddb4e8e640 1 --2- 172.21.15.22:0/1142527173 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdd9c039060 0x7fdd9c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:12.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.064+0000 7fddb4e8e640 1 --2- 172.21.15.22:0/1142527173 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdd9c039060 0x7fdd9c03b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdda00098c0 tx=0x7fdda0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:12.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.069+0000 7fdda67fc640 1 -- 172.21.15.22:0/1142527173 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fddac04a260 con 0x7fddb01015e0 2024-09-10T08:00:12.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.250+0000 7fddb78f3640 1 -- 172.21.15.22:0/1142527173 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fddb002d8a0 con 0x7fdd9c039060 2024-09-10T08:00:12.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.253+0000 7fdda67fc640 1 -- 172.21.15.22:0/1142527173 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fddb002d8a0 con 0x7fdd9c039060 2024-09-10T08:00:12.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.255+0000 7fddb78f3640 1 -- 172.21.15.22:0/1142527173 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdd9c039060 msgr2=0x7fdd9c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:12.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.255+0000 7fddb78f3640 1 --2- 172.21.15.22:0/1142527173 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdd9c039060 0x7fdd9c03b520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdda00098c0 tx=0x7fdda0006db0 comp rx=0 tx=0).stop 2024-09-10T08:00:12.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.255+0000 7fddb78f3640 1 -- 172.21.15.22:0/1142527173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb01015e0 msgr2=0x7fddb0196d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:12.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.255+0000 7fddb78f3640 1 --2- 172.21.15.22:0/1142527173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb01015e0 0x7fddb0196d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fddac004f60 tx=0x7fddac0048f0 comp rx=0 tx=0).stop 2024-09-10T08:00:12.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.255+0000 7fddb78f3640 1 -- 172.21.15.22:0/1142527173 shutdown_connections 2024-09-10T08:00:12.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.255+0000 7fddb78f3640 1 --2- 172.21.15.22:0/1142527173 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdd9c039060 0x7fdd9c03b520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:12.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.255+0000 7fddb78f3640 1 --2- 172.21.15.22:0/1142527173 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fddb01015e0 0x7fddb0196d90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:12.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.255+0000 7fddb78f3640 1 -- 172.21.15.22:0/1142527173 >> 172.21.15.22:0/1142527173 conn(0x7fddb00fcd70 msgr2=0x7fddb00fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:12.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.255+0000 7fddb78f3640 1 -- 172.21.15.22:0/1142527173 shutdown_connections 2024-09-10T08:00:12.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:12.256+0000 7fddb78f3640 1 -- 172.21.15.22:0/1142527173 wait complete. 2024-09-10T08:00:12.959 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi100 2024-09-10T08:00:12.960 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T08:00:12.960 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/etc/ceph/ceph.conf 2024-09-10T08:00:12.982 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T08:00:12.982 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:00:13.040 INFO:tasks.cephadm:Adding host smithi100 to orchestrator... 2024-09-10T08:00:13.041 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch host add smithi100 2024-09-10T08:00:13.295 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:00:13.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:13 smithi022 ceph-mon[30854]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:00:13.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:13.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:00:13.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:13.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:00:13.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:13 smithi022 ceph-mon[30854]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-10T08:00:13.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:13 smithi022 ceph-mon[30854]: Updating smithi022:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:13.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:13 smithi022 ceph-mon[30854]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:00:13.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:13.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:13.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:13.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.707+0000 7f765bbef640 1 -- 172.21.15.22:0/49503851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76541027b0 msgr2=0x7f7654102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:13.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.707+0000 7f765bbef640 1 --2- 172.21.15.22:0/49503851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76541027b0 0x7f7654102b90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7650009c10 tx=0x7f765002aa10 comp rx=0 tx=0).stop 2024-09-10T08:00:13.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.707+0000 7f765bbef640 1 -- 172.21.15.22:0/49503851 shutdown_connections 2024-09-10T08:00:13.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.707+0000 7f765bbef640 1 --2- 172.21.15.22:0/49503851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76541027b0 0x7f7654102b90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:13.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.707+0000 7f765bbef640 1 -- 172.21.15.22:0/49503851 >> 172.21.15.22:0/49503851 conn(0x7f7654077310 msgr2=0x7f76540fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.707+0000 7f765bbef640 1 -- 172.21.15.22:0/49503851 shutdown_connections 2024-09-10T08:00:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.707+0000 7f765bbef640 1 -- 172.21.15.22:0/49503851 wait complete. 2024-09-10T08:00:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.707+0000 7f765bbef640 1 Processor -- start 2024-09-10T08:00:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.707+0000 7f765bbef640 1 -- start start 2024-09-10T08:00:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.707+0000 7f765bbef640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76541027b0 0x7f76541971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.707+0000 7f765bbef640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f765410bc80 con 0x7f76541027b0 2024-09-10T08:00:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.708+0000 7f765998b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76541027b0 0x7f76541971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:13.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.708+0000 7f765998b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76541027b0 0x7f76541971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44610/0 (socket says 172.21.15.22:44610) 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.708+0000 7f765998b640 1 -- 172.21.15.22:0/3187514313 learned_addr learned my addr 172.21.15.22:0/3187514313 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.708+0000 7f765998b640 1 -- 172.21.15.22:0/3187514313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76541976f0 con 0x7f76541027b0 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.708+0000 7f765998b640 1 --2- 172.21.15.22:0/3187514313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76541027b0 0x7f76541971b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7650009d30 tx=0x7f7650030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.708+0000 7f764affd640 1 -- 172.21.15.22:0/3187514313 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7650034070 con 0x7f76541027b0 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.708+0000 7f765bbef640 1 -- 172.21.15.22:0/3187514313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7654197980 con 0x7f76541027b0 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.708+0000 7f764affd640 1 -- 172.21.15.22:0/3187514313 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f765002f8c0 con 0x7f76541027b0 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.708+0000 7f764affd640 1 -- 172.21.15.22:0/3187514313 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76500044d0 con 0x7f76541027b0 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.708+0000 7f765bbef640 1 -- 172.21.15.22:0/3187514313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7654197d80 con 0x7f76541027b0 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.709+0000 7f764affd640 1 -- 172.21.15.22:0/3187514313 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7650037020 con 0x7f76541027b0 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.709+0000 7f765bbef640 1 -- 172.21.15.22:0/3187514313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7654069f10 con 0x7f76541027b0 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.709+0000 7f764affd640 1 --2- 172.21.15.22:0/3187514313 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f76400390c0 0x7f764003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.709+0000 7f764affd640 1 -- 172.21.15.22:0/3187514313 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f765006cf20 con 0x7f76541027b0 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.709+0000 7f765918a640 1 --2- 172.21.15.22:0/3187514313 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f76400390c0 0x7f764003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:13.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.710+0000 7f765918a640 1 --2- 172.21.15.22:0/3187514313 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f76400390c0 0x7f764003b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f76440098c0 tx=0x7f7644006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:13.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.714+0000 7f764affd640 1 -- 172.21.15.22:0/3187514313 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f765003f070 con 0x7f76541027b0 2024-09-10T08:00:13.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:13.892+0000 7f765bbef640 1 -- 172.21.15.22:0/3187514313 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}) -- 0x7f7654106c60 con 0x7f76400390c0 2024-09-10T08:00:14.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:14 smithi022 ceph-mon[30854]: Updating smithi022:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T08:00:15.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:15 smithi022 ceph-mon[30854]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:00:16.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:16 smithi022 ceph-mon[30854]: Deploying cephadm binary to smithi100 2024-09-10T08:00:17.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:17.671+0000 7f764affd640 1 -- 172.21.15.22:0/3187514313 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f7654106c60 con 0x7f76400390c0 2024-09-10T08:00:17.670 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi100' with addr '172.21.15.100' 2024-09-10T08:00:17.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:17.673+0000 7f765bbef640 1 -- 172.21.15.22:0/3187514313 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f76400390c0 msgr2=0x7f764003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:17.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:17.673+0000 7f765bbef640 1 --2- 172.21.15.22:0/3187514313 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f76400390c0 0x7f764003b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f76440098c0 tx=0x7f7644006db0 comp rx=0 tx=0).stop 2024-09-10T08:00:17.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:17.673+0000 7f765bbef640 1 -- 172.21.15.22:0/3187514313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76541027b0 msgr2=0x7f76541971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:17.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:17.673+0000 7f765bbef640 1 --2- 172.21.15.22:0/3187514313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76541027b0 0x7f76541971b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7650009d30 tx=0x7f7650030c30 comp rx=0 tx=0).stop 2024-09-10T08:00:17.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:17.673+0000 7f765bbef640 1 -- 172.21.15.22:0/3187514313 shutdown_connections 2024-09-10T08:00:17.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:17.673+0000 7f765bbef640 1 --2- 172.21.15.22:0/3187514313 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f76400390c0 0x7f764003b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:17.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:17.673+0000 7f765bbef640 1 --2- 172.21.15.22:0/3187514313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76541027b0 0x7f76541971b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:17.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:17.673+0000 7f765bbef640 1 -- 172.21.15.22:0/3187514313 >> 172.21.15.22:0/3187514313 conn(0x7f7654077310 msgr2=0x7f7654105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:17.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:17.673+0000 7f765bbef640 1 -- 172.21.15.22:0/3187514313 shutdown_connections 2024-09-10T08:00:17.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:17.673+0000 7f765bbef640 1 -- 172.21.15.22:0/3187514313 wait complete. 2024-09-10T08:00:18.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T08:00:18.550 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:00:18.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:18 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:18.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:18 smithi022 ceph-mon[30854]: Added host smithi100 2024-09-10T08:00:18.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:18 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:00:18.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:18 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:18.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:18 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.081+0000 7f7457fa7640 1 -- 172.21.15.22:0/3833406921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74501002e0 msgr2=0x7f74501006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.081+0000 7f7457fa7640 1 --2- 172.21.15.22:0/3833406921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74501002e0 0x7f74501006c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f744c009880 tx=0x7f744c02a5d0 comp rx=0 tx=0).stop 2024-09-10T08:00:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.081+0000 7f7457fa7640 1 -- 172.21.15.22:0/3833406921 shutdown_connections 2024-09-10T08:00:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.081+0000 7f7457fa7640 1 --2- 172.21.15.22:0/3833406921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74501002e0 0x7f74501006c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:19.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.081+0000 7f7457fa7640 1 -- 172.21.15.22:0/3833406921 >> 172.21.15.22:0/3833406921 conn(0x7f74500fc1b0 msgr2=0x7f74500fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.081+0000 7f7457fa7640 1 -- 172.21.15.22:0/3833406921 shutdown_connections 2024-09-10T08:00:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.081+0000 7f7457fa7640 1 -- 172.21.15.22:0/3833406921 wait complete. 2024-09-10T08:00:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.082+0000 7f7457fa7640 1 Processor -- start 2024-09-10T08:00:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.082+0000 7f7457fa7640 1 -- start start 2024-09-10T08:00:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.082+0000 7f7457fa7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74501002e0 0x7f74501993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:19.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.082+0000 7f7457fa7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f745010dea0 con 0x7f74501002e0 2024-09-10T08:00:19.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.082+0000 7f7455d43640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74501002e0 0x7f74501993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:19.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.082+0000 7f7455d43640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74501002e0 0x7f74501993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44628/0 (socket says 172.21.15.22:44628) 2024-09-10T08:00:19.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.082+0000 7f7455d43640 1 -- 172.21.15.22:0/2867356128 learned_addr learned my addr 172.21.15.22:0/2867356128 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:19.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.082+0000 7f7455d43640 1 -- 172.21.15.22:0/2867356128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7450199910 con 0x7f74501002e0 2024-09-10T08:00:19.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.082+0000 7f7455d43640 1 --2- 172.21.15.22:0/2867356128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74501002e0 0x7f74501993d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f744c009230 tx=0x7f744c003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:19.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.082+0000 7f7446ffd640 1 -- 172.21.15.22:0/2867356128 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744c03f070 con 0x7f74501002e0 2024-09-10T08:00:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.083+0000 7f7446ffd640 1 -- 172.21.15.22:0/2867356128 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f744c03bd40 con 0x7f74501002e0 2024-09-10T08:00:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.083+0000 7f7457fa7640 1 -- 172.21.15.22:0/2867356128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7450199ba0 con 0x7f74501002e0 2024-09-10T08:00:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.083+0000 7f7446ffd640 1 -- 172.21.15.22:0/2867356128 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744c035030 con 0x7f74501002e0 2024-09-10T08:00:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.083+0000 7f7457fa7640 1 -- 172.21.15.22:0/2867356128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745019a000 con 0x7f74501002e0 2024-09-10T08:00:19.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.083+0000 7f7446ffd640 1 -- 172.21.15.22:0/2867356128 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f744c042070 con 0x7f74501002e0 2024-09-10T08:00:19.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.084+0000 7f7457fa7640 1 -- 172.21.15.22:0/2867356128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f745006a7b0 con 0x7f74501002e0 2024-09-10T08:00:19.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.084+0000 7f7446ffd640 1 --2- 172.21.15.22:0/2867356128 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f743c039060 0x7f743c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:19.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.084+0000 7f7446ffd640 1 -- 172.21.15.22:0/2867356128 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f744c06cc60 con 0x7f74501002e0 2024-09-10T08:00:19.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.084+0000 7f7455542640 1 --2- 172.21.15.22:0/2867356128 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f743c039060 0x7f743c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:19.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.084+0000 7f7455542640 1 --2- 172.21.15.22:0/2867356128 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f743c039060 0x7f743c03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f74400098c0 tx=0x7f7440006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:19.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.089+0000 7f7446ffd640 1 -- 172.21.15.22:0/2867356128 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f744c073080 con 0x7f74501002e0 2024-09-10T08:00:19.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.271+0000 7f7457fa7640 1 -- 172.21.15.22:0/2867356128 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f745019a730 con 0x7f743c039060 2024-09-10T08:00:19.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.272+0000 7f7446ffd640 1 -- 172.21.15.22:0/2867356128 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f745019a730 con 0x7f743c039060 2024-09-10T08:00:19.271 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:19.271 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}] 2024-09-10T08:00:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.274+0000 7f7457fa7640 1 -- 172.21.15.22:0/2867356128 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f743c039060 msgr2=0x7f743c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.274+0000 7f7457fa7640 1 --2- 172.21.15.22:0/2867356128 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f743c039060 0x7f743c03b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f74400098c0 tx=0x7f7440006db0 comp rx=0 tx=0).stop 2024-09-10T08:00:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.274+0000 7f7457fa7640 1 -- 172.21.15.22:0/2867356128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74501002e0 msgr2=0x7f74501993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.274+0000 7f7457fa7640 1 --2- 172.21.15.22:0/2867356128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74501002e0 0x7f74501993d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f744c009230 tx=0x7f744c003d80 comp rx=0 tx=0).stop 2024-09-10T08:00:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.274+0000 7f7457fa7640 1 -- 172.21.15.22:0/2867356128 shutdown_connections 2024-09-10T08:00:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.274+0000 7f7457fa7640 1 --2- 172.21.15.22:0/2867356128 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f743c039060 0x7f743c03b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.274+0000 7f7457fa7640 1 --2- 172.21.15.22:0/2867356128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74501002e0 0x7f74501993d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.274+0000 7f7457fa7640 1 -- 172.21.15.22:0/2867356128 >> 172.21.15.22:0/2867356128 conn(0x7f74500fc1b0 msgr2=0x7f74500fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.274+0000 7f7457fa7640 1 -- 172.21.15.22:0/2867356128 shutdown_connections 2024-09-10T08:00:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:19.274+0000 7f7457fa7640 1 -- 172.21.15.22:0/2867356128 wait complete. 2024-09-10T08:00:19.901 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi153 2024-09-10T08:00:19.902 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-10T08:00:19.902 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.conf 2024-09-10T08:00:19.922 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-10T08:00:19.922 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:00:19.980 INFO:tasks.cephadm:Adding host smithi153 to orchestrator... 2024-09-10T08:00:19.980 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch host add smithi153 2024-09-10T08:00:20.237 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:00:20.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:20.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:20 smithi022 ceph-mon[30854]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:00:20.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.638+0000 7faa0fddf640 1 -- 172.21.15.22:0/3355744942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa08106540 msgr2=0x7faa08106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:20.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.638+0000 7faa0fddf640 1 --2- 172.21.15.22:0/3355744942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa08106540 0x7faa08106920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faa04009810 tx=0x7faa0402a540 comp rx=0 tx=0).stop 2024-09-10T08:00:20.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.638+0000 7faa0fddf640 1 -- 172.21.15.22:0/3355744942 shutdown_connections 2024-09-10T08:00:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.638+0000 7faa0fddf640 1 --2- 172.21.15.22:0/3355744942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa08106540 0x7faa08106920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.638+0000 7faa0fddf640 1 -- 172.21.15.22:0/3355744942 >> 172.21.15.22:0/3355744942 conn(0x7faa08077310 msgr2=0x7faa080fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.638+0000 7faa0fddf640 1 -- 172.21.15.22:0/3355744942 shutdown_connections 2024-09-10T08:00:20.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.638+0000 7faa0fddf640 1 -- 172.21.15.22:0/3355744942 wait complete. 2024-09-10T08:00:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.638+0000 7faa0fddf640 1 Processor -- start 2024-09-10T08:00:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.639+0000 7faa0fddf640 1 -- start start 2024-09-10T08:00:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.639+0000 7faa0fddf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa08106540 0x7faa08197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.639+0000 7faa0fddf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa0810ab70 con 0x7faa08106540 2024-09-10T08:00:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.639+0000 7faa0db7b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa08106540 0x7faa08197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.639+0000 7faa0db7b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa08106540 0x7faa08197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44644/0 (socket says 172.21.15.22:44644) 2024-09-10T08:00:20.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.639+0000 7faa0db7b640 1 -- 172.21.15.22:0/1177271735 learned_addr learned my addr 172.21.15.22:0/1177271735 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:20.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.639+0000 7faa0db7b640 1 -- 172.21.15.22:0/1177271735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa08197690 con 0x7faa08106540 2024-09-10T08:00:20.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.639+0000 7faa0db7b640 1 --2- 172.21.15.22:0/1177271735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa08106540 0x7faa08197150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faa040045e0 tx=0x7faa04004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:20.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.640+0000 7fa9faffd640 1 -- 172.21.15.22:0/1177271735 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa04030e70 con 0x7faa08106540 2024-09-10T08:00:20.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.640+0000 7fa9faffd640 1 -- 172.21.15.22:0/1177271735 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa040318e0 con 0x7faa08106540 2024-09-10T08:00:20.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.640+0000 7faa0fddf640 1 -- 172.21.15.22:0/1177271735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa08197920 con 0x7faa08106540 2024-09-10T08:00:20.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.640+0000 7fa9faffd640 1 -- 172.21.15.22:0/1177271735 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faa040049c0 con 0x7faa08106540 2024-09-10T08:00:20.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.640+0000 7faa0fddf640 1 -- 172.21.15.22:0/1177271735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0819ba20 con 0x7faa08106540 2024-09-10T08:00:20.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.641+0000 7fa9faffd640 1 -- 172.21.15.22:0/1177271735 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7faa04039040 con 0x7faa08106540 2024-09-10T08:00:20.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.641+0000 7faa0fddf640 1 -- 172.21.15.22:0/1177271735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa08101bb0 con 0x7faa08106540 2024-09-10T08:00:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.641+0000 7fa9faffd640 1 --2- 172.21.15.22:0/1177271735 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa9f40390c0 0x7fa9f403b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.641+0000 7fa9faffd640 1 -- 172.21.15.22:0/1177271735 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7faa0406d250 con 0x7faa08106540 2024-09-10T08:00:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.641+0000 7faa0d37a640 1 --2- 172.21.15.22:0/1177271735 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa9f40390c0 0x7fa9f403b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:20.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.641+0000 7faa0d37a640 1 --2- 172.21.15.22:0/1177271735 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa9f40390c0 0x7fa9f403b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00ad30 tx=0x7fa9fc0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:20.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.646+0000 7fa9faffd640 1 -- 172.21.15.22:0/1177271735 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa04040030 con 0x7faa08106540 2024-09-10T08:00:20.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:20.825+0000 7faa0fddf640 1 -- 172.21.15.22:0/1177271735 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}) -- 0x7faa081069a0 con 0x7fa9f40390c0 2024-09-10T08:00:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:22 smithi022 ceph-mon[30854]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:00:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:22 smithi022 ceph-mon[30854]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:00:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:00:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:23.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:23.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:24.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:23 smithi022 ceph-mon[30854]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-10T08:00:24.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:23 smithi022 ceph-mon[30854]: Deploying cephadm binary to smithi153 2024-09-10T08:00:24.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:23 smithi022 ceph-mon[30854]: Updating smithi100:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:24.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:23 smithi022 ceph-mon[30854]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:00:24.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:23 smithi022 ceph-mon[30854]: Updating smithi100:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T08:00:24.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:24.705+0000 7fa9faffd640 1 -- 172.21.15.22:0/1177271735 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7faa081069a0 con 0x7fa9f40390c0 2024-09-10T08:00:24.704 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi153' with addr '172.21.15.153' 2024-09-10T08:00:24.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:24.707+0000 7faa0fddf640 1 -- 172.21.15.22:0/1177271735 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa9f40390c0 msgr2=0x7fa9f403b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:24.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:24.707+0000 7faa0fddf640 1 --2- 172.21.15.22:0/1177271735 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa9f40390c0 0x7fa9f403b580 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00ad30 tx=0x7fa9fc0093f0 comp rx=0 tx=0).stop 2024-09-10T08:00:24.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:24.707+0000 7faa0fddf640 1 -- 172.21.15.22:0/1177271735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa08106540 msgr2=0x7faa08197150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:24.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:24.707+0000 7faa0fddf640 1 --2- 172.21.15.22:0/1177271735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa08106540 0x7faa08197150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faa040045e0 tx=0x7faa04004610 comp rx=0 tx=0).stop 2024-09-10T08:00:24.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:24.707+0000 7faa0fddf640 1 -- 172.21.15.22:0/1177271735 shutdown_connections 2024-09-10T08:00:24.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:24.707+0000 7faa0fddf640 1 --2- 172.21.15.22:0/1177271735 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa9f40390c0 0x7fa9f403b580 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:24.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:24.707+0000 7faa0fddf640 1 --2- 172.21.15.22:0/1177271735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa08106540 0x7faa08197150 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:24.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:24.707+0000 7faa0fddf640 1 -- 172.21.15.22:0/1177271735 >> 172.21.15.22:0/1177271735 conn(0x7faa08077310 msgr2=0x7faa080696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:24.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:24.707+0000 7faa0fddf640 1 -- 172.21.15.22:0/1177271735 shutdown_connections 2024-09-10T08:00:24.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:24.707+0000 7faa0fddf640 1 -- 172.21.15.22:0/1177271735 wait complete. 2024-09-10T08:00:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:24 smithi022 ceph-mon[30854]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:00:25.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T08:00:25.563 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:00:26.002 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:25 smithi022 ceph-mon[30854]: Added host smithi153 2024-09-10T08:00:26.002 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:25 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:26.002 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:25 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:26.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.087+0000 7f784af93640 1 -- 172.21.15.22:0/2231114311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7844102730 msgr2=0x7f7844102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:26.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.087+0000 7f784af93640 1 --2- 172.21.15.22:0/2231114311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7844102730 0x7f7844102b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7834009810 tx=0x7f783402a540 comp rx=0 tx=0).stop 2024-09-10T08:00:26.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.087+0000 7f784af93640 1 -- 172.21.15.22:0/2231114311 shutdown_connections 2024-09-10T08:00:26.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.087+0000 7f784af93640 1 --2- 172.21.15.22:0/2231114311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7844102730 0x7f7844102b10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:26.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.087+0000 7f784af93640 1 -- 172.21.15.22:0/2231114311 >> 172.21.15.22:0/2231114311 conn(0x7f7844077310 msgr2=0x7f78440fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:26.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.087+0000 7f784af93640 1 -- 172.21.15.22:0/2231114311 shutdown_connections 2024-09-10T08:00:26.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.087+0000 7f784af93640 1 -- 172.21.15.22:0/2231114311 wait complete. 2024-09-10T08:00:26.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.088+0000 7f784af93640 1 Processor -- start 2024-09-10T08:00:26.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.088+0000 7f784af93640 1 -- start start 2024-09-10T08:00:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.088+0000 7f784af93640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7844102730 0x7f78441971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.088+0000 7f784af93640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f784410bc80 con 0x7f7844102730 2024-09-10T08:00:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.089+0000 7f7848d2f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7844102730 0x7f78441971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.089+0000 7f7848d2f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7844102730 0x7f78441971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40582/0 (socket says 172.21.15.22:40582) 2024-09-10T08:00:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.089+0000 7f7848d2f640 1 -- 172.21.15.22:0/3490996520 learned_addr learned my addr 172.21.15.22:0/3490996520 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.089+0000 7f7848d2f640 1 -- 172.21.15.22:0/3490996520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78441976f0 con 0x7f7844102730 2024-09-10T08:00:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.089+0000 7f7848d2f640 1 --2- 172.21.15.22:0/3490996520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7844102730 0x7f78441971b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7834009930 tx=0x7f7834004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.089+0000 7f7841ffb640 1 -- 172.21.15.22:0/3490996520 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7834031400 con 0x7f7844102730 2024-09-10T08:00:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.089+0000 7f784af93640 1 -- 172.21.15.22:0/3490996520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7844197980 con 0x7f7844102730 2024-09-10T08:00:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.089+0000 7f7841ffb640 1 -- 172.21.15.22:0/3490996520 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f78340035f0 con 0x7f7844102730 2024-09-10T08:00:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.089+0000 7f7841ffb640 1 -- 172.21.15.22:0/3490996520 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f783403c440 con 0x7f7844102730 2024-09-10T08:00:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.089+0000 7f784af93640 1 -- 172.21.15.22:0/3490996520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7844197de0 con 0x7f7844102730 2024-09-10T08:00:26.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.090+0000 7f7841ffb640 1 -- 172.21.15.22:0/3490996520 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f7834039040 con 0x7f7844102730 2024-09-10T08:00:26.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.090+0000 7f7841ffb640 1 --2- 172.21.15.22:0/3490996520 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f782c039060 0x7f782c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:26.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.090+0000 7f7841ffb640 1 -- 172.21.15.22:0/3490996520 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f783406d290 con 0x7f7844102730 2024-09-10T08:00:26.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.091+0000 7f784af93640 1 -- 172.21.15.22:0/3490996520 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7844069f90 con 0x7f7844102730 2024-09-10T08:00:26.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.091+0000 7f7843fff640 1 --2- 172.21.15.22:0/3490996520 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f782c039060 0x7f782c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:26.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.091+0000 7f7843fff640 1 --2- 172.21.15.22:0/3490996520 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f782c039060 0x7f782c03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f78380098c0 tx=0x7f7838006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:26.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.096+0000 7f7841ffb640 1 -- 172.21.15.22:0/3490996520 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7834040030 con 0x7f7844102730 2024-09-10T08:00:26.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.278+0000 7f784af93640 1 -- 172.21.15.22:0/3490996520 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78441985a0 con 0x7f782c039060 2024-09-10T08:00:26.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.279+0000 7f7841ffb640 1 -- 172.21.15.22:0/3490996520 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f78441985a0 con 0x7f782c039060 2024-09-10T08:00:26.280 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:26.280 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "172.21.15.153", "hostname": "smithi153", "labels": [], "status": ""}] 2024-09-10T08:00:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.282+0000 7f784af93640 1 -- 172.21.15.22:0/3490996520 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f782c039060 msgr2=0x7f782c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.282+0000 7f784af93640 1 --2- 172.21.15.22:0/3490996520 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f782c039060 0x7f782c03b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f78380098c0 tx=0x7f7838006db0 comp rx=0 tx=0).stop 2024-09-10T08:00:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.282+0000 7f784af93640 1 -- 172.21.15.22:0/3490996520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7844102730 msgr2=0x7f78441971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.282+0000 7f784af93640 1 --2- 172.21.15.22:0/3490996520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7844102730 0x7f78441971b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7834009930 tx=0x7f7834004570 comp rx=0 tx=0).stop 2024-09-10T08:00:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.282+0000 7f784af93640 1 -- 172.21.15.22:0/3490996520 shutdown_connections 2024-09-10T08:00:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.282+0000 7f784af93640 1 --2- 172.21.15.22:0/3490996520 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f782c039060 0x7f782c03b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.282+0000 7f784af93640 1 --2- 172.21.15.22:0/3490996520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7844102730 0x7f78441971b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:26.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.282+0000 7f784af93640 1 -- 172.21.15.22:0/3490996520 >> 172.21.15.22:0/3490996520 conn(0x7f7844077310 msgr2=0x7f78441034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:26.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.282+0000 7f784af93640 1 -- 172.21.15.22:0/3490996520 shutdown_connections 2024-09-10T08:00:26.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:26.282+0000 7f784af93640 1 -- 172.21.15.22:0/3490996520 wait complete. 2024-09-10T08:00:26.906 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:26 smithi022 ceph-mon[30854]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:26.906 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:26 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:26.934 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T08:00:26.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T08:00:27.191 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:00:27.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.656+0000 7f421f53a640 1 -- 172.21.15.22:0/2868310994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42181002e0 msgr2=0x7f42181006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.656+0000 7f421f53a640 1 --2- 172.21.15.22:0/2868310994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42181002e0 0x7f42181006c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4214009880 tx=0x7f421402a5d0 comp rx=0 tx=0).stop 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.656+0000 7f421f53a640 1 -- 172.21.15.22:0/2868310994 shutdown_connections 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.656+0000 7f421f53a640 1 --2- 172.21.15.22:0/2868310994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42181002e0 0x7f42181006c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.656+0000 7f421f53a640 1 -- 172.21.15.22:0/2868310994 >> 172.21.15.22:0/2868310994 conn(0x7f42180fc1b0 msgr2=0x7f42180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.657+0000 7f421f53a640 1 -- 172.21.15.22:0/2868310994 shutdown_connections 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.657+0000 7f421f53a640 1 -- 172.21.15.22:0/2868310994 wait complete. 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.657+0000 7f421f53a640 1 Processor -- start 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.657+0000 7f421f53a640 1 -- start start 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.658+0000 7f421f53a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42181002e0 0x7f42181993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.658+0000 7f421f53a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f421810dea0 con 0x7f42181002e0 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.658+0000 7f421d2d6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42181002e0 0x7f42181993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.658+0000 7f421d2d6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42181002e0 0x7f42181993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40610/0 (socket says 172.21.15.22:40610) 2024-09-10T08:00:27.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.658+0000 7f421d2d6640 1 -- 172.21.15.22:0/3242936651 learned_addr learned my addr 172.21.15.22:0/3242936651 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.658+0000 7f421d2d6640 1 -- 172.21.15.22:0/3242936651 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4218199910 con 0x7f42181002e0 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.658+0000 7f421d2d6640 1 --2- 172.21.15.22:0/3242936651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42181002e0 0x7f42181993d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4214009230 tx=0x7f4214003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.658+0000 7f420e7fc640 1 -- 172.21.15.22:0/3242936651 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f421403f070 con 0x7f42181002e0 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.658+0000 7f421f53a640 1 -- 172.21.15.22:0/3242936651 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4218199ba0 con 0x7f42181002e0 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.658+0000 7f420e7fc640 1 -- 172.21.15.22:0/3242936651 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f421403bc80 con 0x7f42181002e0 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.658+0000 7f420e7fc640 1 -- 172.21.15.22:0/3242936651 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4214035030 con 0x7f42181002e0 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.658+0000 7f421f53a640 1 -- 172.21.15.22:0/3242936651 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f421819a000 con 0x7f42181002e0 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.659+0000 7f420e7fc640 1 -- 172.21.15.22:0/3242936651 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f4214042070 con 0x7f42181002e0 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.659+0000 7f420e7fc640 1 --2- 172.21.15.22:0/3242936651 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f4204039060 0x7f420403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.659+0000 7f421f53a640 1 -- 172.21.15.22:0/3242936651 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f421806a7b0 con 0x7f42181002e0 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.659+0000 7f420e7fc640 1 -- 172.21.15.22:0/3242936651 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f421406cd60 con 0x7f42181002e0 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.660+0000 7f421cad5640 1 --2- 172.21.15.22:0/3242936651 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f4204039060 0x7f420403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.660+0000 7f421cad5640 1 --2- 172.21.15.22:0/3242936651 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f4204039060 0x7f420403b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f42080098c0 tx=0x7f4208006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:27.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.664+0000 7f420e7fc640 1 -- 172.21.15.22:0/3242936651 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4214041c30 con 0x7f42181002e0 2024-09-10T08:00:27.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:27.846+0000 7f421f53a640 1 -- 172.21.15.22:0/3242936651 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f421819a730 con 0x7f42181002e0 2024-09-10T08:00:28.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:27 smithi022 ceph-mon[30854]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:00:28.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:28.800+0000 7f420e7fc640 1 -- 172.21.15.22:0/3242936651 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f4214031e20 con 0x7f42181002e0 2024-09-10T08:00:28.800 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2024-09-10T08:00:28.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:28.803+0000 7f421f53a640 1 -- 172.21.15.22:0/3242936651 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f4204039060 msgr2=0x7f420403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:28.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:28.803+0000 7f421f53a640 1 --2- 172.21.15.22:0/3242936651 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f4204039060 0x7f420403b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f42080098c0 tx=0x7f4208006db0 comp rx=0 tx=0).stop 2024-09-10T08:00:28.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:28.803+0000 7f421f53a640 1 -- 172.21.15.22:0/3242936651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42181002e0 msgr2=0x7f42181993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:28.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:28.803+0000 7f421f53a640 1 --2- 172.21.15.22:0/3242936651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42181002e0 0x7f42181993d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4214009230 tx=0x7f4214003d40 comp rx=0 tx=0).stop 2024-09-10T08:00:28.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:28.803+0000 7f421f53a640 1 -- 172.21.15.22:0/3242936651 shutdown_connections 2024-09-10T08:00:28.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:28.803+0000 7f421f53a640 1 --2- 172.21.15.22:0/3242936651 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f4204039060 0x7f420403b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:28.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:28.803+0000 7f421f53a640 1 --2- 172.21.15.22:0/3242936651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42181002e0 0x7f42181993d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:28.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:28.803+0000 7f421f53a640 1 -- 172.21.15.22:0/3242936651 >> 172.21.15.22:0/3242936651 conn(0x7f42180fc1b0 msgr2=0x7f42180fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:28.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:28.803+0000 7f421f53a640 1 -- 172.21.15.22:0/3242936651 shutdown_connections 2024-09-10T08:00:28.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:28.803+0000 7f421f53a640 1 -- 172.21.15.22:0/3242936651 wait complete. 2024-09-10T08:00:29.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:28 smithi022 ceph-mon[30854]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:29.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:28 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3242936651' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-10T08:00:29.453 INFO:tasks.cephadm:Adding mon.a on smithi022 2024-09-10T08:00:29.453 INFO:tasks.cephadm:Adding mon.b on smithi100 2024-09-10T08:00:29.453 INFO:tasks.cephadm:Adding mon.c on smithi153 2024-09-10T08:00:29.454 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi022:172.21.15.22=a;smithi100:172.21.15.100=b;smithi153:172.21.15.153=c' 2024-09-10T08:00:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:30.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3242936651' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T08:00:30.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T08:00:30.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:30.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:30.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:30.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:30.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:30.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:00:30.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:30.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:00:30.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-10T08:00:30.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: Updating smithi153:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:30.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:00:30.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:29 smithi022 ceph-mon[30854]: Updating smithi153:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T08:00:30.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.313+0000 7f1eaf796640 1 -- 172.21.15.153:0/1047559492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ea81075e0 msgr2=0x7f1ea81079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:30.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.313+0000 7f1eaf796640 1 --2- 172.21.15.153:0/1047559492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ea81075e0 0x7f1ea81079c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009880 tx=0x7f1ea402a5d0 comp rx=0 tx=0).stop 2024-09-10T08:00:30.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.313+0000 7f1eaf796640 1 -- 172.21.15.153:0/1047559492 shutdown_connections 2024-09-10T08:00:30.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.313+0000 7f1eaf796640 1 --2- 172.21.15.153:0/1047559492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ea81075e0 0x7f1ea81079c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:30.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.313+0000 7f1eaf796640 1 -- 172.21.15.153:0/1047559492 >> 172.21.15.153:0/1047559492 conn(0x7f1ea80fb8c0 msgr2=0x7f1ea80fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:30.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.313+0000 7f1eaf796640 1 -- 172.21.15.153:0/1047559492 shutdown_connections 2024-09-10T08:00:30.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.313+0000 7f1eaf796640 1 -- 172.21.15.153:0/1047559492 wait complete. 2024-09-10T08:00:30.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.313+0000 7f1eaf796640 1 Processor -- start 2024-09-10T08:00:30.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.313+0000 7f1eaf796640 1 -- start start 2024-09-10T08:00:30.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.314+0000 7f1eaf796640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ea81075e0 0x7f1ea8197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:30.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.314+0000 7f1eaf796640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea810bb90 con 0x7f1ea81075e0 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.314+0000 7f1ead532640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ea81075e0 0x7f1ea8197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.314+0000 7f1ead532640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ea81075e0 0x7f1ea8197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.153:34070/0 (socket says 172.21.15.153:34070) 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.314+0000 7f1ead532640 1 -- 172.21.15.153:0/2586234676 learned_addr learned my addr 172.21.15.153:0/2586234676 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.314+0000 7f1ead532640 1 -- 172.21.15.153:0/2586234676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea81975d0 con 0x7f1ea81075e0 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.314+0000 7f1ead532640 1 --2- 172.21.15.153:0/2586234676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ea81075e0 0x7f1ea8197090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009230 tx=0x7f1ea4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.314+0000 7f1e9a7fc640 1 -- 172.21.15.153:0/2586234676 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea403f070 con 0x7f1ea81075e0 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.314+0000 7f1e9a7fc640 1 -- 172.21.15.153:0/2586234676 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea403bc80 con 0x7f1ea81075e0 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.314+0000 7f1eaf796640 1 -- 172.21.15.153:0/2586234676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea81978c0 con 0x7f1ea81075e0 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.314+0000 7f1e9a7fc640 1 -- 172.21.15.153:0/2586234676 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea4035030 con 0x7f1ea81075e0 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.314+0000 7f1eaf796640 1 -- 172.21.15.153:0/2586234676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea819b960 con 0x7f1ea81075e0 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.315+0000 7f1e9a7fc640 1 -- 172.21.15.153:0/2586234676 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f1ea4042070 con 0x7f1ea81075e0 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.315+0000 7f1eaf796640 1 -- 172.21.15.153:0/2586234676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea8102d90 con 0x7f1ea81075e0 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.315+0000 7f1e9a7fc640 1 --2- 172.21.15.153:0/2586234676 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1e94039060 0x7f1e9403b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.316+0000 7f1e9a7fc640 1 -- 172.21.15.153:0/2586234676 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1ea406cd80 con 0x7f1ea81075e0 2024-09-10T08:00:30.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.316+0000 7f1eacd31640 1 --2- 172.21.15.153:0/2586234676 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1e94039060 0x7f1e9403b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:30.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.316+0000 7f1eacd31640 1 --2- 172.21.15.153:0/2586234676 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1e94039060 0x7f1e9403b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0098c0 tx=0x7f1e9c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:30.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.320+0000 7f1e9a7fc640 1 -- 172.21.15.153:0/2586234676 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1ea4031570 con 0x7f1ea81075e0 2024-09-10T08:00:30.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.503+0000 7f1eaf796640 1 -- 172.21.15.153:0/2586234676 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi100:172.21.15.100=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}) -- 0x7f1ea81983f0 con 0x7f1e94039060 2024-09-10T08:00:30.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.508+0000 7f1e9a7fc640 1 -- 172.21.15.153:0/2586234676 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1ea81983f0 con 0x7f1e94039060 2024-09-10T08:00:30.508 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mon update... 2024-09-10T08:00:30.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.510+0000 7f1eaf796640 1 -- 172.21.15.153:0/2586234676 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1e94039060 msgr2=0x7f1e9403b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:30.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.510+0000 7f1eaf796640 1 --2- 172.21.15.153:0/2586234676 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1e94039060 0x7f1e9403b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0098c0 tx=0x7f1e9c006db0 comp rx=0 tx=0).stop 2024-09-10T08:00:30.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.510+0000 7f1eaf796640 1 -- 172.21.15.153:0/2586234676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ea81075e0 msgr2=0x7f1ea8197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:30.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.510+0000 7f1eaf796640 1 --2- 172.21.15.153:0/2586234676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ea81075e0 0x7f1ea8197090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009230 tx=0x7f1ea4003d40 comp rx=0 tx=0).stop 2024-09-10T08:00:30.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.511+0000 7f1eaf796640 1 -- 172.21.15.153:0/2586234676 shutdown_connections 2024-09-10T08:00:30.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.511+0000 7f1eaf796640 1 --2- 172.21.15.153:0/2586234676 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1e94039060 0x7f1e9403b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:30.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.511+0000 7f1eaf796640 1 --2- 172.21.15.153:0/2586234676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ea81075e0 0x7f1ea8197090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:30.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.511+0000 7f1eaf796640 1 -- 172.21.15.153:0/2586234676 >> 172.21.15.153:0/2586234676 conn(0x7f1ea80fb8c0 msgr2=0x7f1ea80fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:30.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.511+0000 7f1eaf796640 1 -- 172.21.15.153:0/2586234676 shutdown_connections 2024-09-10T08:00:30.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:30.511+0000 7f1eaf796640 1 -- 172.21.15.153:0/2586234676 wait complete. 2024-09-10T08:00:31.107 DEBUG:teuthology.orchestra.run.smithi100:mon.b> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T08:00:31.110 DEBUG:teuthology.orchestra.run.smithi153:mon.c> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T08:00:31.112 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T08:00:31.112 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T08:00:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi100:172.21.15.100=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:00:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: Saving service mon spec with placement smithi022:172.21.15.22=a;smithi100:172.21.15.100=b;smithi153:172.21.15.153=c;count:3 2024-09-10T08:00:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:00:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:31.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:00:31.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:31.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T08:00:31.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:31.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:30 smithi022 ceph-mon[30854]: Deploying daemon mon.c on smithi153 2024-09-10T08:00:32.218 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:33.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:32 smithi022 ceph-mon[30854]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.817+0000 7fe612cdd640 1 -- 172.21.15.153:0/1642818839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe60c074620 msgr2=0x7fe60c074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.817+0000 7fe612cdd640 1 --2- 172.21.15.153:0/1642818839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe60c074620 0x7fe60c074a00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe600009880 tx=0x7fe60002a670 comp rx=0 tx=0).stop 2024-09-10T08:00:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.817+0000 7fe612cdd640 1 -- 172.21.15.153:0/1642818839 shutdown_connections 2024-09-10T08:00:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.817+0000 7fe612cdd640 1 --2- 172.21.15.153:0/1642818839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe60c074620 0x7fe60c074a00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.817+0000 7fe612cdd640 1 -- 172.21.15.153:0/1642818839 >> 172.21.15.153:0/1642818839 conn(0x7fe60c0fd2b0 msgr2=0x7fe60c0ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.817+0000 7fe612cdd640 1 -- 172.21.15.153:0/1642818839 shutdown_connections 2024-09-10T08:00:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.817+0000 7fe612cdd640 1 -- 172.21.15.153:0/1642818839 wait complete. 2024-09-10T08:00:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.817+0000 7fe612cdd640 1 Processor -- start 2024-09-10T08:00:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.817+0000 7fe612cdd640 1 -- start start 2024-09-10T08:00:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.818+0000 7fe612cdd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe60c074620 0x7fe60c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.818+0000 7fe612cdd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c10dec0 con 0x7fe60c074620 2024-09-10T08:00:33.567 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T08:00:33.567 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","modified":"2024-09-10T07:59:01.813763Z","created":"2024-09-10T07:59:01.813763Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T08:00:33.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.818+0000 7fe610a79640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe60c074620 0x7fe60c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:33.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.818+0000 7fe610a79640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe60c074620 0x7fe60c1993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.153:34084/0 (socket says 172.21.15.153:34084) 2024-09-10T08:00:33.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.818+0000 7fe610a79640 1 -- 172.21.15.153:0/1373218676 learned_addr learned my addr 172.21.15.153:0/1373218676 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-10T08:00:33.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.818+0000 7fe610a79640 1 -- 172.21.15.153:0/1373218676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60c199910 con 0x7fe60c074620 2024-09-10T08:00:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.819+0000 7fe610a79640 1 --2- 172.21.15.153:0/1373218676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe60c074620 0x7fe60c1993d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe600009230 tx=0x7fe600003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.819+0000 7fe609ffb640 1 -- 172.21.15.153:0/1373218676 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe60003f070 con 0x7fe60c074620 2024-09-10T08:00:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.819+0000 7fe612cdd640 1 -- 172.21.15.153:0/1373218676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60c199ba0 con 0x7fe60c074620 2024-09-10T08:00:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.819+0000 7fe609ffb640 1 -- 172.21.15.153:0/1373218676 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe60003bd40 con 0x7fe60c074620 2024-09-10T08:00:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.819+0000 7fe609ffb640 1 -- 172.21.15.153:0/1373218676 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe600035030 con 0x7fe60c074620 2024-09-10T08:00:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.819+0000 7fe612cdd640 1 -- 172.21.15.153:0/1373218676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60c19a000 con 0x7fe60c074620 2024-09-10T08:00:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.820+0000 7fe612cdd640 1 -- 172.21.15.153:0/1373218676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe60c075cd0 con 0x7fe60c074620 2024-09-10T08:00:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.820+0000 7fe609ffb640 1 -- 172.21.15.153:0/1373218676 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fe600042070 con 0x7fe60c074620 2024-09-10T08:00:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.820+0000 7fe609ffb640 1 --2- 172.21.15.153:0/1373218676 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe5fc039060 0x7fe5fc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.820+0000 7fe609ffb640 1 -- 172.21.15.153:0/1373218676 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe60006ccc0 con 0x7fe60c074620 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.820+0000 7fe60bfff640 1 --2- 172.21.15.153:0/1373218676 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe5fc039060 0x7fe5fc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.821+0000 7fe60bfff640 1 --2- 172.21.15.153:0/1373218676 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe5fc039060 0x7fe5fc03b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80098c0 tx=0x7fe5f8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:32.825+0000 7fe609ffb640 1 -- 172.21.15.153:0/1373218676 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe600036df0 con 0x7fe60c074620 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:33.064+0000 7fe612cdd640 1 -- 172.21.15.153:0/1373218676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe60c19a790 con 0x7fe60c074620 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:33.065+0000 7fe609ffb640 1 -- 172.21.15.153:0/1373218676 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fe60003b860 con 0x7fe60c074620 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:33.068+0000 7fe612cdd640 1 -- 172.21.15.153:0/1373218676 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe5fc039060 msgr2=0x7fe5fc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:33.068+0000 7fe612cdd640 1 --2- 172.21.15.153:0/1373218676 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe5fc039060 0x7fe5fc03b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80098c0 tx=0x7fe5f8006db0 comp rx=0 tx=0).stop 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:33.068+0000 7fe612cdd640 1 -- 172.21.15.153:0/1373218676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe60c074620 msgr2=0x7fe60c1993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:33.068+0000 7fe612cdd640 1 --2- 172.21.15.153:0/1373218676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe60c074620 0x7fe60c1993d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe600009230 tx=0x7fe600003d80 comp rx=0 tx=0).stop 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:33.068+0000 7fe612cdd640 1 -- 172.21.15.153:0/1373218676 shutdown_connections 2024-09-10T08:00:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:33.068+0000 7fe612cdd640 1 --2- 172.21.15.153:0/1373218676 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe5fc039060 0x7fe5fc03b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:33.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:33.068+0000 7fe612cdd640 1 --2- 172.21.15.153:0/1373218676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe60c074620 0x7fe60c1993d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:33.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:33.068+0000 7fe612cdd640 1 -- 172.21.15.153:0/1373218676 >> 172.21.15.153:0/1373218676 conn(0x7fe60c0fd2b0 msgr2=0x7fe60c107840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:33.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:33.068+0000 7fe612cdd640 1 -- 172.21.15.153:0/1373218676 shutdown_connections 2024-09-10T08:00:33.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:33.068+0000 7fe612cdd640 1 -- 172.21.15.153:0/1373218676 wait complete. 2024-09-10T08:00:34.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:33 smithi022 ceph-mon[30854]: from='client.? 172.21.15.153:0/1373218676' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T08:00:35.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:34 smithi022 ceph-mon[30854]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:35.250 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T08:00:35.250 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T08:00:35.274 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:35 smithi153 systemd[1]: Started Ceph mon.c for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:00:35.514 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:00:40.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.347+0000 7f17e0f70640 1 -- 172.21.15.153:0/4185821536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17c4005740 msgr2=0x7f17c4007bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:40.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.347+0000 7f17e0f70640 1 --2- 172.21.15.153:0/4185821536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17c4005740 0x7f17c4007bd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17dc1016a0 tx=0x7f17cc02c490 comp rx=0 tx=0).stop 2024-09-10T08:00:40.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.347+0000 7f17e0f70640 1 -- 172.21.15.153:0/4185821536 shutdown_connections 2024-09-10T08:00:40.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.347+0000 7f17e0f70640 1 --2- 172.21.15.153:0/4185821536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17c4005740 0x7f17c4007bd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:40.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.347+0000 7f17e0f70640 1 -- 172.21.15.153:0/4185821536 >> 172.21.15.153:0/4185821536 conn(0x7f17dc0fc220 msgr2=0x7f17dc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:40.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.347+0000 7f17e0f70640 1 -- 172.21.15.153:0/4185821536 shutdown_connections 2024-09-10T08:00:40.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.347+0000 7f17e0f70640 1 -- 172.21.15.153:0/4185821536 wait complete. 2024-09-10T08:00:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.349+0000 7f17e0f70640 1 Processor -- start 2024-09-10T08:00:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.349+0000 7f17e0f70640 1 -- start start 2024-09-10T08:00:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.349+0000 7f17e0f70640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17c4005740 0x7f17dc199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.349+0000 7f17e0f70640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17dc199970 0x7f17dc19dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.349+0000 7f17e0f70640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc1075a0 con 0x7f17c4005740 2024-09-10T08:00:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.349+0000 7f17e0f70640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc107420 con 0x7f17dc199970 2024-09-10T08:00:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.349+0000 7f17d9d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17dc199970 0x7f17dc19dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.349+0000 7f17d9d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17dc199970 0x7f17dc19dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34812/0 (socket says 172.21.15.153:34812) 2024-09-10T08:00:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.349+0000 7f17d9d9b640 1 -- 172.21.15.153:0/1823166881 learned_addr learned my addr 172.21.15.153:0/1823166881 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-10T08:00:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.350+0000 7f17d9d9b640 1 -- 172.21.15.153:0/1823166881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17dc199970 msgr2=0x7f17dc19dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-10T08:00:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.350+0000 7f17d9d9b640 1 -- 172.21.15.153:0/1823166881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17dc199970 msgr2=0x7f17dc19dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:00:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.350+0000 7f17da59c640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17c4005740 0x7f17dc199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.350+0000 7f17d9d9b640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17dc199970 0x7f17dc19dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:00:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.350+0000 7f17d9d9b640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17dc199970 0x7f17dc19dd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:00:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.350+0000 7f17da59c640 1 -- 172.21.15.153:0/1823166881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17dc199970 msgr2=0x7f17dc19dd00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:00:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.350+0000 7f17da59c640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17dc199970 0x7f17dc19dd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.350+0000 7f17da59c640 1 -- 172.21.15.153:0/1823166881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17dc199f90 con 0x7f17c4005740 2024-09-10T08:00:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.350+0000 7f17da59c640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17c4005740 0x7f17dc199430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f17cc012c10 tx=0x7f17cc0337c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.350+0000 7f17cb7fe640 1 -- 172.21.15.153:0/1823166881 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f17cc038040 con 0x7f17c4005740 2024-09-10T08:00:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.350+0000 7f17cb7fe640 1 -- 172.21.15.153:0/1823166881 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17cc032e00 con 0x7f17c4005740 2024-09-10T08:00:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.350+0000 7f17cb7fe640 1 -- 172.21.15.153:0/1823166881 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f17cc03cde0 con 0x7f17c4005740 2024-09-10T08:00:40.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.351+0000 7f17e0f70640 1 -- 172.21.15.153:0/1823166881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17dc19e240 con 0x7f17c4005740 2024-09-10T08:00:40.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.351+0000 7f17e0f70640 1 -- 172.21.15.153:0/1823166881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17dc19e800 con 0x7f17c4005740 2024-09-10T08:00:40.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.352+0000 7f17cb7fe640 1 -- 172.21.15.153:0/1823166881 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f17cc043070 con 0x7f17c4005740 2024-09-10T08:00:40.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.352+0000 7f17cb7fe640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f17bc038df0 0x7f17bc03b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:40.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.352+0000 7f17cb7fe640 1 -- 172.21.15.153:0/1823166881 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f17cc06e770 con 0x7f17c4005740 2024-09-10T08:00:40.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.352+0000 7f17e0f70640 1 -- 172.21.15.153:0/1823166881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17dc101ca0 con 0x7f17c4005740 2024-09-10T08:00:40.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.352+0000 7f17d9d9b640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f17bc038df0 0x7f17bc03b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:40.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.353+0000 7f17d9d9b640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f17bc038df0 0x7f17bc03b2b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009100 tx=0x7f17d0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:40.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.358+0000 7f17cb7fe640 1 -- 172.21.15.153:0/1823166881 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17cc043360 con 0x7f17c4005740 2024-09-10T08:00:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:00:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: mon.a calling monitor election 2024-09-10T08:00:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: mon.c calling monitor election 2024-09-10T08:00:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: monmap epoch 2 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: last_changed 2024-09-10T08:00:35.065447+0000 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: created 2024-09-10T07:59:01.813763+0000 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: min_mon_release 19 (squid) 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: election_strategy: 1 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: fsmap 2024-09-10T08:00:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T08:00:40.446 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: mgrmap e13: x(active, since 39s) 2024-09-10T08:00:40.446 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: overall HEALTH_OK 2024-09-10T08:00:40.446 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:40.446 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:40.446 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:40.446 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T08:00:40.446 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:40.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:40.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:00:40.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:40.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: mon.a calling monitor election 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: mon.c calling monitor election 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: monmap epoch 2 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: last_changed 2024-09-10T08:00:35.065447+0000 2024-09-10T08:00:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: created 2024-09-10T07:59:01.813763+0000 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: min_mon_release 19 (squid) 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: election_strategy: 1 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: fsmap 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: mgrmap e13: x(active, since 39s) 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: overall HEALTH_OK 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T08:00:40.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:40.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.594+0000 7f17e0f70640 1 -- 172.21.15.153:0/1823166881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f17dc19eab0 con 0x7f17c4005740 2024-09-10T08:00:40.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.594+0000 7f17cb7fe640 1 -- 172.21.15.153:0/1823166881 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f17cc041260 con 0x7f17c4005740 2024-09-10T08:00:40.594 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T08:00:40.594 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","modified":"2024-09-10T08:00:35.065447Z","created":"2024-09-10T07:59:01.813763Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T08:00:40.594 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 2 2024-09-10T08:00:40.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.596+0000 7f17e0f70640 1 -- 172.21.15.153:0/1823166881 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f17bc038df0 msgr2=0x7f17bc03b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:40.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.596+0000 7f17e0f70640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f17bc038df0 0x7f17bc03b2b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009100 tx=0x7f17d0008040 comp rx=0 tx=0).stop 2024-09-10T08:00:40.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.596+0000 7f17e0f70640 1 -- 172.21.15.153:0/1823166881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17c4005740 msgr2=0x7f17dc199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:40.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.596+0000 7f17e0f70640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17c4005740 0x7f17dc199430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f17cc012c10 tx=0x7f17cc0337c0 comp rx=0 tx=0).stop 2024-09-10T08:00:40.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.596+0000 7f17e0f70640 1 -- 172.21.15.153:0/1823166881 shutdown_connections 2024-09-10T08:00:40.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.596+0000 7f17e0f70640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f17bc038df0 0x7f17bc03b2b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:40.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.596+0000 7f17e0f70640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17dc199970 0x7f17dc19dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:40.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.596+0000 7f17e0f70640 1 --2- 172.21.15.153:0/1823166881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f17c4005740 0x7f17dc199430 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:40.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.596+0000 7f17e0f70640 1 -- 172.21.15.153:0/1823166881 >> 172.21.15.153:0/1823166881 conn(0x7f17dc0fc220 msgr2=0x7f17dc0fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:40.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.597+0000 7f17e0f70640 1 -- 172.21.15.153:0/1823166881 shutdown_connections 2024-09-10T08:00:40.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:40.597+0000 7f17e0f70640 1 -- 172.21.15.153:0/1823166881 wait complete. 2024-09-10T08:00:41.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:41 smithi153 ceph-mon[35609]: Deploying daemon mon.b on smithi100 2024-09-10T08:00:41.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:41 smithi153 ceph-mon[35609]: from='client.? 172.21.15.153:0/1823166881' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T08:00:41.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:41 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:41.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:41 smithi022 ceph-mon[30854]: Deploying daemon mon.b on smithi100 2024-09-10T08:00:41.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:41 smithi022 ceph-mon[30854]: from='client.? 172.21.15.153:0/1823166881' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T08:00:41.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:41 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:42.183 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T08:00:42.184 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T08:00:42.434 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:00:42.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:42 smithi153 ceph-mon[35609]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:42.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:42 smithi022 ceph-mon[30854]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:42.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.855+0000 7fdefaa48640 1 -- 172.21.15.153:0/1453282431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef4107660 msgr2=0x7fdef4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:42.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.855+0000 7fdefaa48640 1 --2- 172.21.15.153:0/1453282431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef4107660 0x7fdef4107a40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009880 tx=0x7fdee402a5d0 comp rx=0 tx=0).stop 2024-09-10T08:00:42.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.855+0000 7fdefaa48640 1 -- 172.21.15.153:0/1453282431 shutdown_connections 2024-09-10T08:00:42.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.855+0000 7fdefaa48640 1 --2- 172.21.15.153:0/1453282431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef4107660 0x7fdef4107a40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:42.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.855+0000 7fdefaa48640 1 -- 172.21.15.153:0/1453282431 >> 172.21.15.153:0/1453282431 conn(0x7fdef40fd320 msgr2=0x7fdef40ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:42.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.855+0000 7fdefaa48640 1 -- 172.21.15.153:0/1453282431 shutdown_connections 2024-09-10T08:00:42.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.855+0000 7fdefaa48640 1 -- 172.21.15.153:0/1453282431 wait complete. 2024-09-10T08:00:42.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.856+0000 7fdefaa48640 1 Processor -- start 2024-09-10T08:00:42.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.856+0000 7fdefaa48640 1 -- start start 2024-09-10T08:00:42.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.856+0000 7fdefaa48640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdef4107660 0x7fdef41973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:42.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.856+0000 7fdefaa48640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef4197900 0x7fdef419bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:42.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.856+0000 7fdefaa48640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdef410bd20 con 0x7fdef4197900 2024-09-10T08:00:42.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.856+0000 7fdefaa48640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdef410bba0 con 0x7fdef4107660 2024-09-10T08:00:42.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdef4107660 0x7fdef41973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:42.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef4197900 0x7fdef419bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:42.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdef4107660 0x7fdef41973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34814/0 (socket says 172.21.15.153:34814) 2024-09-10T08:00:42.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef3fff640 1 -- 172.21.15.153:0/3732561815 learned_addr learned my addr 172.21.15.153:0/3732561815 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-10T08:00:42.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef4197900 0x7fdef419bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.153:50084/0 (socket says 172.21.15.153:50084) 2024-09-10T08:00:42.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef3fff640 1 -- 172.21.15.153:0/3732561815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdef4107660 msgr2=0x7fdef41973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T08:00:42.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef3fff640 1 -- 172.21.15.153:0/3732561815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdef4107660 msgr2=0x7fdef41973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:00:42.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef3fff640 1 --2- 172.21.15.153:0/3732561815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdef4107660 0x7fdef41973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:00:42.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef3fff640 1 --2- 172.21.15.153:0/3732561815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdef4107660 0x7fdef41973c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:00:42.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef37fe640 1 -- 172.21.15.153:0/3732561815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdef4107660 msgr2=0x7fdef41973c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:00:42.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef37fe640 1 --2- 172.21.15.153:0/3732561815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdef4107660 0x7fdef41973c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:42.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef37fe640 1 -- 172.21.15.153:0/3732561815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef4197f20 con 0x7fdef4197900 2024-09-10T08:00:42.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef37fe640 1 --2- 172.21.15.153:0/3732561815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef4197900 0x7fdef419bc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00b3d0 tx=0x7fdedc00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:42.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef17fa640 1 -- 172.21.15.153:0/3732561815 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fdedc011630 con 0x7fdef4197900 2024-09-10T08:00:42.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdefaa48640 1 -- 172.21.15.153:0/3732561815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef419c1d0 con 0x7fdef4197900 2024-09-10T08:00:42.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef17fa640 1 -- 172.21.15.153:0/3732561815 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdedc011cb0 con 0x7fdef4197900 2024-09-10T08:00:42.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.857+0000 7fdef17fa640 1 -- 172.21.15.153:0/3732561815 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fdedc010df0 con 0x7fdef4197900 2024-09-10T08:00:42.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.858+0000 7fdefaa48640 1 -- 172.21.15.153:0/3732561815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef419c710 con 0x7fdef4197900 2024-09-10T08:00:42.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.859+0000 7fdefaa48640 1 -- 172.21.15.153:0/3732561815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef4102da0 con 0x7fdef4197900 2024-09-10T08:00:42.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.859+0000 7fdef17fa640 1 -- 172.21.15.153:0/3732561815 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fdedc018020 con 0x7fdef4197900 2024-09-10T08:00:42.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.859+0000 7fdef17fa640 1 --2- 172.21.15.153:0/3732561815 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdee0038e00 0x7fdee003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:42.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.859+0000 7fdef17fa640 1 -- 172.21.15.153:0/3732561815 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdedc04bc80 con 0x7fdef4197900 2024-09-10T08:00:42.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.859+0000 7fdef3fff640 1 --2- 172.21.15.153:0/3732561815 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdee0038e00 0x7fdee003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:42.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.860+0000 7fdef3fff640 1 --2- 172.21.15.153:0/3732561815 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdee0038e00 0x7fdee003b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdee40096c0 tx=0x7fdee4005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:42.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:42.864+0000 7fdef17fa640 1 -- 172.21.15.153:0/3732561815 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdedc052080 con 0x7fdef4197900 2024-09-10T08:00:43.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.091+0000 7fdefaa48640 1 -- 172.21.15.153:0/3732561815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fdef419ca20 con 0x7fdef4197900 2024-09-10T08:00:43.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.092+0000 7fdef17fa640 1 -- 172.21.15.153:0/3732561815 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fdedc01f020 con 0x7fdef4197900 2024-09-10T08:00:43.091 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T08:00:43.091 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","modified":"2024-09-10T08:00:35.065447Z","created":"2024-09-10T07:59:01.813763Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T08:00:43.092 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 2 2024-09-10T08:00:43.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.094+0000 7fdefaa48640 1 -- 172.21.15.153:0/3732561815 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdee0038e00 msgr2=0x7fdee003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:43.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.094+0000 7fdefaa48640 1 --2- 172.21.15.153:0/3732561815 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdee0038e00 0x7fdee003b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdee40096c0 tx=0x7fdee4005a40 comp rx=0 tx=0).stop 2024-09-10T08:00:43.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.094+0000 7fdefaa48640 1 -- 172.21.15.153:0/3732561815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef4197900 msgr2=0x7fdef419bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:43.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.094+0000 7fdefaa48640 1 --2- 172.21.15.153:0/3732561815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef4197900 0x7fdef419bc90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00b3d0 tx=0x7fdedc00b890 comp rx=0 tx=0).stop 2024-09-10T08:00:43.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.094+0000 7fdefaa48640 1 -- 172.21.15.153:0/3732561815 shutdown_connections 2024-09-10T08:00:43.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.094+0000 7fdefaa48640 1 --2- 172.21.15.153:0/3732561815 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdee0038e00 0x7fdee003b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:43.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.094+0000 7fdefaa48640 1 --2- 172.21.15.153:0/3732561815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef4197900 0x7fdef419bc90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:43.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.094+0000 7fdefaa48640 1 --2- 172.21.15.153:0/3732561815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdef4107660 0x7fdef41973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:43.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.094+0000 7fdefaa48640 1 -- 172.21.15.153:0/3732561815 >> 172.21.15.153:0/3732561815 conn(0x7fdef40fd320 msgr2=0x7fdef40fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:43.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.094+0000 7fdefaa48640 1 -- 172.21.15.153:0/3732561815 shutdown_connections 2024-09-10T08:00:43.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:43.094+0000 7fdefaa48640 1 -- 172.21.15.153:0/3732561815 wait complete. 2024-09-10T08:00:43.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:43 smithi153 ceph-mon[35609]: from='client.? 172.21.15.153:0/3732561815' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T08:00:43.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:43 smithi022 ceph-mon[30854]: from='client.? 172.21.15.153:0/3732561815' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T08:00:44.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:43 smithi100 systemd[1]: Started Ceph mon.b for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:00:44.700 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T08:00:44.701 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T08:00:44.955 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:00:48.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.972+0000 7fa486de2640 1 -- 172.21.15.153:0/671295736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa470003530 msgr2=0x7fa4700059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:48.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.972+0000 7fa486de2640 1 --2- 172.21.15.153:0/671295736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa470003530 0x7fa4700059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa4801016c0 tx=0x7fa47402c3f0 comp rx=0 tx=0).stop 2024-09-10T08:00:48.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.973+0000 7fa486de2640 1 -- 172.21.15.153:0/671295736 shutdown_connections 2024-09-10T08:00:48.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.973+0000 7fa486de2640 1 --2- 172.21.15.153:0/671295736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa470003530 0x7fa4700059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:48.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.973+0000 7fa486de2640 1 -- 172.21.15.153:0/671295736 >> 172.21.15.153:0/671295736 conn(0x7fa4800fc280 msgr2=0x7fa4800fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:48.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.973+0000 7fa486de2640 1 -- 172.21.15.153:0/671295736 shutdown_connections 2024-09-10T08:00:48.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.973+0000 7fa486de2640 1 -- 172.21.15.153:0/671295736 wait complete. 2024-09-10T08:00:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa486de2640 1 Processor -- start 2024-09-10T08:00:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa486de2640 1 -- start start 2024-09-10T08:00:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa486de2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa470003530 0x7fa4801981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa486de2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4801986e0 0x7fa480198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa486de2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4801a1210 0x7fa4801a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa486de2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa480108690 con 0x7fa4801a1210 2024-09-10T08:00:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa486de2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa480108510 con 0x7fa470003530 2024-09-10T08:00:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa486de2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa480108810 con 0x7fa4801986e0 2024-09-10T08:00:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa47ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4801986e0 0x7fa480198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa47ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4801986e0 0x7fa480198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49468/0 (socket says 172.21.15.153:49468) 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa47ffff640 1 -- 172.21.15.153:0/2288278642 learned_addr learned my addr 172.21.15.153:0/2288278642 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa484b7e640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa470003530 0x7fa4801981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.974+0000 7fa48537f640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4801a1210 0x7fa4801a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa47ffff640 1 -- 172.21.15.153:0/2288278642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4801986e0 msgr2=0x7fa480198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa47ffff640 1 -- 172.21.15.153:0/2288278642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4801986e0 msgr2=0x7fa480198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa47ffff640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4801986e0 0x7fa480198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa484b7e640 1 -- 172.21.15.153:0/2288278642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa470003530 msgr2=0x7fa4801981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa484b7e640 1 -- 172.21.15.153:0/2288278642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa470003530 msgr2=0x7fa4801981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa484b7e640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa470003530 0x7fa4801981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa484b7e640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa470003530 0x7fa4801981a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa47ffff640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4801986e0 0x7fa480198b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa48537f640 1 -- 172.21.15.153:0/2288278642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4801986e0 msgr2=0x7fa480198b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:00:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa48537f640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4801986e0 0x7fa480198b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa48537f640 1 -- 172.21.15.153:0/2288278642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa470003530 msgr2=0x7fa4801981a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:00:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa48537f640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa470003530 0x7fa4801981a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa48537f640 1 -- 172.21.15.153:0/2288278642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4801a3da0 con 0x7fa4801a1210 2024-09-10T08:00:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa48537f640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4801a1210 0x7fa4801a3600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa47800bd50 tx=0x7fa47800be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa47dffb640 1 -- 172.21.15.153:0/2288278642 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478019070 con 0x7fa4801a1210 2024-09-10T08:00:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa47dffb640 1 -- 172.21.15.153:0/2288278642 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa478014920 con 0x7fa4801a1210 2024-09-10T08:00:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa47dffb640 1 -- 172.21.15.153:0/2288278642 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478012990 con 0x7fa4801a1210 2024-09-10T08:00:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.975+0000 7fa486de2640 1 -- 172.21.15.153:0/2288278642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4801a4090 con 0x7fa4801a1210 2024-09-10T08:00:48.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.976+0000 7fa486de2640 1 -- 172.21.15.153:0/2288278642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4801a45d0 con 0x7fa4801a1210 2024-09-10T08:00:48.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.977+0000 7fa47dffb640 1 -- 172.21.15.153:0/2288278642 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7fa47801c070 con 0x7fa4801a1210 2024-09-10T08:00:48.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.977+0000 7fa47dffb640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa4640394f0 0x7fa46403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:48.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.977+0000 7fa47dffb640 1 -- 172.21.15.153:0/2288278642 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa47804bd80 con 0x7fa4801a1210 2024-09-10T08:00:48.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.977+0000 7fa484b7e640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa4640394f0 0x7fa46403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:48.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.977+0000 7fa486de2640 1 -- 172.21.15.153:0/2288278642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4801097c0 con 0x7fa4801a1210 2024-09-10T08:00:48.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.978+0000 7fa484b7e640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa4640394f0 0x7fa46403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa474014cc0 tx=0x7fa474005f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:48.982+0000 7fa47dffb640 1 -- 172.21.15.153:0/2288278642 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa478011df0 con 0x7fa4801a1210 2024-09-10T08:00:49.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:00:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: mon.a calling monitor election 2024-09-10T08:00:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: mon.c calling monitor election 2024-09-10T08:00:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: mon.b calling monitor election 2024-09-10T08:00:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: monmap epoch 3 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: last_changed 2024-09-10T08:00:43.843635+0000 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: created 2024-09-10T07:59:01.813763+0000 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: min_mon_release 19 (squid) 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: election_strategy: 1 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: fsmap 2024-09-10T08:00:49.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T08:00:49.196 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: mgrmap e13: x(active, since 47s) 2024-09-10T08:00:49.196 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: overall HEALTH_OK 2024-09-10T08:00:49.196 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:49.196 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:49.196 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:49.196 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:49.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.226+0000 7fa486de2640 1 -- 172.21.15.153:0/2288278642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa4801a4890 con 0x7fa4801a1210 2024-09-10T08:00:49.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.226+0000 7fa47dffb640 1 -- 172.21.15.153:0/2288278642 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7fa47801d8d0 con 0x7fa4801a1210 2024-09-10T08:00:49.226 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T08:00:49.226 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":3,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","modified":"2024-09-10T08:00:43.843635Z","created":"2024-09-10T07:59:01.813763Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T08:00:49.226 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 3 2024-09-10T08:00:49.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.229+0000 7fa486de2640 1 -- 172.21.15.153:0/2288278642 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa4640394f0 msgr2=0x7fa46403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:49.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.229+0000 7fa486de2640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa4640394f0 0x7fa46403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa474014cc0 tx=0x7fa474005f60 comp rx=0 tx=0).stop 2024-09-10T08:00:49.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.229+0000 7fa486de2640 1 -- 172.21.15.153:0/2288278642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4801a1210 msgr2=0x7fa4801a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:49.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.229+0000 7fa486de2640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4801a1210 0x7fa4801a3600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa47800bd50 tx=0x7fa47800be40 comp rx=0 tx=0).stop 2024-09-10T08:00:49.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.229+0000 7fa486de2640 1 -- 172.21.15.153:0/2288278642 shutdown_connections 2024-09-10T08:00:49.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.229+0000 7fa486de2640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa4640394f0 0x7fa46403b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:49.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.229+0000 7fa486de2640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa4801a1210 0x7fa4801a3600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:49.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.229+0000 7fa486de2640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4801986e0 0x7fa480198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:49.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.229+0000 7fa486de2640 1 --2- 172.21.15.153:0/2288278642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa470003530 0x7fa4801981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:49.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.229+0000 7fa486de2640 1 -- 172.21.15.153:0/2288278642 >> 172.21.15.153:0/2288278642 conn(0x7fa4800fc280 msgr2=0x7fa4800fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:49.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.229+0000 7fa486de2640 1 -- 172.21.15.153:0/2288278642 shutdown_connections 2024-09-10T08:00:49.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:49.229+0000 7fa486de2640 1 -- 172.21.15.153:0/2288278642 wait complete. 2024-09-10T08:00:49.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:00:49.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: mon.a calling monitor election 2024-09-10T08:00:49.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: mon.c calling monitor election 2024-09-10T08:00:49.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:49.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: mon.b calling monitor election 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: monmap epoch 3 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: last_changed 2024-09-10T08:00:43.843635+0000 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: created 2024-09-10T07:59:01.813763+0000 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: min_mon_release 19 (squid) 2024-09-10T08:00:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: election_strategy: 1 2024-09-10T08:00:49.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-10T08:00:49.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-09-10T08:00:49.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-10T08:00:49.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: fsmap 2024-09-10T08:00:49.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T08:00:49.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: mgrmap e13: x(active, since 47s) 2024-09-10T08:00:49.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: overall HEALTH_OK 2024-09-10T08:00:49.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:49.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:49.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:49.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:49.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:00:49.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: mon.a calling monitor election 2024-09-10T08:00:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: mon.c calling monitor election 2024-09-10T08:00:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:00:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: mon.b calling monitor election 2024-09-10T08:00:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: monmap epoch 3 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: last_changed 2024-09-10T08:00:43.843635+0000 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: created 2024-09-10T07:59:01.813763+0000 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: min_mon_release 19 (squid) 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: election_strategy: 1 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: fsmap 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: mgrmap e13: x(active, since 47s) 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: overall HEALTH_OK 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:49.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:49.371 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:49.371 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:49.887 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T08:00:49.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T08:00:50.152 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:00:50.179 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:49 smithi153 ceph-mon[35609]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:50.179 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:49 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:00:50.179 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:49 smithi153 ceph-mon[35609]: from='client.? 172.21.15.153:0/2288278642' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T08:00:50.179 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:49 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:50.246 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:49 smithi022 ceph-mon[30854]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:50.246 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:49 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:00:50.246 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:49 smithi022 ceph-mon[30854]: from='client.? 172.21.15.153:0/2288278642' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T08:00:50.247 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:49 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:50.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:49 smithi100 ceph-mon[35102]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:50.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:49 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:00:50.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:49 smithi100 ceph-mon[35102]: from='client.? 172.21.15.153:0/2288278642' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-10T08:00:50.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:49 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:00:50.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.576+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3336802032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4106560 msgr2=0x7f13e4106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.576+0000 7f13ea9ba640 1 --2- 172.21.15.22:0/3336802032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4106560 0x7f13e4106940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009880 tx=0x7f13d402a5d0 comp rx=0 tx=0).stop 2024-09-10T08:00:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.576+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3336802032 shutdown_connections 2024-09-10T08:00:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.576+0000 7f13ea9ba640 1 --2- 172.21.15.22:0/3336802032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4106560 0x7f13e4106940 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.576+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3336802032 >> 172.21.15.22:0/3336802032 conn(0x7f13e40fc1b0 msgr2=0x7f13e40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.576+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3336802032 shutdown_connections 2024-09-10T08:00:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.576+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3336802032 wait complete. 2024-09-10T08:00:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.576+0000 7f13ea9ba640 1 Processor -- start 2024-09-10T08:00:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.576+0000 7f13ea9ba640 1 -- start start 2024-09-10T08:00:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13ea9ba640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13e4106560 0x7f13e41981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13ea9ba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4198710 0x7f13e4198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13ea9ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13e41a1240 0x7f13e41a3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13ea9ba640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f13e410ab40 con 0x7f13e4198710 2024-09-10T08:00:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13ea9ba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13e410a9c0 con 0x7f13e41a1240 2024-09-10T08:00:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13ea9ba640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13e410acc0 con 0x7f13e4106560 2024-09-10T08:00:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13dbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4198710 0x7f13e4198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13dbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4198710 0x7f13e4198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60814/0 (socket says 172.21.15.22:60814) 2024-09-10T08:00:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13dbfff640 1 -- 172.21.15.22:0/3826066318 learned_addr learned my addr 172.21.15.22:0/3826066318 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13e3fff640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13e4106560 0x7f13e41981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13dbfff640 1 -- 172.21.15.22:0/3826066318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13e4106560 msgr2=0x7f13e41981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13dbfff640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13e4106560 0x7f13e41981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13dbfff640 1 -- 172.21.15.22:0/3826066318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13e41a1240 msgr2=0x7f13e41a3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:50.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13dbfff640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13e41a1240 0x7f13e41a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13dbfff640 1 -- 172.21.15.22:0/3826066318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e41a3dd0 con 0x7f13e4198710 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13dbfff640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4198710 0x7f13e4198b70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00b520 tx=0x7f13cc00b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13e1ffb640 1 -- 172.21.15.22:0/3826066318 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc004230 con 0x7f13e4198710 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13e1ffb640 1 -- 172.21.15.22:0/3826066318 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13cc0043d0 con 0x7f13e4198710 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.577+0000 7f13e1ffb640 1 -- 172.21.15.22:0/3826066318 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13cc003d60 con 0x7f13e4198710 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.578+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3826066318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e41a40c0 con 0x7f13e4198710 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.578+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3826066318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e41a45b0 con 0x7f13e4198710 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.578+0000 7f13e1ffb640 1 -- 172.21.15.22:0/3826066318 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f13cc00e070 con 0x7f13e4198710 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.579+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3826066318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e41069c0 con 0x7f13e4198710 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.579+0000 7f13e1ffb640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f13d00394f0 0x7f13d003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.579+0000 7f13e1ffb640 1 -- 172.21.15.22:0/3826066318 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f13cc04b930 con 0x7f13e4198710 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.579+0000 7f13e3fff640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f13d00394f0 0x7f13d003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.579+0000 7f13e3fff640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f13d00394f0 0x7f13d003b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f13d40096c0 tx=0x7f13d4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:50.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.583+0000 7f13e1ffb640 1 -- 172.21.15.22:0/3826066318 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13cc014020 con 0x7f13e4198710 2024-09-10T08:00:50.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.762+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3826066318 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f13e41a4a40 con 0x7f13e4198710 2024-09-10T08:00:50.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.763+0000 7f13e1ffb640 1 -- 172.21.15.22:0/3826066318 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f13cc010d70 con 0x7f13e4198710 2024-09-10T08:00:50.762 INFO:teuthology.orchestra.run.smithi022.stdout:# minimal ceph.conf for 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:00:50.762 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2024-09-10T08:00:50.762 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:00:50.762 INFO:teuthology.orchestra.run.smithi022.stdout: mon_host = [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-10T08:00:50.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.765+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3826066318 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f13d00394f0 msgr2=0x7f13d003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:50.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.765+0000 7f13ea9ba640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f13d00394f0 0x7f13d003b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f13d40096c0 tx=0x7f13d4005a20 comp rx=0 tx=0).stop 2024-09-10T08:00:50.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.765+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3826066318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4198710 msgr2=0x7f13e4198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:50.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.765+0000 7f13ea9ba640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4198710 0x7f13e4198b70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00b520 tx=0x7f13cc00b9e0 comp rx=0 tx=0).stop 2024-09-10T08:00:50.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.765+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3826066318 shutdown_connections 2024-09-10T08:00:50.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.765+0000 7f13ea9ba640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f13d00394f0 0x7f13d003b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:50.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.765+0000 7f13ea9ba640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13e41a1240 0x7f13e41a3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:50.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.765+0000 7f13ea9ba640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13e4198710 0x7f13e4198b70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:50.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.765+0000 7f13ea9ba640 1 --2- 172.21.15.22:0/3826066318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13e4106560 0x7f13e41981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:50.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.765+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3826066318 >> 172.21.15.22:0/3826066318 conn(0x7f13e40fc1b0 msgr2=0x7f13e40fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:50.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.766+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3826066318 shutdown_connections 2024-09-10T08:00:50.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:50.766+0000 7f13ea9ba640 1 -- 172.21.15.22:0/3826066318 wait complete. 2024-09-10T08:00:51.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:51.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:00:51.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:51 smithi100 ceph-mon[35102]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-10T08:00:51.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:51 smithi100 ceph-mon[35102]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-10T08:00:51.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:51 smithi100 ceph-mon[35102]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-10T08:00:51.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:51 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3826066318' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:51.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.413 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:51.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:00:51.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:51 smithi022 ceph-mon[30854]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-10T08:00:51.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:51 smithi022 ceph-mon[30854]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-10T08:00:51.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:51 smithi022 ceph-mon[30854]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-10T08:00:51.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:51 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3826066318' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:51.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:00:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:51 smithi153 ceph-mon[35609]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-10T08:00:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:51 smithi153 ceph-mon[35609]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-10T08:00:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:51 smithi153 ceph-mon[35609]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-10T08:00:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:51 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3826066318' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:51.445 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T08:00:51.445 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T08:00:51.446 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T08:00:51.474 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T08:00:51.475 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:00:51.544 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T08:00:51.544 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T08:00:51.572 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T08:00:51.572 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:00:51.638 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-10T08:00:51.638 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T08:00:51.666 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-10T08:00:51.666 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:00:51.731 INFO:tasks.cephadm:Adding mgr.x on smithi022 2024-09-10T08:00:51.731 INFO:tasks.cephadm:Adding mgr.y on smithi100 2024-09-10T08:00:51.731 INFO:tasks.cephadm:Adding mgr.z on smithi153 2024-09-10T08:00:51.731 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi022=x;smithi100=y;smithi153=z' 2024-09-10T08:00:52.005 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:00:52.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:52.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: Updating smithi153:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:52.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: Updating smithi100:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:52.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: Updating smithi022:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:52.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:52.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:52 smithi022 ceph-mon[30854]: Reconfiguring daemon mon.a on smithi022 2024-09-10T08:00:52.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:52.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: Updating smithi153:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:52.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: Updating smithi100:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:52.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: Updating smithi022:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:52.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.392 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:52.393 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:52 smithi153 ceph-mon[35609]: Reconfiguring daemon mon.a on smithi022 2024-09-10T08:00:52.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 -- 172.21.15.153:0/2135072760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08581016e0 msgr2=0x7f0858101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:52.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 --2- 172.21.15.153:0/2135072760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08581016e0 0x7f0858101ae0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0848009880 tx=0x7f084802a5d0 comp rx=0 tx=0).stop 2024-09-10T08:00:52.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 -- 172.21.15.153:0/2135072760 shutdown_connections 2024-09-10T08:00:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 --2- 172.21.15.153:0/2135072760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08581016e0 0x7f0858101ae0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 -- 172.21.15.153:0/2135072760 >> 172.21.15.153:0/2135072760 conn(0x7f08580fce90 msgr2=0x7f08580ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 -- 172.21.15.153:0/2135072760 shutdown_connections 2024-09-10T08:00:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 -- 172.21.15.153:0/2135072760 wait complete. 2024-09-10T08:00:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 Processor -- start 2024-09-10T08:00:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 -- start start 2024-09-10T08:00:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08581016e0 0x7f0858196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0858197510 0x7f085819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0858197990 0x7f085819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f08581077d0 con 0x7f0858197990 2024-09-10T08:00:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0858107650 con 0x7f08581016e0 2024-09-10T08:00:52.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.400+0000 7f085e946640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0858107950 con 0x7f0858197510 2024-09-10T08:00:52.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f085cee3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0858197990 0x7f085819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:52.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f085cee3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0858197990 0x7f085819eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.153:36918/0 (socket says 172.21.15.153:36918) 2024-09-10T08:00:52.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f085cee3640 1 -- 172.21.15.153:0/469071003 learned_addr learned my addr 172.21.15.153:0/469071003 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-10T08:00:52.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f084ffff640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0858197510 0x7f085819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:52.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f0857fff640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08581016e0 0x7f0858196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:52.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f085cee3640 1 -- 172.21.15.153:0/469071003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0858197510 msgr2=0x7f085819c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f085cee3640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0858197510 0x7f085819c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f085cee3640 1 -- 172.21.15.153:0/469071003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08581016e0 msgr2=0x7f0858196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f085cee3640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08581016e0 0x7f0858196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f085cee3640 1 -- 172.21.15.153:0/469071003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085819f3d0 con 0x7f0858197990 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f085cee3640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0858197990 0x7f085819eb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f085000ba50 tx=0x7f085000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f0855ffb640 1 -- 172.21.15.153:0/469071003 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0850019070 con 0x7f0858197990 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f085e946640 1 -- 172.21.15.153:0/469071003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085819f6c0 con 0x7f0858197990 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f0855ffb640 1 -- 172.21.15.153:0/469071003 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f085000cbe0 con 0x7f0858197990 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f0855ffb640 1 -- 172.21.15.153:0/469071003 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08500076a0 con 0x7f0858197990 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.401+0000 7f085e946640 1 -- 172.21.15.153:0/469071003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085819fc30 con 0x7f0858197990 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.402+0000 7f0855ffb640 1 -- 172.21.15.153:0/469071003 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f085001c070 con 0x7f0858197990 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.403+0000 7f085e946640 1 -- 172.21.15.153:0/469071003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0858190590 con 0x7f0858197990 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.403+0000 7f0855ffb640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f08440394f0 0x7f084403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:52.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.403+0000 7f0855ffb640 1 -- 172.21.15.153:0/469071003 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f085004bb10 con 0x7f0858197990 2024-09-10T08:00:52.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.403+0000 7f0857fff640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f08440394f0 0x7f084403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:52.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.403+0000 7f0857fff640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f08440394f0 0x7f084403b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0848000c00 tx=0x7f0848031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:52.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.408+0000 7f0855ffb640 1 -- 172.21.15.153:0/469071003 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08500133a0 con 0x7f0858197990 2024-09-10T08:00:52.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.587+0000 7f085e946640 1 -- 172.21.15.153:0/469071003 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi100=y;smithi153=z", "target": ["mon-mgr", ""]}) -- 0x7f08580626c0 con 0x7f08440394f0 2024-09-10T08:00:52.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.593+0000 7f0855ffb640 1 -- 172.21.15.153:0/469071003 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f08580626c0 con 0x7f08440394f0 2024-09-10T08:00:52.593 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mgr update... 2024-09-10T08:00:52.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.595+0000 7f085e946640 1 -- 172.21.15.153:0/469071003 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f08440394f0 msgr2=0x7f084403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:52.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.595+0000 7f085e946640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f08440394f0 0x7f084403b9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0848000c00 tx=0x7f0848031400 comp rx=0 tx=0).stop 2024-09-10T08:00:52.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.595+0000 7f085e946640 1 -- 172.21.15.153:0/469071003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0858197990 msgr2=0x7f085819eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:52.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.595+0000 7f085e946640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0858197990 0x7f085819eb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f085000ba50 tx=0x7f085000bf10 comp rx=0 tx=0).stop 2024-09-10T08:00:52.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.595+0000 7f085e946640 1 -- 172.21.15.153:0/469071003 shutdown_connections 2024-09-10T08:00:52.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.595+0000 7f085e946640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f08440394f0 0x7f084403b9b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:52.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.595+0000 7f085e946640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0858197990 0x7f085819eb10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:52.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.595+0000 7f085e946640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0858197510 0x7f085819c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:52.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.595+0000 7f085e946640 1 --2- 172.21.15.153:0/469071003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08581016e0 0x7f0858196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:52.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.596+0000 7f085e946640 1 -- 172.21.15.153:0/469071003 >> 172.21.15.153:0/469071003 conn(0x7f08580fce90 msgr2=0x7f08580fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:52.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.596+0000 7f085e946640 1 -- 172.21.15.153:0/469071003 shutdown_connections 2024-09-10T08:00:52.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:00:52.596+0000 7f085e946640 1 -- 172.21.15.153:0/469071003 wait complete. 2024-09-10T08:00:52.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:52.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: Updating smithi153:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:52.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: Updating smithi100:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:52.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: Updating smithi022:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:00:52.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:52.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T08:00:52.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T08:00:52.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T08:00:52.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:52.611 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:52 smithi100 ceph-mon[35102]: Reconfiguring daemon mon.a on smithi022 2024-09-10T08:00:53.076 DEBUG:teuthology.orchestra.run.smithi100:mgr.y> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T08:00:53.078 DEBUG:teuthology.orchestra.run.smithi153:mgr.z> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T08:00:53.081 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T08:00:53.081 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T08:00:53.081 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T08:00:53.099 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T08:00:53.099 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2024-09-10T08:00:53.155 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T08:00:53.155 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:00:53.156 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-10T08:00:53.156 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:00:53.156 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:00:53.156 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-10 08:00:09.843774207 +0000 2024-09-10T08:00:53.156 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-10 07:55:55.935940174 +0000 2024-09-10T08:00:53.156 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-10 07:55:55.935940174 +0000 2024-09-10T08:00:53.156 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-10 07:55:55.935940174 +0000 2024-09-10T08:00:53.156 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T08:00:53.224 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-10T08:00:53.224 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-10T08:00:53.224 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 9.2501e-05 s, 5.5 MB/s 2024-09-10T08:00:53.225 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T08:00:53.282 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2024-09-10T08:00:53.338 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T08:00:53.338 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:00:53.338 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T08:00:53.338 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:00:53.338 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:00:53.338 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-10 08:00:09.875773760 +0000 2024-09-10T08:00:53.338 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-10 07:55:56.265935527 +0000 2024-09-10T08:00:53.339 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-10 07:55:56.265935527 +0000 2024-09-10T08:00:53.339 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-10 07:55:56.265935527 +0000 2024-09-10T08:00:53.339 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T08:00:53.403 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-10T08:00:53.403 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-10T08:00:53.403 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000105158 s, 4.9 MB/s 2024-09-10T08:00:53.404 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T08:00:53.461 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2024-09-10T08:00:53.517 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T08:00:53.517 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:00:53.517 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T08:00:53.517 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:00:53.517 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:00:53.517 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-10 08:00:09.911773258 +0000 2024-09-10T08:00:53.517 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-10 07:55:56.582931063 +0000 2024-09-10T08:00:53.517 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-10 07:55:56.582931063 +0000 2024-09-10T08:00:53.517 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-10 07:55:56.582931063 +0000 2024-09-10T08:00:53.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T08:00:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-10T08:00:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-10T08:00:53.581 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000107358 s, 4.8 MB/s 2024-09-10T08:00:53.583 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T08:00:53.639 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2024-09-10T08:00:53.696 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T08:00:53.696 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:00:53.696 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-10T08:00:53.696 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:00:53.697 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:00:53.697 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-10 08:00:09.945772783 +0000 2024-09-10T08:00:53.697 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-10 07:55:56.910926444 +0000 2024-09-10T08:00:53.697 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-10 07:55:56.910926444 +0000 2024-09-10T08:00:53.697 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-10 07:55:56.910926444 +0000 2024-09-10T08:00:53.697 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T08:00:53.762 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-10T08:00:53.762 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-10T08:00:53.762 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 9.3553e-05 s, 5.5 MB/s 2024-09-10T08:00:53.763 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T08:00:53.820 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-10T08:00:53.820 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T08:00:53.838 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T08:00:53.838 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-09-10T08:00:53.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:53 smithi100 ceph-mon[35102]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi100=y;smithi153=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:00:53.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:53 smithi100 ceph-mon[35102]: Saving service mgr spec with placement smithi022=x;smithi100=y;smithi153=z;count:3 2024-09-10T08:00:53.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:53 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:53.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:53 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:53.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:53 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:53.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:53 smithi100 ceph-mon[35102]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T08:00:53.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:53 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T08:00:53.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:53 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T08:00:53.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:53 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:53.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:53 smithi100 ceph-mon[35102]: Reconfiguring daemon mgr.x on smithi022 2024-09-10T08:00:53.885 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T08:00:53.885 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:00:53.886 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T08:00:53.886 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:00:53.886 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:00:53.886 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-10 08:00:43.292237410 +0000 2024-09-10T08:00:53.886 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-10 07:56:06.165670561 +0000 2024-09-10T08:00:53.886 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-10 07:56:06.165670561 +0000 2024-09-10T08:00:53.886 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-10 07:56:06.165670561 +0000 2024-09-10T08:00:53.886 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T08:00:53.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:53 smithi022 ceph-mon[30854]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi100=y;smithi153=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:00:53.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:53 smithi022 ceph-mon[30854]: Saving service mgr spec with placement smithi022=x;smithi100=y;smithi153=z;count:3 2024-09-10T08:00:53.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:53 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:53.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:53 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:53.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:53 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:53.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:53 smithi022 ceph-mon[30854]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T08:00:53.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:53 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T08:00:53.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:53 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T08:00:53.937 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:53 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:53.937 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:53 smithi022 ceph-mon[30854]: Reconfiguring daemon mgr.x on smithi022 2024-09-10T08:00:53.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:53 smithi153 ceph-mon[35609]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi100=y;smithi153=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:00:53.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:53 smithi153 ceph-mon[35609]: Saving service mgr spec with placement smithi022=x;smithi100=y;smithi153=z;count:3 2024-09-10T08:00:53.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:53 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:53.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:53 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:53.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:53 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:53.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:53 smithi153 ceph-mon[35609]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T08:00:53.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:53 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T08:00:53.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:53 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T08:00:53.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:53 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:53.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:53 smithi153 ceph-mon[35609]: Reconfiguring daemon mgr.x on smithi022 2024-09-10T08:00:53.952 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-10T08:00:53.952 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-10T08:00:53.953 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000279314 s, 1.8 MB/s 2024-09-10T08:00:53.954 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T08:00:54.011 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-09-10T08:00:54.066 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T08:00:54.066 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:00:54.066 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T08:00:54.067 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:00:54.067 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:00:54.067 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-10 08:00:43.292237410 +0000 2024-09-10T08:00:54.067 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-10 07:56:06.487661824 +0000 2024-09-10T08:00:54.067 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-10 07:56:06.487661824 +0000 2024-09-10T08:00:54.067 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-10 07:56:06.487661824 +0000 2024-09-10T08:00:54.067 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T08:00:54.130 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-10T08:00:54.130 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-10T08:00:54.130 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.00022234 s, 2.3 MB/s 2024-09-10T08:00:54.132 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T08:00:54.188 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-09-10T08:00:54.243 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T08:00:54.243 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:00:54.243 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-10T08:00:54.243 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:00:54.244 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:00:54.244 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-10 08:00:43.293237383 +0000 2024-09-10T08:00:54.244 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-10 07:56:06.807653142 +0000 2024-09-10T08:00:54.244 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-10 07:56:06.807653142 +0000 2024-09-10T08:00:54.244 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-10 07:56:06.807653142 +0000 2024-09-10T08:00:54.244 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T08:00:54.308 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-10T08:00:54.309 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-10T08:00:54.309 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000201466 s, 2.5 MB/s 2024-09-10T08:00:54.310 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T08:00:54.367 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-09-10T08:00:54.423 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T08:00:54.424 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:00:54.424 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T08:00:54.424 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:00:54.424 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:00:54.424 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-10 08:00:43.293237383 +0000 2024-09-10T08:00:54.425 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-10 07:56:07.119644677 +0000 2024-09-10T08:00:54.425 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-10 07:56:07.119644677 +0000 2024-09-10T08:00:54.425 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-10 07:56:07.119644677 +0000 2024-09-10T08:00:54.425 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T08:00:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-10T08:00:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-10T08:00:54.487 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000282235 s, 1.8 MB/s 2024-09-10T08:00:54.489 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T08:00:54.547 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-10T08:00:54.548 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T08:00:54.568 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T08:00:54.568 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-09-10T08:00:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T08:00:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:00:54.626 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-10T08:00:54.626 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:00:54.626 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:00:54.626 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-10 08:00:34.504773665 +0000 2024-09-10T08:00:54.626 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-10 07:56:05.570647214 +0000 2024-09-10T08:00:54.626 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-10 07:56:05.570647214 +0000 2024-09-10T08:00:54.626 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-10 07:56:05.570647214 +0000 2024-09-10T08:00:54.626 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T08:00:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-10T08:00:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-10T08:00:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000283371 s, 1.8 MB/s 2024-09-10T08:00:54.695 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T08:00:54.753 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-09-10T08:00:54.811 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T08:00:54.811 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:00:54.811 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T08:00:54.811 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:00:54.811 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:00:54.811 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-10 08:00:34.505773647 +0000 2024-09-10T08:00:54.811 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-10 07:56:05.891641822 +0000 2024-09-10T08:00:54.811 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-10 07:56:05.891641822 +0000 2024-09-10T08:00:54.811 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-10 07:56:05.891641822 +0000 2024-09-10T08:00:54.812 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T08:00:54.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:54 smithi100 ceph-mon[35102]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:54.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:54 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:54.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:54 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:54.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:54 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T08:00:54.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:54 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T08:00:54.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:54 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:54.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-10T08:00:54.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-10T08:00:54.876 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000285002 s, 1.8 MB/s 2024-09-10T08:00:54.877 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T08:00:54.936 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-09-10T08:00:54.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:54 smithi153 ceph-mon[35609]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:54.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:54 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:54.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:54 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:54.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:54 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T08:00:54.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:54 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T08:00:54.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:54 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T08:00:54.959 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:00:54.960 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-10T08:00:54.960 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:00:54.960 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:00:54.960 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-10 08:00:34.505773647 +0000 2024-09-10T08:00:54.960 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-10 07:56:06.209636481 +0000 2024-09-10T08:00:54.960 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-10 07:56:06.209636481 +0000 2024-09-10T08:00:54.960 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-10 07:56:06.209636481 +0000 2024-09-10T08:00:54.960 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T08:00:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:54 smithi022 ceph-mon[30854]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:54 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:54 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:54 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T08:00:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:54 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T08:00:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:54 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:55.025 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-10T08:00:55.025 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-10T08:00:55.025 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000221253 s, 2.3 MB/s 2024-09-10T08:00:55.026 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T08:00:55.082 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-09-10T08:00:55.139 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T08:00:55.139 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:00:55.139 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-10T08:00:55.139 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:00:55.139 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:00:55.139 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-10 08:00:34.505773647 +0000 2024-09-10T08:00:55.139 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-10 07:56:06.533631039 +0000 2024-09-10T08:00:55.139 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-10 07:56:06.533631039 +0000 2024-09-10T08:00:55.139 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-10 07:56:06.533631039 +0000 2024-09-10T08:00:55.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T08:00:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-10T08:00:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-10T08:00:55.202 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000192162 s, 2.7 MB/s 2024-09-10T08:00:55.204 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T08:00:55.260 INFO:tasks.cephadm:Deploying osd.0 on smithi022 with /dev/vg_nvme/lv_4... 2024-09-10T08:00:55.260 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T08:00:55.521 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:00:55.932 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:55 smithi153 ceph-mon[35609]: Reconfiguring mon.b (monmap changed)... 2024-09-10T08:00:55.932 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:55 smithi153 ceph-mon[35609]: Reconfiguring daemon mon.b on smithi100 2024-09-10T08:00:55.932 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:55.932 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:55.932 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T08:00:55.932 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T08:00:55.932 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:55.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:55 smithi022 ceph-mon[30854]: Reconfiguring mon.b (monmap changed)... 2024-09-10T08:00:55.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:55 smithi022 ceph-mon[30854]: Reconfiguring daemon mon.b on smithi100 2024-09-10T08:00:55.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:55.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:55.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T08:00:55.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T08:00:55.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:56.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:55 smithi100 ceph-mon[35102]: Reconfiguring mon.b (monmap changed)... 2024-09-10T08:00:56.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:55 smithi100 ceph-mon[35102]: Reconfiguring daemon mon.b on smithi100 2024-09-10T08:00:56.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:56.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:56.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-10T08:00:56.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-10T08:00:56.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:56 smithi022 ceph-mon[30854]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:56 smithi022 ceph-mon[30854]: Reconfiguring mon.c (monmap changed)... 2024-09-10T08:00:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:56 smithi022 ceph-mon[30854]: Reconfiguring daemon mon.c on smithi153 2024-09-10T08:00:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:56 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:56.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:56 smithi153 ceph-mon[35609]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:56.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:56 smithi153 ceph-mon[35609]: Reconfiguring mon.c (monmap changed)... 2024-09-10T08:00:56.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:56 smithi153 ceph-mon[35609]: Reconfiguring daemon mon.c on smithi153 2024-09-10T08:00:56.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:56 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:57.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:56 smithi100 ceph-mon[35102]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:57.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:56 smithi100 ceph-mon[35102]: Reconfiguring mon.c (monmap changed)... 2024-09-10T08:00:57.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:56 smithi100 ceph-mon[35102]: Reconfiguring daemon mon.c on smithi153 2024-09-10T08:00:57.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:56 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:57.844 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:00:57.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_4 2024-09-10T08:00:57.896 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:57 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:57.896 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:57 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:00:57.896 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:57 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:57.896 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:57 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:00:57.896 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:57 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:57.896 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:57 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T08:00:57.896 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:57 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T08:00:57.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:57 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T08:00:57.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:57 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:57.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:57 smithi022 ceph-mon[30854]: Deploying daemon mgr.z on smithi153 2024-09-10T08:00:57.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:57 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:57.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:57 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:00:57.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:57 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:57.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:57 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:00:57.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:57 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:57.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:57 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T08:00:57.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:57 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T08:00:57.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:57 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T08:00:57.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:57 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:57.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:57 smithi153 ceph-mon[35609]: Deploying daemon mgr.z on smithi153 2024-09-10T08:00:58.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:57 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:58.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:57 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:00:58.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:57 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:58.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:57 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:00:58.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:57 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:58.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:57 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T08:00:58.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:57 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T08:00:58.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:57 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T08:00:58.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:57 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:58.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:57 smithi100 ceph-mon[35102]: Deploying daemon mgr.z on smithi153 2024-09-10T08:00:58.124 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:00:58.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.573+0000 7f542b361640 1 -- 172.21.15.22:0/924106926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5424101770 msgr2=0x7f5424101c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:58.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.573+0000 7f542b361640 1 --2- 172.21.15.22:0/924106926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5424101770 0x7f5424101c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f541c009ca0 tx=0x7f541c02a8c0 comp rx=0 tx=0).stop 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 -- 172.21.15.22:0/924106926 shutdown_connections 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 --2- 172.21.15.22:0/924106926 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5424101770 0x7f5424101c20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 --2- 172.21.15.22:0/924106926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5424100dd0 0x7f5424101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 --2- 172.21.15.22:0/924106926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5424100490 0x7f5424100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 -- 172.21.15.22:0/924106926 >> 172.21.15.22:0/924106926 conn(0x7f54240fc2a0 msgr2=0x7f54240fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 -- 172.21.15.22:0/924106926 shutdown_connections 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 -- 172.21.15.22:0/924106926 wait complete. 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 Processor -- start 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 -- start start 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5424100490 0x7f542419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5424100dd0 0x7f542419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5424101770 0x7f54241a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:58.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f542410fa60 con 0x7f5424101770 2024-09-10T08:00:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f542410f8e0 con 0x7f5424100490 2024-09-10T08:00:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.574+0000 7f542b361640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f542410fbe0 con 0x7f5424100dd0 2024-09-10T08:00:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f54298fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5424101770 0x7f54241a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f54298fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5424101770 0x7f54241a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59378/0 (socket says 172.21.15.22:59378) 2024-09-10T08:00:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f54298fe640 1 -- 172.21.15.22:0/3736669957 learned_addr learned my addr 172.21.15.22:0/3736669957 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:00:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f54288fc640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5424100dd0 0x7f542419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f54290fd640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5424100490 0x7f542419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f54298fe640 1 -- 172.21.15.22:0/3736669957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5424100dd0 msgr2=0x7f542419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f54298fe640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5424100dd0 0x7f542419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f54298fe640 1 -- 172.21.15.22:0/3736669957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5424100490 msgr2=0x7f542419a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:00:58.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f54298fe640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5424100490 0x7f542419a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f54298fe640 1 -- 172.21.15.22:0/3736669957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54241a1cc0 con 0x7f5424101770 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f54288fc640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5424100dd0 0x7f542419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f54298fe640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5424101770 0x7f54241a1650 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f541c005e30 tx=0x7f541c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f541a7fc640 1 -- 172.21.15.22:0/3736669957 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c003c30 con 0x7f5424101770 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f541a7fc640 1 -- 172.21.15.22:0/3736669957 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f541c003dd0 con 0x7f5424101770 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f541a7fc640 1 -- 172.21.15.22:0/3736669957 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c02fde0 con 0x7f5424101770 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f542b361640 1 -- 172.21.15.22:0/3736669957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54241a1f50 con 0x7f5424101770 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.575+0000 7f542b361640 1 -- 172.21.15.22:0/3736669957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54241a2450 con 0x7f5424101770 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.576+0000 7f541a7fc640 1 -- 172.21.15.22:0/3736669957 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 13) ==== 46343+0+0 (secure 0 0 0) 0x7f541c004050 con 0x7f5424101770 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.576+0000 7f542b361640 1 -- 172.21.15.22:0/3736669957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f542410b1e0 con 0x7f5424101770 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.577+0000 7f541a7fc640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f54100392c0 0x7f541003b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.577+0000 7f541a7fc640 1 -- 172.21.15.22:0/3736669957 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f541c06d770 con 0x7f5424101770 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.577+0000 7f54290fd640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f54100392c0 0x7f541003b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:00:58.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.577+0000 7f54290fd640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f54100392c0 0x7f541003b780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5420005d00 tx=0x7f5420005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:00:58.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.582+0000 7f541a7fc640 1 -- 172.21.15.22:0/3736669957 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f541c04cba0 con 0x7f5424101770 2024-09-10T08:00:58.670 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:58 smithi153 systemd[1]: Starting Ceph mgr.z for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:00:58.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:00:58.766+0000 7f542b361640 1 -- 172.21.15.22:0/3736669957 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5424062630 con 0x7f54100392c0 2024-09-10T08:00:58.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:58 smithi153 ceph-mon[35609]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:58.944 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:58 smithi153 podman[37403]: 2024-09-10 08:00:58.678802658 +0000 UTC m=+0.101171554 container create b13d21273962cadaeca1ae662c53992336d84b35b4e767e89b3b78c5abdf0cae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:00:58.944 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:58 smithi153 podman[37403]: 2024-09-10 08:00:58.592904316 +0000 UTC m=+0.015273221 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:00:58.944 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:58 smithi153 podman[37403]: 2024-09-10 08:00:58.889620012 +0000 UTC m=+0.311988908 container init b13d21273962cadaeca1ae662c53992336d84b35b4e767e89b3b78c5abdf0cae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD) 2024-09-10T08:00:58.944 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:58 smithi153 podman[37403]: 2024-09-10 08:00:58.892551998 +0000 UTC m=+0.314920910 container start b13d21273962cadaeca1ae662c53992336d84b35b4e767e89b3b78c5abdf0cae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T08:00:58.944 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:58 smithi153 ceph-mgr[37421]: -- 172.21.15.153:0/1403678025 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bca5ecd0e0 con 0x55bca5eab000 2024-09-10T08:00:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:58 smithi022 ceph-mon[30854]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:59.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:58 smithi100 ceph-mon[35102]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:00:59.288 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:58 smithi153 bash[37403]: b13d21273962cadaeca1ae662c53992336d84b35b4e767e89b3b78c5abdf0cae 2024-09-10T08:00:59.288 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:58 smithi153 systemd[1]: Started Ceph mgr.z for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:00:59.289 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:00:59.016+0000 7fd8b552f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:00:59.289 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:00:59.078+0000 7fd8b552f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:00:59.289 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:00:59.224+0000 7fd8b552f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:00:59.289 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:00:59.289+0000 7fd8b552f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:00:59.570 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:00:59.434+0000 7fd8b552f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:00:59.570 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:00:59.571+0000 7fd8b552f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:00:59.732 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:59 smithi100 ceph-mon[35102]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:00:59.732 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:00:59.732 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:00:59.732 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:59.732 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:59.732 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:59.732 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:59.733 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T08:00:59.733 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T08:00:59.733 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T08:00:59.733 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:00:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:59.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:59 smithi022 ceph-mon[30854]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:00:59.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:00:59.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:00:59.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:59.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:59.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:59.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:59.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T08:00:59.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T08:00:59.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T08:00:59.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:00:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:59.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-mon[35609]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:00:59.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:00:59.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:00:59.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:00:59.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:59.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:59.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:00:59.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-10T08:00:59.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T08:00:59.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-10T08:00:59.883 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:00.193 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:00:59.883+0000 7fd8b552f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:01:00.193 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:00:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:00:59.943+0000 7fd8b552f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:01:00.193 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:00 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:00.125+0000 7fd8b552f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:01:00.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:00 smithi100 ceph-mon[35102]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:00.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:00 smithi100 ceph-mon[35102]: Deploying daemon mgr.y on smithi100 2024-09-10T08:01:00.868 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:00 smithi100 systemd[1]: Starting Ceph mgr.y for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:01:00.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:00 smithi153 ceph-mon[35609]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:00.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:00 smithi153 ceph-mon[35609]: Deploying daemon mgr.y on smithi100 2024-09-10T08:01:01.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:00 smithi022 ceph-mon[30854]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:01.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:00 smithi022 ceph-mon[30854]: Deploying daemon mgr.y on smithi100 2024-09-10T08:01:01.273 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:00 smithi100 podman[36457]: 2024-09-10 08:01:00.898485246 +0000 UTC m=+0.015991373 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:01:01.274 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:00 smithi100 podman[36457]: 2024-09-10 08:01:00.997308431 +0000 UTC m=+0.114814598 container create eaba2fa9f5a5a588037e2dc2a86e4c04b0b8669c8a7ae19a7b7e3fe2bc50b138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:01:01.274 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:01 smithi100 podman[36457]: 2024-09-10 08:01:01.275024727 +0000 UTC m=+0.392530853 container init eaba2fa9f5a5a588037e2dc2a86e4c04b0b8669c8a7ae19a7b7e3fe2bc50b138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:01:01.443 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:00 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:00.996+0000 7fd8b552f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:01:01.443 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:01.062+0000 7fd8b552f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:01:01.610 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:01 smithi100 podman[36457]: 2024-09-10 08:01:01.277962794 +0000 UTC m=+0.395468917 container start eaba2fa9f5a5a588037e2dc2a86e4c04b0b8669c8a7ae19a7b7e3fe2bc50b138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True) 2024-09-10T08:01:01.610 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-mgr[36491]: -- 172.21.15.100:0/1091750290 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d2d33a50e0 con 0x55d2d3382800 2024-09-10T08:01:01.610 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:01 smithi100 bash[36457]: eaba2fa9f5a5a588037e2dc2a86e4c04b0b8669c8a7ae19a7b7e3fe2bc50b138 2024-09-10T08:01:01.610 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:01.393+0000 7f18cee3e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:01:01.610 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:01 smithi100 systemd[1]: Started Ceph mgr.y for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:01:01.611 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:01.455+0000 7f18cee3e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:01:01.611 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:01.611+0000 7f18cee3e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:01:01.868 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:01.680+0000 7f18cee3e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:01:01.868 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:01.837+0000 7f18cee3e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:01:01.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2632546243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d296bd3-28a7-418c-ad73-343a5e806cfc"}]: dispatch 2024-09-10T08:01:01.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2632546243' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d296bd3-28a7-418c-ad73-343a5e806cfc"}]': finished 2024-09-10T08:01:01.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-mon[35102]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T08:01:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3497555351' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:01:01.933 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:01.795+0000 7fd8b552f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:01:01.934 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:01.928+0000 7fd8b552f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:01:01.934 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2632546243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d296bd3-28a7-418c-ad73-343a5e806cfc"}]: dispatch 2024-09-10T08:01:01.934 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2632546243' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d296bd3-28a7-418c-ad73-343a5e806cfc"}]': finished 2024-09-10T08:01:01.934 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-mon[35609]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T08:01:01.935 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:01.935 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:01.935 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:01.935 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:01.935 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:01.935 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:01.935 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:01 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3497555351' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:01:02.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:01 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2632546243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d296bd3-28a7-418c-ad73-343a5e806cfc"}]: dispatch 2024-09-10T08:01:02.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:01 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2632546243' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d296bd3-28a7-418c-ad73-343a5e806cfc"}]': finished 2024-09-10T08:01:02.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:01 smithi022 ceph-mon[30854]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T08:01:02.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:02.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:02.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:01 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3497555351' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:01:02.193 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:02.073+0000 7fd8b552f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:01:02.194 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:02.135+0000 7fd8b552f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:01:02.271 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:01 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:01.991+0000 7f18cee3e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:01:02.568 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:02 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:02.315+0000 7f18cee3e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:01:02.568 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:02 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:02.378+0000 7f18cee3e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:01:02.579 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:02.292+0000 7fd8b552f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:01:02.579 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:02.359+0000 7fd8b552f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:01:02.579 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:02.421+0000 7fd8b552f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:01:02.580 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:02.579+0000 7fd8b552f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:01:02.868 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:02 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:02.568+0000 7f18cee3e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:01:02.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:02 smithi100 ceph-mon[35102]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:02.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.876 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-mon[35609]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:02.876 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.876 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.876 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.876 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.876 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:02.876 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:02.877 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:02.877 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:02.664+0000 7fd8b552f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:01:02.877 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:02.731+0000 7fd8b552f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:01:02.877 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:02.816+0000 7fd8b552f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:01:02.877 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:02.877+0000 7fd8b552f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:01:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:02 smithi022 ceph-mon[30854]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:03.193 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:02.936+0000 7fd8b552f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:01:03.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:03.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:03.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:03.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:03.869 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:03.459+0000 7f18cee3e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:01:03.869 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:03.524+0000 7f18cee3e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:01:03.943 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:01:03 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:01:03.722+0000 7fd8b552f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:01:03.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:03.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:03.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:03.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:04.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:04.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:04.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:04.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:04.486 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:04.231+0000 7f18cee3e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:01:04.486 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:04.345+0000 7f18cee3e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:01:04.486 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:04.486+0000 7f18cee3e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:01:04.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:04.690+0000 7f541a7fc640 1 -- 172.21.15.22:0/3736669957 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 14) ==== 92060+0+0 (secure 0 0 0) 0x7f541c030940 con 0x7f5424101770 2024-09-10T08:01:04.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-mon[35102]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:04.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-mon[35102]: Standby manager daemon z started 2024-09-10T08:01:04.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.153:0/1202990915' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T08:01:04.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.153:0/1202990915' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T08:01:04.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.153:0/1202990915' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T08:01:04.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.153:0/1202990915' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T08:01:04.762 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:04.546+0000 7f18cee3e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:01:04.762 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:04.694+0000 7f18cee3e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:01:04.762 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:04.761+0000 7f18cee3e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:01:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:04 smithi153 ceph-mon[35609]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:04 smithi153 ceph-mon[35609]: Standby manager daemon z started 2024-09-10T08:01:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:04 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.153:0/1202990915' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T08:01:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:04 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.153:0/1202990915' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T08:01:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:04 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.153:0/1202990915' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T08:01:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:04 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.153:0/1202990915' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T08:01:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:04 smithi022 ceph-mon[30854]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:04 smithi022 ceph-mon[30854]: Standby manager daemon z started 2024-09-10T08:01:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:04 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.153:0/1202990915' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T08:01:05.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:04 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.153:0/1202990915' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T08:01:05.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:04 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.153:0/1202990915' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T08:01:05.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:04 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.153:0/1202990915' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T08:01:05.041 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:04.821+0000 7f18cee3e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:01:05.041 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:04.978+0000 7f18cee3e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:01:05.042 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:05 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:05.041+0000 7f18cee3e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:01:05.307 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:05 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:05.108+0000 7f18cee3e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:01:05.307 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:05 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:05.190+0000 7f18cee3e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:01:05.307 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:05 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:05.248+0000 7f18cee3e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:01:05.307 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:05 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:05.307+0000 7f18cee3e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:01:05.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:05 smithi153 ceph-mon[35609]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-10T08:01:05.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:05 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T08:01:05.965 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:05 smithi022 ceph-mon[30854]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-10T08:01:05.965 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:05 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T08:01:06.094 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:05 smithi100 ceph-mon[35102]: mgrmap e14: x(active, since 63s), standbys: z 2024-09-10T08:01:06.094 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:05 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T08:01:06.368 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:01:06 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:01:06.094+0000 7f18cee3e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:01:06.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:06.909+0000 7f541a7fc640 1 -- 172.21.15.22:0/3736669957 <== mon.0 v2:172.21.15.22:3300/0 8 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f541c0433d0 con 0x7f5424101770 2024-09-10T08:01:06.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:06 smithi022 ceph-mon[30854]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:06.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:06 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:06.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:06 smithi022 ceph-mon[30854]: Standby manager daemon y started 2024-09-10T08:01:06.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:06 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.100:0/45656602' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T08:01:06.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:06 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.100:0/45656602' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T08:01:06.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:06 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.100:0/45656602' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T08:01:06.912 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:06 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.100:0/45656602' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T08:01:06.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:06 smithi153 ceph-mon[35609]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:06.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:06 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:06.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:06 smithi153 ceph-mon[35609]: Standby manager daemon y started 2024-09-10T08:01:06.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:06 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.100:0/45656602' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T08:01:06.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:06 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.100:0/45656602' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T08:01:06.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:06 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.100:0/45656602' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T08:01:06.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:06 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.100:0/45656602' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T08:01:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:06 smithi100 ceph-mon[35102]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:06 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:06 smithi100 ceph-mon[35102]: Standby manager daemon y started 2024-09-10T08:01:07.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:06 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.100:0/45656602' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T08:01:07.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:06 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.100:0/45656602' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T08:01:07.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:06 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.100:0/45656602' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T08:01:07.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:06 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.100:0/45656602' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T08:01:08.183 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:07 smithi022 ceph-mon[30854]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:08.184 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:07 smithi022 ceph-mon[30854]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-10T08:01:08.184 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:07 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T08:01:08.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:07 smithi153 ceph-mon[35609]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:08.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:07 smithi153 ceph-mon[35609]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-10T08:01:08.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:07 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T08:01:08.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:07 smithi100 ceph-mon[35102]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:08.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:07 smithi100 ceph-mon[35102]: mgrmap e15: x(active, since 66s), standbys: z, y 2024-09-10T08:01:08.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:07 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T08:01:10.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:09 smithi022 ceph-mon[30854]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:10.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:09 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T08:01:10.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:09 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:10.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:09 smithi022 ceph-mon[30854]: Deploying daemon osd.0 on smithi022 2024-09-10T08:01:10.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:09 smithi100 ceph-mon[35102]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:10.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:09 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T08:01:10.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:09 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:10.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:09 smithi100 ceph-mon[35102]: Deploying daemon osd.0 on smithi022 2024-09-10T08:01:10.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:09 smithi153 ceph-mon[35609]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:10.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:09 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-10T08:01:10.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:09 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:10.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:09 smithi153 ceph-mon[35609]: Deploying daemon osd.0 on smithi022 2024-09-10T08:01:12.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:11 smithi153 ceph-mon[35609]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:12.228 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:11 smithi022 ceph-mon[30854]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:12.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:11 smithi100 ceph-mon[35102]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:14.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:13 smithi153 ceph-mon[35609]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:14.232 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:13 smithi022 ceph-mon[30854]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:14.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:13 smithi100 ceph-mon[35102]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:16.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:15 smithi153 ceph-mon[35609]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:16.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:15 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:16.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:15 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:16.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:15 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:16.216 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:15 smithi022 ceph-mon[30854]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:16.216 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:15 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:16.217 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:15 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:16.217 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:15 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:16.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:15 smithi100 ceph-mon[35102]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:16.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:15 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:16.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:15 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:16.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:15 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:18.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:17 smithi022 ceph-mon[30854]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:18.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:17 smithi153 ceph-mon[35609]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:18.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:17 smithi100 ceph-mon[35102]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:19.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:19.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:19.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:19.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:19.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:19.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:19.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:19.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:19.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:19.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:19.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:19.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:19.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:19.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:19.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:19.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.579+0000 7f541a7fc640 1 -- 172.21.15.22:0/3736669957 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5424062630 con 0x7f54100392c0 2024-09-10T08:01:19.579 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 0 on host 'smithi022' 2024-09-10T08:01:19.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.583+0000 7f542b361640 1 -- 172.21.15.22:0/3736669957 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f54100392c0 msgr2=0x7f541003b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:01:19.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.583+0000 7f542b361640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f54100392c0 0x7f541003b780 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5420005d00 tx=0x7f5420005c50 comp rx=0 tx=0).stop 2024-09-10T08:01:19.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.583+0000 7f542b361640 1 -- 172.21.15.22:0/3736669957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5424101770 msgr2=0x7f54241a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:01:19.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.583+0000 7f542b361640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5424101770 0x7f54241a1650 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f541c005e30 tx=0x7f541c031ee0 comp rx=0 tx=0).stop 2024-09-10T08:01:19.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.583+0000 7f542b361640 1 -- 172.21.15.22:0/3736669957 shutdown_connections 2024-09-10T08:01:19.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.583+0000 7f542b361640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f54100392c0 0x7f541003b780 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:19.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.583+0000 7f542b361640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5424101770 0x7f54241a1650 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:19.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.583+0000 7f542b361640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5424100dd0 0x7f542419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:19.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.583+0000 7f542b361640 1 --2- 172.21.15.22:0/3736669957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5424100490 0x7f542419a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:19.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.583+0000 7f542b361640 1 -- 172.21.15.22:0/3736669957 >> 172.21.15.22:0/3736669957 conn(0x7f54240fc2a0 msgr2=0x7f54240fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:01:19.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.584+0000 7f542b361640 1 -- 172.21.15.22:0/3736669957 shutdown_connections 2024-09-10T08:01:19.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:01:19.584+0000 7f542b361640 1 -- 172.21.15.22:0/3736669957 wait complete. 2024-09-10T08:01:20.245 DEBUG:teuthology.orchestra.run.smithi022:osd.0> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T08:01:20.286 INFO:tasks.cephadm:Deploying osd.1 on smithi100 with /dev/vg_nvme/lv_4... 2024-09-10T08:01:20.287 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T08:01:20.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:20 smithi022 ceph-mon[30854]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:20.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:20.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:20.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:20.534 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T08:01:20.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:20 smithi100 ceph-mon[35102]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:20.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:20.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:20.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:20.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:20 smithi153 ceph-mon[35609]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:20.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:20.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:20.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:22.351 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:01:22 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0[42281]: 2024-09-10T08:01:22.004+0000 7f3d6d486640 -1 osd.0 0 log_to_monitors true 2024-09-10T08:01:22.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:22 smithi022 ceph-mon[30854]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:22.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:22 smithi022 ceph-mon[30854]: from='osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T08:01:22.670 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:22 smithi100 ceph-mon[35102]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:22.670 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:22 smithi100 ceph-mon[35102]: from='osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T08:01:22.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:22 smithi153 ceph-mon[35609]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:22.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:22 smithi153 ceph-mon[35609]: from='osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-10T08:01:22.775 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T08:01:22.801 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_4 2024-09-10T08:01:23.048 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T08:01:23.452 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: from='osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T08:01:23.452 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T08:01:23.452 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: from='osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-10T08:01:23.452 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:23.452 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:23.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:23.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:01:23.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:23.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:23.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:23.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:23.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: from='osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-10T08:01:23.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T08:01:23.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:23 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:23.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.481+0000 7f9aef79c640 1 -- 172.21.15.100:0/286755537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ae8101c00 msgr2=0x7f9ae8102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:01:23.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.481+0000 7f9aef79c640 1 --2- 172.21.15.100:0/286755537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ae8101c00 0x7f9ae8102000 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4009900 tx=0x7f9ae402a410 comp rx=0 tx=0).stop 2024-09-10T08:01:23.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.481+0000 7f9aef79c640 1 -- 172.21.15.100:0/286755537 shutdown_connections 2024-09-10T08:01:23.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.481+0000 7f9aef79c640 1 --2- 172.21.15.100:0/286755537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ae81037c0 0x7f9ae810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:23.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.481+0000 7f9aef79c640 1 --2- 172.21.15.100:0/286755537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ae8102e00 0x7f9ae8103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:23.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.481+0000 7f9aef79c640 1 --2- 172.21.15.100:0/286755537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ae8101c00 0x7f9ae8102000 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:23.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.481+0000 7f9aef79c640 1 -- 172.21.15.100:0/286755537 >> 172.21.15.100:0/286755537 conn(0x7f9ae80fd390 msgr2=0x7f9ae80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:01:23.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.481+0000 7f9aef79c640 1 -- 172.21.15.100:0/286755537 shutdown_connections 2024-09-10T08:01:23.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.481+0000 7f9aef79c640 1 -- 172.21.15.100:0/286755537 wait complete. 2024-09-10T08:01:23.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aef79c640 1 Processor -- start 2024-09-10T08:01:23.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aef79c640 1 -- start start 2024-09-10T08:01:23.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aef79c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ae8101c00 0x7f9ae8075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:01:23.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aef79c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ae8102e00 0x7f9ae80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:01:23.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aef79c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ae81037c0 0x7f9ae8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:01:23.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aef79c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae810d8e0 con 0x7f9ae8102e00 2024-09-10T08:01:23.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aef79c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae810d760 con 0x7f9ae81037c0 2024-09-10T08:01:23.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aef79c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae810da60 con 0x7f9ae8101c00 2024-09-10T08:01:23.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aedd39640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ae81037c0 0x7f9ae8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:01:23.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aedd39640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ae81037c0 0x7f9ae8074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36976/0 (socket says 172.21.15.100:36976) 2024-09-10T08:01:23.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aedd39640 1 -- 172.21.15.100:0/1720975696 learned_addr learned my addr 172.21.15.100:0/1720975696 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T08:01:23.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aecd37640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ae8102e00 0x7f9ae80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:01:23.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aed538640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ae8101c00 0x7f9ae8075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:01:23.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aedd39640 1 -- 172.21.15.100:0/1720975696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ae8101c00 msgr2=0x7f9ae8075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:01:23.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aedd39640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ae8101c00 0x7f9ae8075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:23.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aedd39640 1 -- 172.21.15.100:0/1720975696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ae8102e00 msgr2=0x7f9ae80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:01:23.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.482+0000 7f9aedd39640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ae8102e00 0x7f9ae80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:23.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.483+0000 7f9aedd39640 1 -- 172.21.15.100:0/1720975696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae80753e0 con 0x7f9ae81037c0 2024-09-10T08:01:23.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.483+0000 7f9aedd39640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ae81037c0 0x7f9ae8074b20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000b970 tx=0x7f9ae000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:01:23.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.483+0000 7f9ade7fc640 1 -- 172.21.15.100:0/1720975696 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0019070 con 0x7f9ae81037c0 2024-09-10T08:01:23.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.483+0000 7f9ade7fc640 1 -- 172.21.15.100:0/1720975696 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9ae000cb40 con 0x7f9ae81037c0 2024-09-10T08:01:23.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.483+0000 7f9aef79c640 1 -- 172.21.15.100:0/1720975696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae81a2110 con 0x7f9ae81037c0 2024-09-10T08:01:23.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.483+0000 7f9ade7fc640 1 -- 172.21.15.100:0/1720975696 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0007650 con 0x7f9ae81037c0 2024-09-10T08:01:23.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.483+0000 7f9aef79c640 1 -- 172.21.15.100:0/1720975696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae81a25d0 con 0x7f9ae81037c0 2024-09-10T08:01:23.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.484+0000 7f9aef79c640 1 -- 172.21.15.100:0/1720975696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae8109000 con 0x7f9ae81037c0 2024-09-10T08:01:23.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.485+0000 7f9ade7fc640 1 -- 172.21.15.100:0/1720975696 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f9ae001c070 con 0x7f9ae81037c0 2024-09-10T08:01:23.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.485+0000 7f9ade7fc640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9ad40a2b70 0x7f9ad40a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:01:23.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.486+0000 7f9aed538640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9ad40a2b70 0x7f9ad40a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:01:23.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.486+0000 7f9ade7fc640 1 -- 172.21.15.100:0/1720975696 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f9ae00ccb00 con 0x7f9ae81037c0 2024-09-10T08:01:23.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.486+0000 7f9aed538640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9ad40a2b70 0x7f9ad40a5030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4006010 tx=0x7f9ae4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:01:23.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.490+0000 7f9ade7fc640 1 -- 172.21.15.100:0/1720975696 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9ae009af00 con 0x7f9ae81037c0 2024-09-10T08:01:23.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:23.665+0000 7f9aef79c640 1 -- 172.21.15.100:0/1720975696 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9ae8062630 con 0x7f9ad40a2b70 2024-09-10T08:01:23.686 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0[42281]: 2024-09-10T08:01:23.398+0000 7f3d69409640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T08:01:23.686 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0[42281]: 2024-09-10T08:01:23.403+0000 7f3d65231640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:01:23.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: from='osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T08:01:23.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T08:01:23.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: from='osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-10T08:01:23.686 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:23.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:23.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:23.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:01:23.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:23.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:23.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:23.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:23.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: from='osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-10T08:01:23.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T08:01:23.687 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:23 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:23.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: from='osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: from='osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: from='osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T08:01:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:23 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:24.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:24 smithi100 ceph-mon[35102]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:24.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:24 smithi100 ceph-mon[35102]: Detected new or changed devices on smithi022 2024-09-10T08:01:24.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:24 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-10T08:01:24.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:24.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:24 smithi100 ceph-mon[35102]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:01:24.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:01:24.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:01:24.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:24.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:24 smithi153 ceph-mon[35609]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:24 smithi153 ceph-mon[35609]: Detected new or changed devices on smithi022 2024-09-10T08:01:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:24 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-10T08:01:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:24 smithi153 ceph-mon[35609]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:01:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:01:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:01:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:24.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:24 smithi022 ceph-mon[30854]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:24.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:24 smithi022 ceph-mon[30854]: Detected new or changed devices on smithi022 2024-09-10T08:01:24.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:24 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-10T08:01:24.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:24.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:24 smithi022 ceph-mon[30854]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:01:24.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:01:24.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:01:24.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:24.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:25.549 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:25 smithi100 ceph-mon[35102]: purged_snaps scrub starts 2024-09-10T08:01:25.550 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:25 smithi100 ceph-mon[35102]: purged_snaps scrub ok 2024-09-10T08:01:25.550 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:25 smithi100 ceph-mon[35102]: osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152] boot 2024-09-10T08:01:25.550 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:25 smithi100 ceph-mon[35102]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T08:01:25.550 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:25 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:25.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:25 smithi153 ceph-mon[35609]: purged_snaps scrub starts 2024-09-10T08:01:25.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:25 smithi153 ceph-mon[35609]: purged_snaps scrub ok 2024-09-10T08:01:25.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:25 smithi153 ceph-mon[35609]: osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152] boot 2024-09-10T08:01:25.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:25 smithi153 ceph-mon[35609]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T08:01:25.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:25 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:25.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:25 smithi022 ceph-mon[30854]: purged_snaps scrub starts 2024-09-10T08:01:25.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:25 smithi022 ceph-mon[30854]: purged_snaps scrub ok 2024-09-10T08:01:25.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:25 smithi022 ceph-mon[30854]: osd.0 [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152] boot 2024-09-10T08:01:25.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:25 smithi022 ceph-mon[30854]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T08:01:25.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:25 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:01:26.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:26 smithi153 ceph-mon[35609]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:26.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:26 smithi153 ceph-mon[35609]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T08:01:26.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:26 smithi153 ceph-mon[35609]: from='client.? 172.21.15.100:0/1807604224' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1e2b40e-b4ab-475a-8a9e-c67409f46b6f"}]: dispatch 2024-09-10T08:01:26.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:26 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1e2b40e-b4ab-475a-8a9e-c67409f46b6f"}]: dispatch 2024-09-10T08:01:26.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:26 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1e2b40e-b4ab-475a-8a9e-c67409f46b6f"}]': finished 2024-09-10T08:01:26.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:26 smithi153 ceph-mon[35609]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T08:01:26.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:26 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:26.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:26 smithi022 ceph-mon[30854]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:26.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:26 smithi022 ceph-mon[30854]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T08:01:26.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:26 smithi022 ceph-mon[30854]: from='client.? 172.21.15.100:0/1807604224' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1e2b40e-b4ab-475a-8a9e-c67409f46b6f"}]: dispatch 2024-09-10T08:01:26.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:26 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1e2b40e-b4ab-475a-8a9e-c67409f46b6f"}]: dispatch 2024-09-10T08:01:26.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:26 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1e2b40e-b4ab-475a-8a9e-c67409f46b6f"}]': finished 2024-09-10T08:01:26.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:26 smithi022 ceph-mon[30854]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T08:01:26.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:26 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:26.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:26 smithi100 ceph-mon[35102]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T08:01:26.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:26 smithi100 ceph-mon[35102]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T08:01:26.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:26 smithi100 ceph-mon[35102]: from='client.? 172.21.15.100:0/1807604224' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1e2b40e-b4ab-475a-8a9e-c67409f46b6f"}]: dispatch 2024-09-10T08:01:26.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:26 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1e2b40e-b4ab-475a-8a9e-c67409f46b6f"}]: dispatch 2024-09-10T08:01:26.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:26 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1e2b40e-b4ab-475a-8a9e-c67409f46b6f"}]': finished 2024-09-10T08:01:26.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:26 smithi100 ceph-mon[35102]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T08:01:26.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:26 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:27.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:27 smithi153 ceph-mon[35609]: from='client.? 172.21.15.100:0/1295495324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:01:27.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:27 smithi022 ceph-mon[30854]: from='client.? 172.21.15.100:0/1295495324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:01:27.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:27 smithi100 ceph-mon[35102]: from='client.? 172.21.15.100:0/1295495324' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:01:28.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:28 smithi153 ceph-mon[35609]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:28.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:28 smithi022 ceph-mon[30854]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:28.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:28 smithi100 ceph-mon[35102]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:30.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:30 smithi153 ceph-mon[35609]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:30.738 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:30 smithi100 ceph-mon[35102]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:30.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:30 smithi022 ceph-mon[30854]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:32.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:32 smithi153 ceph-mon[35609]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:32.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:32 smithi022 ceph-mon[30854]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:32.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:32 smithi100 ceph-mon[35102]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:34.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:34 smithi153 ceph-mon[35609]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:34.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:34 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T08:01:34.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:34 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:34.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:34 smithi153 ceph-mon[35609]: Deploying daemon osd.1 on smithi100 2024-09-10T08:01:34.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:34 smithi022 ceph-mon[30854]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:34.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:34 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T08:01:34.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:34 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:34.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:34 smithi022 ceph-mon[30854]: Deploying daemon osd.1 on smithi100 2024-09-10T08:01:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:34 smithi100 ceph-mon[35102]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:34.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:34 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-10T08:01:34.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:34 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:34.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:34 smithi100 ceph-mon[35102]: Deploying daemon osd.1 on smithi100 2024-09-10T08:01:36.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:36 smithi153 ceph-mon[35609]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:36.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:36 smithi022 ceph-mon[30854]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:36.825 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:36 smithi100 ceph-mon[35102]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:38.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:38 smithi153 ceph-mon[35609]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:38.725 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:38 smithi100 ceph-mon[35102]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:38.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:38 smithi022 ceph-mon[30854]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:40.628 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:40 smithi100 ceph-mon[35102]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:40.629 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:40 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:40.629 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:40 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:40.629 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:40 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:40.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:40 smithi153 ceph-mon[35609]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:40.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:40.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:40.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:40.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:40 smithi022 ceph-mon[30854]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:40.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:40.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:40.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:42.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:42 smithi100 ceph-mon[35102]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:42.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:42.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:42.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:42.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:42.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:42.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:42 smithi153 ceph-mon[35609]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:42.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:42.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:42.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:42.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:42.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:42.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:42 smithi022 ceph-mon[30854]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:42.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:42.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:42.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:42.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:42.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:43.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.826+0000 7f9ade7fc640 1 -- 172.21.15.100:0/1720975696 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9ae8062630 con 0x7f9ad40a2b70 2024-09-10T08:01:43.826 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 1 on host 'smithi100' 2024-09-10T08:01:43.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.829+0000 7f9aef79c640 1 -- 172.21.15.100:0/1720975696 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9ad40a2b70 msgr2=0x7f9ad40a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:01:43.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.829+0000 7f9aef79c640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9ad40a2b70 0x7f9ad40a5030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ae4006010 tx=0x7f9ae4000bc0 comp rx=0 tx=0).stop 2024-09-10T08:01:43.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.829+0000 7f9aef79c640 1 -- 172.21.15.100:0/1720975696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ae81037c0 msgr2=0x7f9ae8074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:01:43.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.829+0000 7f9aef79c640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ae81037c0 0x7f9ae8074b20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000b970 tx=0x7f9ae000be30 comp rx=0 tx=0).stop 2024-09-10T08:01:43.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.829+0000 7f9aef79c640 1 -- 172.21.15.100:0/1720975696 shutdown_connections 2024-09-10T08:01:43.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.829+0000 7f9aef79c640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9ad40a2b70 0x7f9ad40a5030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:43.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.829+0000 7f9aef79c640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ae81037c0 0x7f9ae8074b20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:43.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.829+0000 7f9aef79c640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9ae8102e00 0x7f9ae80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:43.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.829+0000 7f9aef79c640 1 --2- 172.21.15.100:0/1720975696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ae8101c00 0x7f9ae8075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:43.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.829+0000 7f9aef79c640 1 -- 172.21.15.100:0/1720975696 >> 172.21.15.100:0/1720975696 conn(0x7f9ae80fd390 msgr2=0x7f9ae81061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:01:43.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.829+0000 7f9aef79c640 1 -- 172.21.15.100:0/1720975696 shutdown_connections 2024-09-10T08:01:43.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:01:43.829+0000 7f9aef79c640 1 -- 172.21.15.100:0/1720975696 wait complete. 2024-09-10T08:01:44.413 DEBUG:teuthology.orchestra.run.smithi100:osd.1> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T08:01:44.415 INFO:tasks.cephadm:Deploying osd.2 on smithi153 with /dev/vg_nvme/lv_4... 2024-09-10T08:01:44.416 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T08:01:44.666 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:01:44.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:44 smithi153 ceph-mon[35609]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:44.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:44 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:44.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:44 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:44.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:44 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:44.740 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:44 smithi100 ceph-mon[35102]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:44.740 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:44 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:44.740 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:44 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:44.740 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:44 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:44.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:44 smithi022 ceph-mon[30854]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:44.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:44 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:01:44.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:44 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:44.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:44 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:45.715 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:45 smithi100 ceph-mon[35102]: from='osd.1 [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T08:01:45.715 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:45 smithi100 ceph-mon[35102]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T08:01:45.715 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:01:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1[39568]: 2024-09-10T08:01:45.395+0000 7f2208fe3640 -1 osd.1 0 log_to_monitors true 2024-09-10T08:01:45.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:45 smithi153 ceph-mon[35609]: from='osd.1 [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T08:01:45.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:45 smithi153 ceph-mon[35609]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T08:01:45.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:45 smithi022 ceph-mon[30854]: from='osd.1 [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T08:01:45.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:45 smithi022 ceph-mon[30854]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-10T08:01:46.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:46 smithi153 ceph-mon[35609]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:46.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:46 smithi153 ceph-mon[35609]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T08:01:46.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:46 smithi153 ceph-mon[35609]: from='osd.1 [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:01:46.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:46 smithi153 ceph-mon[35609]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T08:01:46.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:46.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:46 smithi153 ceph-mon[35609]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:01:46.720 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:01:46 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1[39568]: 2024-09-10T08:01:46.462+0000 7f2204f66640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T08:01:46.720 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:01:46 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1[39568]: 2024-09-10T08:01:46.464+0000 7f2200d8e640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:01:46.721 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:46 smithi100 ceph-mon[35102]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:46.721 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:46 smithi100 ceph-mon[35102]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T08:01:46.721 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:46 smithi100 ceph-mon[35102]: from='osd.1 [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:01:46.721 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:46 smithi100 ceph-mon[35102]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T08:01:46.721 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:46.721 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:46 smithi100 ceph-mon[35102]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:01:46.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:46 smithi022 ceph-mon[30854]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:46.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:46 smithi022 ceph-mon[30854]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T08:01:46.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:46 smithi022 ceph-mon[30854]: from='osd.1 [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:01:46.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:46 smithi022 ceph-mon[30854]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T08:01:46.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:46.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:46 smithi022 ceph-mon[30854]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:01:47.047 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T08:01:47.077 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi153:vg_nvme/lv_4 2024-09-10T08:01:47.333 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:01:47.672 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:47 smithi153 ceph-mon[35609]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-10T08:01:47.673 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:47 smithi153 ceph-mon[35609]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T08:01:47.673 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:47.673 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:47.673 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:47.673 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:47.673 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:01:47.673 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:47.673 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:47.673 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:47.673 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:47.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:47 smithi022 ceph-mon[30854]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-10T08:01:47.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:47 smithi022 ceph-mon[30854]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T08:01:47.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:47.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:47.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:47.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:47.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:01:47.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:47.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:47.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:47.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.759+0000 7f76c6b49640 1 -- 172.21.15.153:0/491208229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c01026a0 msgr2=0x7f76c0104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:01:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.759+0000 7f76c6b49640 1 --2- 172.21.15.153:0/491208229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c01026a0 0x7f76c0104a90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009900 tx=0x7f76b402a410 comp rx=0 tx=0).stop 2024-09-10T08:01:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.759+0000 7f76c6b49640 1 -- 172.21.15.153:0/491208229 shutdown_connections 2024-09-10T08:01:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.759+0000 7f76c6b49640 1 --2- 172.21.15.153:0/491208229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c0107900 0x7f76c0109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.759+0000 7f76c6b49640 1 --2- 172.21.15.153:0/491208229 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c0104fd0 0x7f76c01073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.759+0000 7f76c6b49640 1 --2- 172.21.15.153:0/491208229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c01026a0 0x7f76c0104a90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.759+0000 7f76c6b49640 1 -- 172.21.15.153:0/491208229 >> 172.21.15.153:0/491208229 conn(0x7f76c00fc2a0 msgr2=0x7f76c00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:01:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.759+0000 7f76c6b49640 1 -- 172.21.15.153:0/491208229 shutdown_connections 2024-09-10T08:01:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.759+0000 7f76c6b49640 1 -- 172.21.15.153:0/491208229 wait complete. 2024-09-10T08:01:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.759+0000 7f76c6b49640 1 Processor -- start 2024-09-10T08:01:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c6b49640 1 -- start start 2024-09-10T08:01:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c6b49640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c01026a0 0x7f76c0197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:01:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c6b49640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c0104fd0 0x7f76c01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:01:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c6b49640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c0107900 0x7f76c019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:01:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c6b49640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f76c010d8b0 con 0x7f76c0104fd0 2024-09-10T08:01:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c6b49640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f76c010d730 con 0x7f76c0107900 2024-09-10T08:01:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c6b49640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f76c010da30 con 0x7f76c01026a0 2024-09-10T08:01:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c48e5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c01026a0 0x7f76c0197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:01:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c48e5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c01026a0 0x7f76c0197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48886/0 (socket says 172.21.15.153:48886) 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c48e5640 1 -- 172.21.15.153:0/677590100 learned_addr learned my addr 172.21.15.153:0/677590100 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c50e6640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c0107900 0x7f76c019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76bffff640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c0104fd0 0x7f76c01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c48e5640 1 -- 172.21.15.153:0/677590100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c0107900 msgr2=0x7f76c019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c48e5640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c0107900 0x7f76c019f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c48e5640 1 -- 172.21.15.153:0/677590100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c0104fd0 msgr2=0x7f76c01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c48e5640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c0104fd0 0x7f76c01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c48e5640 1 -- 172.21.15.153:0/677590100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c019fba0 con 0x7f76c01026a0 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76bffff640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c0104fd0 0x7f76c01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76c48e5640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c01026a0 0x7f76c0197f70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009230 tx=0x7f76b4031b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.760+0000 7f76bdffb640 1 -- 172.21.15.153:0/677590100 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b403f030 con 0x7f76c01026a0 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.761+0000 7f76bdffb640 1 -- 172.21.15.153:0/677590100 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76b4003ad0 con 0x7f76c01026a0 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.761+0000 7f76c6b49640 1 -- 172.21.15.153:0/677590100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c019fe30 con 0x7f76c01026a0 2024-09-10T08:01:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.761+0000 7f76bdffb640 1 -- 172.21.15.153:0/677590100 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b4035070 con 0x7f76c01026a0 2024-09-10T08:01:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.761+0000 7f76c6b49640 1 -- 172.21.15.153:0/677590100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c01a0280 con 0x7f76c01026a0 2024-09-10T08:01:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.762+0000 7f76c6b49640 1 -- 172.21.15.153:0/677590100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c00fdd90 con 0x7f76c01026a0 2024-09-10T08:01:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.763+0000 7f76bdffb640 1 -- 172.21.15.153:0/677590100 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f76b4042030 con 0x7f76c01026a0 2024-09-10T08:01:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.764+0000 7f76bdffb640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f76b00a2ba0 0x7f76b00a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:01:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.764+0000 7f76bdffb640 1 -- 172.21.15.153:0/677590100 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7f76b40ed970 con 0x7f76c01026a0 2024-09-10T08:01:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.764+0000 7f76bffff640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f76b00a2ba0 0x7f76b00a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:01:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.764+0000 7f76bffff640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f76b00a2ba0 0x7f76b00a5060 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76c0199490 tx=0x7f76ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:01:47.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.768+0000 7f76bdffb640 1 -- 172.21.15.153:0/677590100 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f76b40bc120 con 0x7f76c01026a0 2024-09-10T08:01:47.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:47 smithi100 ceph-mon[35102]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-10T08:01:47.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:47 smithi100 ceph-mon[35102]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T08:01:47.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:47.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:47.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:47.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:47.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:01:47.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:47.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:47.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:01:47.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:01:47.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:01:47.951+0000 7f76c6b49640 1 -- 172.21.15.153:0/677590100 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f76c0062630 con 0x7f76b00a2ba0 2024-09-10T08:01:48.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:48 smithi153 ceph-mon[35609]: purged_snaps scrub starts 2024-09-10T08:01:48.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:48 smithi153 ceph-mon[35609]: purged_snaps scrub ok 2024-09-10T08:01:48.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:48 smithi153 ceph-mon[35609]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:48.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:48 smithi153 ceph-mon[35609]: Detected new or changed devices on smithi100 2024-09-10T08:01:48.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:48 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-10T08:01:48.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:48.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:48 smithi153 ceph-mon[35609]: osd.1 [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052] boot 2024-09-10T08:01:48.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:48 smithi153 ceph-mon[35609]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T08:01:48.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:48.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:01:48.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:01:48.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:48 smithi022 ceph-mon[30854]: purged_snaps scrub starts 2024-09-10T08:01:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:48 smithi022 ceph-mon[30854]: purged_snaps scrub ok 2024-09-10T08:01:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:48 smithi022 ceph-mon[30854]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:48 smithi022 ceph-mon[30854]: Detected new or changed devices on smithi100 2024-09-10T08:01:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:48 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-10T08:01:48.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:48.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:48 smithi022 ceph-mon[30854]: osd.1 [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052] boot 2024-09-10T08:01:48.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:48 smithi022 ceph-mon[30854]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T08:01:48.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:48.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:01:48.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:01:48.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:48.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:48 smithi100 ceph-mon[35102]: purged_snaps scrub starts 2024-09-10T08:01:48.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:48 smithi100 ceph-mon[35102]: purged_snaps scrub ok 2024-09-10T08:01:48.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:48 smithi100 ceph-mon[35102]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T08:01:48.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:48 smithi100 ceph-mon[35102]: Detected new or changed devices on smithi100 2024-09-10T08:01:48.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:48 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-10T08:01:48.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:48.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:48 smithi100 ceph-mon[35102]: osd.1 [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052] boot 2024-09-10T08:01:48.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:48 smithi100 ceph-mon[35102]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T08:01:48.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:01:48.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:01:48.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:01:48.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:49.518 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:49 smithi153 ceph-mon[35609]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:01:49.518 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:49 smithi153 ceph-mon[35609]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T08:01:49.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:49 smithi022 ceph-mon[30854]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:01:49.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:49 smithi022 ceph-mon[30854]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T08:01:49.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:49 smithi100 ceph-mon[35102]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:01:49.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:49 smithi100 ceph-mon[35102]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T08:01:50.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:50 smithi153 ceph-mon[35609]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:50.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:50 smithi153 ceph-mon[35609]: from='client.? 172.21.15.153:0/903918914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8"}]: dispatch 2024-09-10T08:01:50.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:50 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8"}]: dispatch 2024-09-10T08:01:50.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:50 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8"}]': finished 2024-09-10T08:01:50.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:50 smithi153 ceph-mon[35609]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T08:01:50.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:50 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:01:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:50 smithi022 ceph-mon[30854]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:50 smithi022 ceph-mon[30854]: from='client.? 172.21.15.153:0/903918914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8"}]: dispatch 2024-09-10T08:01:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:50 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8"}]: dispatch 2024-09-10T08:01:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:50 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8"}]': finished 2024-09-10T08:01:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:50 smithi022 ceph-mon[30854]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T08:01:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:50 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:01:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:50 smithi100 ceph-mon[35102]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:50 smithi100 ceph-mon[35102]: from='client.? 172.21.15.153:0/903918914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8"}]: dispatch 2024-09-10T08:01:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:50 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8"}]: dispatch 2024-09-10T08:01:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:50 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8"}]': finished 2024-09-10T08:01:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:50 smithi100 ceph-mon[35102]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T08:01:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:50 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:01:51.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:51 smithi022 ceph-mon[30854]: from='client.? 172.21.15.153:0/3912478700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:01:51.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:51 smithi100 ceph-mon[35102]: from='client.? 172.21.15.153:0/3912478700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:01:51.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:51 smithi153 ceph-mon[35609]: from='client.? 172.21.15.153:0/3912478700' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:01:52.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:52 smithi022 ceph-mon[30854]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:52.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:52 smithi100 ceph-mon[35102]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:52.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:52 smithi153 ceph-mon[35609]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:54.746 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:54 smithi153 ceph-mon[35609]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:54.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:54 smithi022 ceph-mon[30854]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:54.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:54 smithi100 ceph-mon[35102]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:56 smithi022 ceph-mon[30854]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:56.843 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:56 smithi153 ceph-mon[35609]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:56.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:56 smithi100 ceph-mon[35102]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:58.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:58 smithi153 ceph-mon[35609]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:58.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:58 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T08:01:58.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:58 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:58.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:58 smithi022 ceph-mon[30854]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:58.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:58 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T08:01:58.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:58 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:58 smithi100 ceph-mon[35102]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:01:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:58 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-10T08:01:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:58 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:01:59.690 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:01:59 smithi153 ceph-mon[35609]: Deploying daemon osd.2 on smithi153 2024-09-10T08:01:59.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:01:59 smithi022 ceph-mon[30854]: Deploying daemon osd.2 on smithi153 2024-09-10T08:01:59.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:01:59 smithi100 ceph-mon[35102]: Deploying daemon osd.2 on smithi153 2024-09-10T08:02:00.605 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:00 smithi153 ceph-mon[35609]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:00.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:00 smithi022 ceph-mon[30854]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:00.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:00 smithi100 ceph-mon[35102]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:02.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:02 smithi100 ceph-mon[35102]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:02.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:02 smithi153 ceph-mon[35609]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:02 smithi022 ceph-mon[30854]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:04.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:04 smithi153 ceph-mon[35609]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:04.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:04 smithi100 ceph-mon[35102]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:04 smithi022 ceph-mon[30854]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:05.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:05 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:05.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:05 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:05 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:05.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:05 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:05.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:05 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:05.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:05 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:06.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:05 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:06.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:05 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:06.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:05 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:06.850 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:06 smithi153 ceph-mon[35609]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:06.850 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:06 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:06.851 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:06 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:06.851 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:06 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:06.851 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:06 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:06.851 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:06 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:06 smithi022 ceph-mon[30854]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:06 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:06 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:06 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:06 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:06 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:06 smithi100 ceph-mon[35102]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:06 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:06 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:06 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:06 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:06 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:08.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.671+0000 7f76bdffb640 1 -- 172.21.15.153:0/677590100 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f76c0062630 con 0x7f76b00a2ba0 2024-09-10T08:02:08.670 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 2 on host 'smithi153' 2024-09-10T08:02:08.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.673+0000 7f76c6b49640 1 -- 172.21.15.153:0/677590100 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f76b00a2ba0 msgr2=0x7f76b00a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:02:08.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.673+0000 7f76c6b49640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f76b00a2ba0 0x7f76b00a5060 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f76c0199490 tx=0x7f76ac005f90 comp rx=0 tx=0).stop 2024-09-10T08:02:08.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.673+0000 7f76c6b49640 1 -- 172.21.15.153:0/677590100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c01026a0 msgr2=0x7f76c0197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:02:08.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.673+0000 7f76c6b49640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c01026a0 0x7f76c0197f70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009230 tx=0x7f76b4031b60 comp rx=0 tx=0).stop 2024-09-10T08:02:08.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.673+0000 7f76c6b49640 1 -- 172.21.15.153:0/677590100 shutdown_connections 2024-09-10T08:02:08.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.673+0000 7f76c6b49640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f76b00a2ba0 0x7f76b00a5060 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:08.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.673+0000 7f76c6b49640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c0107900 0x7f76c019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:08.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.673+0000 7f76c6b49640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76c0104fd0 0x7f76c01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:08.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.673+0000 7f76c6b49640 1 --2- 172.21.15.153:0/677590100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c01026a0 0x7f76c0197f70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:08.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.673+0000 7f76c6b49640 1 -- 172.21.15.153:0/677590100 >> 172.21.15.153:0/677590100 conn(0x7f76c00fc2a0 msgr2=0x7f76c0102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:02:08.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.673+0000 7f76c6b49640 1 -- 172.21.15.153:0/677590100 shutdown_connections 2024-09-10T08:02:08.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:02:08.674+0000 7f76c6b49640 1 -- 172.21.15.153:0/677590100 wait complete. 2024-09-10T08:02:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:08 smithi153 ceph-mon[35609]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:08 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:08 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:08 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:08 smithi022 ceph-mon[30854]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:08 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:08 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:08 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:09.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:08 smithi100 ceph-mon[35102]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:09.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:08 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:09.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:08 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:09.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:08 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:09.337 DEBUG:teuthology.orchestra.run.smithi153:osd.2> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T08:02:09.339 INFO:tasks.cephadm:Deploying osd.3 on smithi022 with /dev/vg_nvme/lv_3... 2024-09-10T08:02:09.339 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T08:02:09.608 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:02:10.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:10 smithi153 ceph-mon[35609]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:10.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:10 smithi153 ceph-mon[35609]: from='osd.2 [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T08:02:10.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:10 smithi153 ceph-mon[35609]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T08:02:10.800 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:02:10 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2[40606]: 2024-09-10T08:02:10.478+0000 7f27a4b12640 -1 osd.2 0 log_to_monitors true 2024-09-10T08:02:10.938 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:10 smithi100 ceph-mon[35102]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:10.938 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:10 smithi100 ceph-mon[35102]: from='osd.2 [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T08:02:10.939 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:10 smithi100 ceph-mon[35102]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T08:02:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:10 smithi022 ceph-mon[30854]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:10 smithi022 ceph-mon[30854]: from='osd.2 [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T08:02:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:10 smithi022 ceph-mon[30854]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-10T08:02:11.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:11 smithi153 ceph-mon[35609]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T08:02:11.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:11 smithi153 ceph-mon[35609]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T08:02:11.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:11.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:11 smithi153 ceph-mon[35609]: from='osd.2 [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:02:11.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:11 smithi153 ceph-mon[35609]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:02:12.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:11 smithi022 ceph-mon[30854]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T08:02:12.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:11 smithi022 ceph-mon[30854]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T08:02:12.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:12.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:11 smithi022 ceph-mon[30854]: from='osd.2 [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:02:12.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:11 smithi022 ceph-mon[30854]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:02:12.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:11 smithi100 ceph-mon[35102]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T08:02:12.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:11 smithi100 ceph-mon[35102]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T08:02:12.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:12.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:11 smithi100 ceph-mon[35102]: from='osd.2 [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:02:12.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:11 smithi100 ceph-mon[35102]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:02:12.402 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:02:12.429 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_3 2024-09-10T08:02:12.443 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2[40606]: 2024-09-10T08:02:12.106+0000 7f27a0a95640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T08:02:12.443 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2[40606]: 2024-09-10T08:02:12.110+0000 7f27988b5640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:02:12.697 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:02:12.958 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:12.958 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-10T08:02:12.958 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T08:02:12.958 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:12.958 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:12.958 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: from='osd.2 ' entity='osd.2' 2024-09-10T08:02:12.958 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:12.959 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:12.959 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:02:12.959 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:12.959 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:12.959 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:12.959 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-10T08:02:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T08:02:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: from='osd.2 ' entity='osd.2' 2024-09-10T08:02:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:02:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:13.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.167+0000 7f707e9a1640 1 -- 172.21.15.22:0/3673050905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7078107800 msgr2=0x7f7078109bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:02:13.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.167+0000 7f707e9a1640 1 --2- 172.21.15.22:0/3673050905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7078107800 0x7f7078109bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7070009ca0 tx=0x7f707002a8c0 comp rx=0 tx=0).stop 2024-09-10T08:02:13.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.167+0000 7f707e9a1640 1 -- 172.21.15.22:0/3673050905 shutdown_connections 2024-09-10T08:02:13.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.167+0000 7f707e9a1640 1 --2- 172.21.15.22:0/3673050905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7078107800 0x7f7078109bf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:13.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.167+0000 7f707e9a1640 1 --2- 172.21.15.22:0/3673050905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7078104ed0 0x7f70781072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:13.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.167+0000 7f707e9a1640 1 --2- 172.21.15.22:0/3673050905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70781025a0 0x7f7078104990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:13.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.167+0000 7f707e9a1640 1 -- 172.21.15.22:0/3673050905 >> 172.21.15.22:0/3673050905 conn(0x7f70780fc0e0 msgr2=0x7f70780fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:02:13.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.167+0000 7f707e9a1640 1 -- 172.21.15.22:0/3673050905 shutdown_connections 2024-09-10T08:02:13.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.167+0000 7f707e9a1640 1 -- 172.21.15.22:0/3673050905 wait complete. 2024-09-10T08:02:13.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.167+0000 7f707e9a1640 1 Processor -- start 2024-09-10T08:02:13.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707e9a1640 1 -- start start 2024-09-10T08:02:13.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707e9a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70781025a0 0x7f7078197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:02:13.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707e9a1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7078104ed0 0x7f7078198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:02:13.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707e9a1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7078107800 0x7f707819f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:02:13.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707e9a1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f707810d710 con 0x7f70781025a0 2024-09-10T08:02:13.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707e9a1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f707810d590 con 0x7f7078107800 2024-09-10T08:02:13.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707e9a1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f707810d890 con 0x7f7078104ed0 2024-09-10T08:02:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707d99f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70781025a0 0x7f7078197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:02:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707d99f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70781025a0 0x7f7078197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49136/0 (socket says 172.21.15.22:49136) 2024-09-10T08:02:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707d99f640 1 -- 172.21.15.22:0/428691079 learned_addr learned my addr 172.21.15.22:0/428691079 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:02:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707d19e640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7078104ed0 0x7f7078198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:02:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707e1a0640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7078107800 0x7f707819f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:02:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707d99f640 1 -- 172.21.15.22:0/428691079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7078104ed0 msgr2=0x7f7078198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:02:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707d99f640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7078104ed0 0x7f7078198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707d99f640 1 -- 172.21.15.22:0/428691079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7078107800 msgr2=0x7f707819f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:02:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707d99f640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7078107800 0x7f707819f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707d99f640 1 -- 172.21.15.22:0/428691079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707819f940 con 0x7f70781025a0 2024-09-10T08:02:13.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.168+0000 7f707d99f640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70781025a0 0x7f7078197d20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f707400c970 tx=0x7f707400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:02:13.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.169+0000 7f706effd640 1 -- 172.21.15.22:0/428691079 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074007bb0 con 0x7f70781025a0 2024-09-10T08:02:13.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.169+0000 7f706effd640 1 -- 172.21.15.22:0/428691079 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7074007d50 con 0x7f70781025a0 2024-09-10T08:02:13.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.169+0000 7f707e9a1640 1 -- 172.21.15.22:0/428691079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707819fc30 con 0x7f70781025a0 2024-09-10T08:02:13.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.169+0000 7f706effd640 1 -- 172.21.15.22:0/428691079 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f707400f450 con 0x7f70781025a0 2024-09-10T08:02:13.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.169+0000 7f707e9a1640 1 -- 172.21.15.22:0/428691079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70781a0170 con 0x7f70781025a0 2024-09-10T08:02:13.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.170+0000 7f707e9a1640 1 -- 172.21.15.22:0/428691079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70780fdbd0 con 0x7f70781025a0 2024-09-10T08:02:13.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.171+0000 7f706effd640 1 -- 172.21.15.22:0/428691079 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 137777+0+0 (secure 0 0 0) 0x7f7074004fe0 con 0x7f70781025a0 2024-09-10T08:02:13.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.171+0000 7f706effd640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f70640a2b70 0x7f70640a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:02:13.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.172+0000 7f707d19e640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f70640a2b70 0x7f70640a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:02:13.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.172+0000 7f706effd640 1 -- 172.21.15.22:0/428691079 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f70740cdbe0 con 0x7f70781025a0 2024-09-10T08:02:13.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.172+0000 7f707d19e640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f70640a2b70 0x7f70640a5030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7068005fd0 tx=0x7f7068005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:02:13.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.179+0000 7f706effd640 1 -- 172.21.15.22:0/428691079 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7074014030 con 0x7f70781025a0 2024-09-10T08:02:13.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-10T08:02:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T08:02:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: from='osd.2 ' entity='osd.2' 2024-09-10T08:02:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:02:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:13.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:13.365+0000 7f707e9a1640 1 -- 172.21.15.22:0/428691079 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7078062630 con 0x7f70640a2b70 2024-09-10T08:02:14.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:13 smithi022 ceph-mon[30854]: purged_snaps scrub starts 2024-09-10T08:02:14.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:13 smithi022 ceph-mon[30854]: purged_snaps scrub ok 2024-09-10T08:02:14.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:13 smithi022 ceph-mon[30854]: Detected new or changed devices on smithi153 2024-09-10T08:02:14.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:13 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi153 to 17088M 2024-09-10T08:02:14.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:14.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:13 smithi022 ceph-mon[30854]: osd.2 [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476] boot 2024-09-10T08:02:14.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:13 smithi022 ceph-mon[30854]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T08:02:14.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:14.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:02:14.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:02:14.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:14.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:13 smithi100 ceph-mon[35102]: purged_snaps scrub starts 2024-09-10T08:02:14.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:13 smithi100 ceph-mon[35102]: purged_snaps scrub ok 2024-09-10T08:02:14.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:13 smithi100 ceph-mon[35102]: Detected new or changed devices on smithi153 2024-09-10T08:02:14.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:13 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi153 to 17088M 2024-09-10T08:02:14.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:14.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:13 smithi100 ceph-mon[35102]: osd.2 [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476] boot 2024-09-10T08:02:14.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:13 smithi100 ceph-mon[35102]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T08:02:14.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:14.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:02:14.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:02:14.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:14.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:13 smithi153 ceph-mon[35609]: purged_snaps scrub starts 2024-09-10T08:02:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:13 smithi153 ceph-mon[35609]: purged_snaps scrub ok 2024-09-10T08:02:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:13 smithi153 ceph-mon[35609]: Detected new or changed devices on smithi153 2024-09-10T08:02:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:13 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi153 to 17088M 2024-09-10T08:02:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:13 smithi153 ceph-mon[35609]: osd.2 [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476] boot 2024-09-10T08:02:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:13 smithi153 ceph-mon[35609]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T08:02:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:02:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:02:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:02:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:14 smithi022 ceph-mon[30854]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:14 smithi022 ceph-mon[30854]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:02:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:14 smithi022 ceph-mon[30854]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T08:02:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:14 smithi100 ceph-mon[35102]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:14 smithi100 ceph-mon[35102]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:02:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:14 smithi100 ceph-mon[35102]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T08:02:15.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:14 smithi153 ceph-mon[35609]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T08:02:15.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:14 smithi153 ceph-mon[35609]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:02:15.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:14 smithi153 ceph-mon[35609]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T08:02:16.000 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:15 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T08:02:16.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:15 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T08:02:16.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:15 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-10T08:02:16.715 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:02:16 smithi022 sudo[47147]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T08:02:16.715 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:02:16 smithi022 sudo[47147]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T08:02:16.715 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:02:16 smithi022 sudo[47147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T08:02:16.715 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:02:16 smithi022 sudo[47147]: pam_unix(sudo:session): session closed for user root 2024-09-10T08:02:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:16 smithi153 ceph-mon[35609]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T08:02:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:16 smithi153 ceph-mon[35609]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T08:02:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T08:02:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:16 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1206931018' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e980a3ba-c659-4473-9633-9cbe88296d70"}]: dispatch 2024-09-10T08:02:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T08:02:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:16 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1206931018' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e980a3ba-c659-4473-9633-9cbe88296d70"}]': finished 2024-09-10T08:02:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:16 smithi153 ceph-mon[35609]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T08:02:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:16 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3876057049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:02:17.003 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:02:16 smithi022 sudo[47196]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T08:02:17.003 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:02:16 smithi022 sudo[47196]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T08:02:17.003 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:02:16 smithi022 sudo[47196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T08:02:17.003 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:02:16 smithi022 sudo[47196]: pam_unix(sudo:session): session closed for user root 2024-09-10T08:02:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:16 smithi022 ceph-mon[30854]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T08:02:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:16 smithi022 ceph-mon[30854]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T08:02:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T08:02:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:16 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1206931018' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e980a3ba-c659-4473-9633-9cbe88296d70"}]: dispatch 2024-09-10T08:02:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T08:02:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:16 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1206931018' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e980a3ba-c659-4473-9633-9cbe88296d70"}]': finished 2024-09-10T08:02:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:16 smithi022 ceph-mon[30854]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T08:02:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:17.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:16 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3876057049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:02:17.027 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:16 smithi100 ceph-mon[35102]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:17.027 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T08:02:17.027 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:16 smithi100 ceph-mon[35102]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T08:02:17.027 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T08:02:17.027 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:16 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1206931018' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e980a3ba-c659-4473-9633-9cbe88296d70"}]: dispatch 2024-09-10T08:02:17.027 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T08:02:17.027 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:16 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1206931018' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e980a3ba-c659-4473-9633-9cbe88296d70"}]': finished 2024-09-10T08:02:17.027 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:16 smithi100 ceph-mon[35102]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T08:02:17.027 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:17.027 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:16 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3876057049' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:02:17.282 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:02:17 smithi100 sudo[43418]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T08:02:17.282 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:02:17 smithi100 sudo[43418]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T08:02:17.282 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:02:17 smithi100 sudo[43418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T08:02:17.282 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:02:17 smithi100 sudo[43418]: pam_unix(sudo:session): session closed for user root 2024-09-10T08:02:17.618 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:02:17 smithi100 sudo[43421]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T08:02:17.618 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:02:17 smithi100 sudo[43421]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T08:02:17.618 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:02:17 smithi100 sudo[43421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T08:02:17.618 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:02:17 smithi100 sudo[43421]: pam_unix(sudo:session): session closed for user root 2024-09-10T08:02:17.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:17.796+0000 7f706effd640 1 -- 172.21.15.22:0/428691079 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7074098160 con 0x7f70781025a0 2024-09-10T08:02:17.812 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:17 smithi153 ceph-mon[35609]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T08:02:17.812 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:17 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:17.812 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:17 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:17.812 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:17 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:17.812 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:02:17 smithi153 sudo[44252]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T08:02:17.812 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:02:17 smithi153 sudo[44252]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T08:02:17.812 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:02:17 smithi153 sudo[44252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T08:02:17.812 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:02:17 smithi153 sudo[44252]: pam_unix(sudo:session): session closed for user root 2024-09-10T08:02:18.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:17 smithi022 ceph-mon[30854]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T08:02:18.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:17 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:18.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:17 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:18.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:17 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:18.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:17 smithi100 ceph-mon[35102]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T08:02:18.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:17 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:18.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:17 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:18.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:17 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:18.194 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:02:17 smithi153 sudo[44255]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T08:02:18.194 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:02:17 smithi153 sudo[44255]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T08:02:18.194 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:02:17 smithi153 sudo[44255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T08:02:18.194 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:02:17 smithi153 sudo[44255]: pam_unix(sudo:session): session closed for user root 2024-09-10T08:02:18.732 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:18 smithi022 sudo[47572]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T08:02:18.732 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:18 smithi022 sudo[47572]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T08:02:18.732 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:18 smithi022 sudo[47572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T08:02:18.732 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:18 smithi022 sudo[47572]: pam_unix(sudo:session): session closed for user root 2024-09-10T08:02:19.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:18 smithi022 sudo[47577]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T08:02:19.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:18 smithi022 sudo[47577]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T08:02:19.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:18 smithi022 sudo[47577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T08:02:19.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:18 smithi022 sudo[47577]: pam_unix(sudo:session): session closed for user root 2024-09-10T08:02:19.232 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:18 smithi153 sudo[44258]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T08:02:19.233 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:18 smithi153 sudo[44258]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T08:02:19.233 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:18 smithi153 sudo[44258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T08:02:19.233 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:18 smithi153 sudo[44258]: pam_unix(sudo:session): session closed for user root 2024-09-10T08:02:19.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 ceph-mon[35102]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:19.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 ceph-mon[35102]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T08:02:19.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:19.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 ceph-mon[35102]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T08:02:19.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 ceph-mon[35102]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T08:02:19.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:02:19.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:02:19.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:02:19.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:02:19.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:02:19.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:02:19.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 sudo[43424]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T08:02:19.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 sudo[43424]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T08:02:19.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 sudo[43424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T08:02:19.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 sudo[43424]: pam_unix(sudo:session): session closed for user root 2024-09-10T08:02:19.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:19 smithi022 ceph-mon[30854]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:19.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:19 smithi022 ceph-mon[30854]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T08:02:19.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:19.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:19 smithi022 ceph-mon[30854]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T08:02:19.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:19 smithi022 ceph-mon[30854]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T08:02:19.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:02:19.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:02:19.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:02:19.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:02:19.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:02:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:02:19.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 sudo[44261]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T08:02:19.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 sudo[44261]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T08:02:19.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 sudo[44261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T08:02:19.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 sudo[44261]: pam_unix(sudo:session): session closed for user root 2024-09-10T08:02:19.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 ceph-mon[35609]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:19.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 ceph-mon[35609]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T08:02:19.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:19.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 ceph-mon[35609]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T08:02:19.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 ceph-mon[35609]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T08:02:19.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:02:19.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:02:19.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:02:19.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:02:19.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:02:19.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:02:19.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 sudo[43427]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T08:02:19.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 sudo[43427]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T08:02:19.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 sudo[43427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T08:02:19.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:19 smithi100 sudo[43427]: pam_unix(sudo:session): session closed for user root 2024-09-10T08:02:20.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:20 smithi022 ceph-mon[30854]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T08:02:20.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:20 smithi022 ceph-mon[30854]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:20.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:20 smithi022 ceph-mon[30854]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T08:02:20.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:20 smithi022 ceph-mon[30854]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T08:02:20.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:02:20.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:02:20.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:02:20.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:20 smithi022 ceph-mon[30854]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T08:02:20.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:20 smithi100 ceph-mon[35102]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T08:02:20.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:20 smithi100 ceph-mon[35102]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:20.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:20 smithi100 ceph-mon[35102]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T08:02:20.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:20 smithi100 ceph-mon[35102]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T08:02:20.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:02:20.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:02:20.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:02:20.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:20 smithi100 ceph-mon[35102]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T08:02:20.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:20 smithi153 ceph-mon[35609]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T08:02:20.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:20 smithi153 ceph-mon[35609]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:20.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:20 smithi153 ceph-mon[35609]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T08:02:20.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:20 smithi153 ceph-mon[35609]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T08:02:20.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:02:20.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:02:20.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:02:20.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:20 smithi153 ceph-mon[35609]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T08:02:22.406 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:22 smithi022 ceph-mon[30854]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:22.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:22 smithi100 ceph-mon[35102]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:22.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:22 smithi153 ceph-mon[35609]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:24.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:24 smithi022 ceph-mon[30854]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:24.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:24 smithi100 ceph-mon[35102]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:24.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:24 smithi153 ceph-mon[35609]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:25.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:25 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T08:02:25.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:25 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:25.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:25 smithi022 ceph-mon[30854]: Deploying daemon osd.3 on smithi022 2024-09-10T08:02:25.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:25 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T08:02:25.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:25 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:25.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:25 smithi100 ceph-mon[35102]: Deploying daemon osd.3 on smithi022 2024-09-10T08:02:25.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:25 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-10T08:02:25.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:25 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:25.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:25 smithi153 ceph-mon[35609]: Deploying daemon osd.3 on smithi022 2024-09-10T08:02:26.467 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:26 smithi022 ceph-mon[30854]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-10T08:02:26.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:26 smithi100 ceph-mon[35102]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-10T08:02:26.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:26 smithi153 ceph-mon[35609]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-10T08:02:28.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:28 smithi022 ceph-mon[30854]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-10T08:02:28.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:28 smithi100 ceph-mon[35102]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-10T08:02:28.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:28 smithi153 ceph-mon[35609]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-10T08:02:30.495 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:30 smithi022 ceph-mon[30854]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-10T08:02:30.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:30 smithi100 ceph-mon[35102]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-10T08:02:30.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:30 smithi153 ceph-mon[35609]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-10T08:02:31.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:31 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:31.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:31 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:31.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:31 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:31.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:31 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:31.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:31 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:31.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:31 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:31.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:31 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:31.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:31 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:31.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:31 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:32.933 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:32 smithi022 ceph-mon[30854]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T08:02:33.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:32 smithi100 ceph-mon[35102]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T08:02:33.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:32 smithi153 ceph-mon[35609]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T08:02:34.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.252+0000 7f706effd640 1 -- 172.21.15.22:0/428691079 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7078062630 con 0x7f70640a2b70 2024-09-10T08:02:34.252 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 3 on host 'smithi022' 2024-09-10T08:02:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.254+0000 7f707e9a1640 1 -- 172.21.15.22:0/428691079 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f70640a2b70 msgr2=0x7f70640a5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:02:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.254+0000 7f707e9a1640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f70640a2b70 0x7f70640a5030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7068005fd0 tx=0x7f7068005850 comp rx=0 tx=0).stop 2024-09-10T08:02:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.254+0000 7f707e9a1640 1 -- 172.21.15.22:0/428691079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70781025a0 msgr2=0x7f7078197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:02:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.254+0000 7f707e9a1640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70781025a0 0x7f7078197d20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f707400c970 tx=0x7f707400ce30 comp rx=0 tx=0).stop 2024-09-10T08:02:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.254+0000 7f707e9a1640 1 -- 172.21.15.22:0/428691079 shutdown_connections 2024-09-10T08:02:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.254+0000 7f707e9a1640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f70640a2b70 0x7f70640a5030 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.254+0000 7f707e9a1640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7078107800 0x7f707819f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.254+0000 7f707e9a1640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7078104ed0 0x7f7078198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.254+0000 7f707e9a1640 1 --2- 172.21.15.22:0/428691079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70781025a0 0x7f7078197d20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.254+0000 7f707e9a1640 1 -- 172.21.15.22:0/428691079 >> 172.21.15.22:0/428691079 conn(0x7f70780fc0e0 msgr2=0x7f7078102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:02:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.255+0000 7f707e9a1640 1 -- 172.21.15.22:0/428691079 shutdown_connections 2024-09-10T08:02:34.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:02:34.255+0000 7f707e9a1640 1 -- 172.21.15.22:0/428691079 wait complete. 2024-09-10T08:02:34.826 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:34 smithi022 ceph-mon[30854]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T08:02:34.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:34 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:34 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:34 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:34.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:34 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:34.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:34 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:34 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:34.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:34 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:34 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.852 DEBUG:teuthology.orchestra.run.smithi022:osd.3> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T08:02:34.855 INFO:tasks.cephadm:Deploying osd.4 on smithi100 with /dev/vg_nvme/lv_3... 2024-09-10T08:02:34.855 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T08:02:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:34 smithi100 ceph-mon[35102]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T08:02:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:34 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:34 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:34 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:34 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:34 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:34 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:34 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:34 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:34 smithi153 ceph-mon[35609]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T08:02:34.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:34 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:34 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:34 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:34.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:34 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:34.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:34 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:34 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:34.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:34 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:34.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:34 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T08:02:36.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:36 smithi022 ceph-mon[30854]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T08:02:36.768 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:36 smithi100 ceph-mon[35102]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T08:02:36.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:36 smithi153 ceph-mon[35609]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-10T08:02:37.003 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:02:36 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3[49157]: 2024-09-10T08:02:36.598+0000 7f2807255640 -1 osd.3 0 log_to_monitors true 2024-09-10T08:02:37.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:37 smithi100 ceph-mon[35102]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T08:02:37.667 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T08:02:37.696 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_3 2024-09-10T08:02:37.733 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:37 smithi022 ceph-mon[30854]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T08:02:37.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:37 smithi153 ceph-mon[35609]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-10T08:02:37.989 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T08:02:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.487+0000 7ff190520640 1 -- 172.21.15.100:0/2060493864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1881037b0 msgr2=0x7ff18810a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:02:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.487+0000 7ff190520640 1 --2- 172.21.15.100:0/2060493864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1881037b0 0x7ff18810a040 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff180009ca0 tx=0x7ff18002a8c0 comp rx=0 tx=0).stop 2024-09-10T08:02:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.487+0000 7ff190520640 1 -- 172.21.15.100:0/2060493864 shutdown_connections 2024-09-10T08:02:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.487+0000 7ff190520640 1 --2- 172.21.15.100:0/2060493864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1881037b0 0x7ff18810a040 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.487+0000 7ff190520640 1 --2- 172.21.15.100:0/2060493864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff188102df0 0x7ff188103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.487+0000 7ff190520640 1 --2- 172.21.15.100:0/2060493864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff188101bf0 0x7ff188101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.487+0000 7ff190520640 1 -- 172.21.15.100:0/2060493864 >> 172.21.15.100:0/2060493864 conn(0x7ff1880fd3c0 msgr2=0x7ff1880ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:02:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.487+0000 7ff190520640 1 -- 172.21.15.100:0/2060493864 shutdown_connections 2024-09-10T08:02:38.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.487+0000 7ff190520640 1 -- 172.21.15.100:0/2060493864 wait complete. 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.487+0000 7ff190520640 1 Processor -- start 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.487+0000 7ff190520640 1 -- start start 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff190520640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188101bf0 0x7ff188197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff190520640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff188102df0 0x7ff188198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff190520640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1881037b0 0x7ff18819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff190520640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff18810d850 con 0x7ff1881037b0 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff190520640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff18810d6d0 con 0x7ff188101bf0 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff190520640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff18810d9d0 con 0x7ff188102df0 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff18e2bc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188101bf0 0x7ff188197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff18e2bc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188101bf0 0x7ff188197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33184/0 (socket says 172.21.15.100:33184) 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff18e2bc640 1 -- 172.21.15.100:0/3649372986 learned_addr learned my addr 172.21.15.100:0/3649372986 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff18dabb640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff188102df0 0x7ff188198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:02:38.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff18eabd640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1881037b0 0x7ff18819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:02:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff18e2bc640 1 -- 172.21.15.100:0/3649372986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff188102df0 msgr2=0x7ff188198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:02:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff18e2bc640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff188102df0 0x7ff188198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff18e2bc640 1 -- 172.21.15.100:0/3649372986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1881037b0 msgr2=0x7ff18819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:02:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff18e2bc640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1881037b0 0x7ff18819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff18e2bc640 1 -- 172.21.15.100:0/3649372986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18819fa70 con 0x7ff188101bf0 2024-09-10T08:02:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff18e2bc640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188101bf0 0x7ff188197e40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff18400d950 tx=0x7ff18400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:02:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff17f7fe640 1 -- 172.21.15.100:0/3649372986 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184017020 con 0x7ff188101bf0 2024-09-10T08:02:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff190520640 1 -- 172.21.15.100:0/3649372986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18819fd60 con 0x7ff188101bf0 2024-09-10T08:02:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff17f7fe640 1 -- 172.21.15.100:0/3649372986 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff184009c30 con 0x7ff188101bf0 2024-09-10T08:02:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff17f7fe640 1 -- 172.21.15.100:0/3649372986 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18400f740 con 0x7ff188101bf0 2024-09-10T08:02:38.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.488+0000 7ff190520640 1 -- 172.21.15.100:0/3649372986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1881a0210 con 0x7ff188101bf0 2024-09-10T08:02:38.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.489+0000 7ff190520640 1 -- 172.21.15.100:0/3649372986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff188108f20 con 0x7ff188101bf0 2024-09-10T08:02:38.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.490+0000 7ff17f7fe640 1 -- 172.21.15.100:0/3649372986 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7ff18401a020 con 0x7ff188101bf0 2024-09-10T08:02:38.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.491+0000 7ff17f7fe640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff1740a2bb0 0x7ff1740a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:02:38.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.491+0000 7ff17f7fe640 1 -- 172.21.15.100:0/3649372986 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3373+0+0 (secure 0 0 0) 0x7ff1840cd620 con 0x7ff188101bf0 2024-09-10T08:02:38.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.491+0000 7ff18dabb640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff1740a2bb0 0x7ff1740a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:02:38.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.492+0000 7ff18dabb640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff1740a2bb0 0x7ff1740a5070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff188199360 tx=0x7ff17800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:02:38.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.496+0000 7ff17f7fe640 1 -- 172.21.15.100:0/3649372986 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff184021070 con 0x7ff188101bf0 2024-09-10T08:02:38.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:38.674+0000 7ff190520640 1 -- 172.21.15.100:0/3649372986 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff188062630 con 0x7ff1740a2bb0 2024-09-10T08:02:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T08:02:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T08:02:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-10T08:02:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: Detected new or changed devices on smithi022 2024-09-10T08:02:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:02:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:02:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-10T08:02:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:38.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T08:02:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T08:02:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-10T08:02:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: Detected new or changed devices on smithi022 2024-09-10T08:02:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:02:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:02:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-10T08:02:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:38.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:38.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:38.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:38.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:38.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T08:02:38.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T08:02:38.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-10T08:02:38.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:38.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: Detected new or changed devices on smithi022 2024-09-10T08:02:38.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:38.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:38.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:02:38.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:02:38.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-10T08:02:38.971 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:38.972 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:38.972 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:38.972 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:39.253 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3[49157]: 2024-09-10T08:02:38.971+0000 7f28031d8640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T08:02:39.253 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:02:38 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3[49157]: 2024-09-10T08:02:38.976+0000 7f27faff8640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:02:39.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:39 smithi100 ceph-mon[35102]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-10T08:02:39.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:39 smithi100 ceph-mon[35102]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T08:02:39.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:39 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:39.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:39 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:39.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:39 smithi100 ceph-mon[35102]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:02:39.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:39 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:02:39.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:39 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:02:39.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:39 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:39.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:39 smithi100 ceph-mon[35102]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' 2024-09-10T08:02:39.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:39 smithi100 ceph-mon[35102]: osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276] boot 2024-09-10T08:02:39.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:39 smithi100 ceph-mon[35102]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T08:02:39.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:39 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:39.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:39 smithi153 ceph-mon[35609]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-10T08:02:39.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:39 smithi153 ceph-mon[35609]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T08:02:39.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:39 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:39.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:39 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:39.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:39 smithi153 ceph-mon[35609]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:02:39.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:39 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:02:39.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:39 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:02:39.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:39 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:39.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:39 smithi153 ceph-mon[35609]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' 2024-09-10T08:02:39.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:39 smithi153 ceph-mon[35609]: osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276] boot 2024-09-10T08:02:39.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:39 smithi153 ceph-mon[35609]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T08:02:39.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:39 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:40.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:39 smithi022 ceph-mon[30854]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-10T08:02:40.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:39 smithi022 ceph-mon[30854]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T08:02:40.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:39 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:40.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:39 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:40.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:39 smithi022 ceph-mon[30854]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:02:40.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:39 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:02:40.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:39 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:02:40.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:39 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:40.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:39 smithi022 ceph-mon[30854]: from='osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276]' entity='osd.3' 2024-09-10T08:02:40.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:39 smithi022 ceph-mon[30854]: osd.3 [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276] boot 2024-09-10T08:02:40.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:39 smithi022 ceph-mon[30854]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T08:02:40.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:39 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:02:40.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:40 smithi100 ceph-mon[35102]: purged_snaps scrub starts 2024-09-10T08:02:40.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:40 smithi100 ceph-mon[35102]: purged_snaps scrub ok 2024-09-10T08:02:40.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:40 smithi100 ceph-mon[35102]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:40.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:40 smithi100 ceph-mon[35102]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T08:02:40.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:40 smithi153 ceph-mon[35609]: purged_snaps scrub starts 2024-09-10T08:02:40.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:40 smithi153 ceph-mon[35609]: purged_snaps scrub ok 2024-09-10T08:02:40.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:40 smithi153 ceph-mon[35609]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:40.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:40 smithi153 ceph-mon[35609]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T08:02:41.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:40 smithi022 ceph-mon[30854]: purged_snaps scrub starts 2024-09-10T08:02:41.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:40 smithi022 ceph-mon[30854]: purged_snaps scrub ok 2024-09-10T08:02:41.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:40 smithi022 ceph-mon[30854]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-10T08:02:41.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:40 smithi022 ceph-mon[30854]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T08:02:41.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:41 smithi100 ceph-mon[35102]: from='client.? 172.21.15.100:0/354578373' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b37d0590-99b1-4566-96b4-9936890d4308"}]: dispatch 2024-09-10T08:02:41.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:41 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b37d0590-99b1-4566-96b4-9936890d4308"}]: dispatch 2024-09-10T08:02:41.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:41 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b37d0590-99b1-4566-96b4-9936890d4308"}]': finished 2024-09-10T08:02:41.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:41 smithi100 ceph-mon[35102]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T08:02:41.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:41 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:02:41.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:41 smithi100 ceph-mon[35102]: from='client.? 172.21.15.100:0/105468391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:02:41.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:41 smithi153 ceph-mon[35609]: from='client.? 172.21.15.100:0/354578373' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b37d0590-99b1-4566-96b4-9936890d4308"}]: dispatch 2024-09-10T08:02:41.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:41 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b37d0590-99b1-4566-96b4-9936890d4308"}]: dispatch 2024-09-10T08:02:41.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:41 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b37d0590-99b1-4566-96b4-9936890d4308"}]': finished 2024-09-10T08:02:41.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:41 smithi153 ceph-mon[35609]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T08:02:41.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:41 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:02:41.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:41 smithi153 ceph-mon[35609]: from='client.? 172.21.15.100:0/105468391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:02:42.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:41 smithi022 ceph-mon[30854]: from='client.? 172.21.15.100:0/354578373' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b37d0590-99b1-4566-96b4-9936890d4308"}]: dispatch 2024-09-10T08:02:42.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:41 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b37d0590-99b1-4566-96b4-9936890d4308"}]: dispatch 2024-09-10T08:02:42.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:41 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b37d0590-99b1-4566-96b4-9936890d4308"}]': finished 2024-09-10T08:02:42.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:41 smithi022 ceph-mon[30854]: osdmap e27: 5 total, 4 up, 5 in 2024-09-10T08:02:42.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:41 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:02:42.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:41 smithi022 ceph-mon[30854]: from='client.? 172.21.15.100:0/105468391' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:02:42.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:42 smithi100 ceph-mon[35102]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:02:42.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:42 smithi153 ceph-mon[35609]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:02:43.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:42 smithi022 ceph-mon[30854]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:02:43.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:43 smithi100 ceph-mon[35102]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T08:02:43.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:43 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:02:43.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:43 smithi153 ceph-mon[35609]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T08:02:43.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:43 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:02:44.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:43 smithi022 ceph-mon[30854]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T08:02:44.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:43 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:02:44.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:44 smithi100 ceph-mon[35102]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:02:44.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:44 smithi100 ceph-mon[35102]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T08:02:44.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:44 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:02:44.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:44 smithi153 ceph-mon[35609]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:02:44.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:44 smithi153 ceph-mon[35609]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T08:02:44.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:44 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:02:45.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:44 smithi022 ceph-mon[30854]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 123 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:02:45.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:44 smithi022 ceph-mon[30854]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T08:02:45.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:44 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:02:46.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:46 smithi100 ceph-mon[35102]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-10T08:02:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:46 smithi153 ceph-mon[35609]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-10T08:02:47.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:46 smithi022 ceph-mon[30854]: pgmap v101: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 128 KiB/s, 0 objects/s recovering 2024-09-10T08:02:48.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:48 smithi100 ceph-mon[35102]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T08:02:48.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:48 smithi153 ceph-mon[35609]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T08:02:49.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:48 smithi022 ceph-mon[30854]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T08:02:49.849 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:49 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T08:02:49.849 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:49 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:49.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:49 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T08:02:49.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:49 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:50.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:49 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-10T08:02:50.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:49 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:50.852 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:50 smithi100 ceph-mon[35102]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-10T08:02:50.852 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:50 smithi100 ceph-mon[35102]: Deploying daemon osd.4 on smithi100 2024-09-10T08:02:50.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:50 smithi153 ceph-mon[35609]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-10T08:02:50.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:50 smithi153 ceph-mon[35609]: Deploying daemon osd.4 on smithi100 2024-09-10T08:02:51.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:50 smithi022 ceph-mon[30854]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-10T08:02:51.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:50 smithi022 ceph-mon[30854]: Deploying daemon osd.4 on smithi100 2024-09-10T08:02:52.817 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:52 smithi100 ceph-mon[35102]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T08:02:52.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:52 smithi153 ceph-mon[35609]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T08:02:53.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:52 smithi022 ceph-mon[30854]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-10T08:02:54.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:54 smithi100 ceph-mon[35102]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T08:02:54.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:54 smithi153 ceph-mon[35609]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T08:02:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:54 smithi022 ceph-mon[30854]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T08:02:55.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:55.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:55.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:55.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:56.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:56.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:56.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:56.856 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:56 smithi100 ceph-mon[35102]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:02:56.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:56 smithi022 ceph-mon[30854]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:02:56.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:56 smithi153 ceph-mon[35609]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:02:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:58 smithi100 ceph-mon[35102]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:02:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:58 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:58 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:58 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:58 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:58 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:58.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:58 smithi153 ceph-mon[35609]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:02:58.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:58 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:58.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:58 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:58.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:58 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:58.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:58 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:58.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:58 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:58 smithi022 ceph-mon[30854]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:02:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:58 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:58 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:58 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:02:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:58 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:02:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:58 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:59.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.406+0000 7ff17f7fe640 1 -- 172.21.15.100:0/3649372986 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff188062630 con 0x7ff1740a2bb0 2024-09-10T08:02:59.406 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 4 on host 'smithi100' 2024-09-10T08:02:59.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.408+0000 7ff190520640 1 -- 172.21.15.100:0/3649372986 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff1740a2bb0 msgr2=0x7ff1740a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:02:59.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.408+0000 7ff190520640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff1740a2bb0 0x7ff1740a5070 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff188199360 tx=0x7ff17800b390 comp rx=0 tx=0).stop 2024-09-10T08:02:59.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.408+0000 7ff190520640 1 -- 172.21.15.100:0/3649372986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188101bf0 msgr2=0x7ff188197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:02:59.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.408+0000 7ff190520640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188101bf0 0x7ff188197e40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff18400d950 tx=0x7ff18400de10 comp rx=0 tx=0).stop 2024-09-10T08:02:59.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.408+0000 7ff190520640 1 -- 172.21.15.100:0/3649372986 shutdown_connections 2024-09-10T08:02:59.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.408+0000 7ff190520640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff1740a2bb0 0x7ff1740a5070 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:59.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.408+0000 7ff190520640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1881037b0 0x7ff18819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:59.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.408+0000 7ff190520640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff188102df0 0x7ff188198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:59.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.408+0000 7ff190520640 1 --2- 172.21.15.100:0/3649372986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff188101bf0 0x7ff188197e40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:02:59.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.408+0000 7ff190520640 1 -- 172.21.15.100:0/3649372986 >> 172.21.15.100:0/3649372986 conn(0x7ff1880fd3c0 msgr2=0x7ff1881060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:02:59.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.408+0000 7ff190520640 1 -- 172.21.15.100:0/3649372986 shutdown_connections 2024-09-10T08:02:59.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:02:59.408+0000 7ff190520640 1 -- 172.21.15.100:0/3649372986 wait complete. 2024-09-10T08:02:59.730 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:59.730 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:59.730 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:02:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:59.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:02:59.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:02:59.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:02:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:00.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:00.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:00.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:02:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:00.040 DEBUG:teuthology.orchestra.run.smithi100:osd.4> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T08:03:00.043 INFO:tasks.cephadm:Deploying osd.5 on smithi153 with /dev/vg_nvme/lv_3... 2024-09-10T08:03:00.043 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T08:03:00.298 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:03:00.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:00 smithi153 ceph-mon[35609]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:03:00.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:00 smithi100 ceph-mon[35102]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:03:01.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:00 smithi022 ceph-mon[30854]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:03:01.869 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:03:01 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4[46182]: 2024-09-10T08:03:01.611+0000 7f1495f99640 -1 osd.4 0 log_to_monitors true 2024-09-10T08:03:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:02 smithi153 ceph-mon[35609]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:03:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:02 smithi153 ceph-mon[35609]: from='osd.4 [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T08:03:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:02 smithi153 ceph-mon[35609]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T08:03:02.863 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:02 smithi100 ceph-mon[35102]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:03:02.863 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:02 smithi100 ceph-mon[35102]: from='osd.4 [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T08:03:02.863 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:02 smithi100 ceph-mon[35102]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T08:03:02.870 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T08:03:02.896 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi153:vg_nvme/lv_3 2024-09-10T08:03:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:02 smithi022 ceph-mon[30854]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:03:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:02 smithi022 ceph-mon[30854]: from='osd.4 [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T08:03:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:02 smithi022 ceph-mon[30854]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-10T08:03:03.151 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:03:03.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.630+0000 7faaab5c3640 1 -- 172.21.15.153:0/3309167913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa4100ad0 msgr2=0x7faaa4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:03.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.630+0000 7faaab5c3640 1 --2- 172.21.15.153:0/3309167913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa4100ad0 0x7faaa4100ed0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009900 tx=0x7faaa002a410 comp rx=0 tx=0).stop 2024-09-10T08:03:03.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 -- 172.21.15.153:0/3309167913 shutdown_connections 2024-09-10T08:03:03.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 --2- 172.21.15.153:0/3309167913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa4102690 0x7faaa4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:03.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 --2- 172.21.15.153:0/3309167913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaa4101cd0 0x7faaa4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:03.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 --2- 172.21.15.153:0/3309167913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa4100ad0 0x7faaa4100ed0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 -- 172.21.15.153:0/3309167913 >> 172.21.15.153:0/3309167913 conn(0x7faaa40fc280 msgr2=0x7faaa40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:03:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 -- 172.21.15.153:0/3309167913 shutdown_connections 2024-09-10T08:03:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 -- 172.21.15.153:0/3309167913 wait complete. 2024-09-10T08:03:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 Processor -- start 2024-09-10T08:03:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 -- start start 2024-09-10T08:03:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa4100ad0 0x7faaa4197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:03:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa4101cd0 0x7faaa41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:03:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaa4102690 0x7faaa419f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:03:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faaa410d8c0 con 0x7faaa4102690 2024-09-10T08:03:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faaa410d740 con 0x7faaa4101cd0 2024-09-10T08:03:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.631+0000 7faaab5c3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faaa410da40 con 0x7faaa4100ad0 2024-09-10T08:03:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaa935f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa4100ad0 0x7faaa4197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:03:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaa935f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa4100ad0 0x7faaa4197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43738/0 (socket says 172.21.15.153:43738) 2024-09-10T08:03:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaa935f640 1 -- 172.21.15.153:0/886122374 learned_addr learned my addr 172.21.15.153:0/886122374 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-10T08:03:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaa8b5e640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa4101cd0 0x7faaa41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:03:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaa9b60640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaa4102690 0x7faaa419f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:03:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaa935f640 1 -- 172.21.15.153:0/886122374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa4101cd0 msgr2=0x7faaa41984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaa935f640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa4101cd0 0x7faaa41984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaa935f640 1 -- 172.21.15.153:0/886122374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaa4102690 msgr2=0x7faaa419f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaa935f640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaa4102690 0x7faaa419f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaa935f640 1 -- 172.21.15.153:0/886122374 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa419fba0 con 0x7faaa4100ad0 2024-09-10T08:03:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaa935f640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa4100ad0 0x7faaa4197f70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faaa0031610 tx=0x7faaa00043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:03:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faa9a7fc640 1 -- 172.21.15.153:0/886122374 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa003f030 con 0x7faaa4100ad0 2024-09-10T08:03:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faa9a7fc640 1 -- 172.21.15.153:0/886122374 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faaa0003ce0 con 0x7faaa4100ad0 2024-09-10T08:03:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaab5c3640 1 -- 172.21.15.153:0/886122374 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa419fe30 con 0x7faaa4100ad0 2024-09-10T08:03:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faa9a7fc640 1 -- 172.21.15.153:0/886122374 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa0035070 con 0x7faaa4100ad0 2024-09-10T08:03:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.632+0000 7faaab5c3640 1 -- 172.21.15.153:0/886122374 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa41a02a0 con 0x7faaa4100ad0 2024-09-10T08:03:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.633+0000 7faaab5c3640 1 -- 172.21.15.153:0/886122374 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa4107f20 con 0x7faaa4100ad0 2024-09-10T08:03:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.634+0000 7faa9a7fc640 1 -- 172.21.15.153:0/886122374 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7faaa0042030 con 0x7faaa4100ad0 2024-09-10T08:03:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.635+0000 7faa9a7fc640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7faa900a2bb0 0x7faa900a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:03:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.635+0000 7faa9a7fc640 1 -- 172.21.15.153:0/886122374 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7faaa00ee500 con 0x7faaa4100ad0 2024-09-10T08:03:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.635+0000 7faaa8b5e640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7faa900a2bb0 0x7faa900a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:03:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.636+0000 7faaa8b5e640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7faa900a2bb0 0x7faa900a5070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faaa4199490 tx=0x7faa94009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:03:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.639+0000 7faa9a7fc640 1 -- 172.21.15.153:0/886122374 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faaa00bc550 con 0x7faaa4100ad0 2024-09-10T08:03:03.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:03.815+0000 7faaab5c3640 1 -- 172.21.15.153:0/886122374 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7faaa4062630 con 0x7faa900a2bb0 2024-09-10T08:03:03.815 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T08:03:03.815 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T08:03:03.815 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:03:03.815 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: from='osd.4 [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:03:03.815 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:03:03.815 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:03.815 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:03.815 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:03.815 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:03.815 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:03.816 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:03.816 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:03.816 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:03.868 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4[46182]: 2024-09-10T08:03:03.604+0000 7f1491f1c640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T08:03:03.868 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4[46182]: 2024-09-10T08:03:03.610+0000 7f148dd44640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:03:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T08:03:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T08:03:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:03:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: from='osd.4 [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:03:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:03:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:03.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:03.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:04.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T08:03:04.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T08:03:04.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:03:04.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: from='osd.4 [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:03:04.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:03:04.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:04.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:04.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:04.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:04.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:04.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:04.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:04.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:04.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:04 smithi100 ceph-mon[35102]: Detected new or changed devices on smithi100 2024-09-10T08:03:04.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:04 smithi100 ceph-mon[35102]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:03:04.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:04 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-10T08:03:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:04 smithi100 ceph-mon[35102]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-10T08:03:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:04 smithi100 ceph-mon[35102]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T08:03:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:04 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:03:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:04 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:03:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:04 smithi100 ceph-mon[35102]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:03:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:04 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:03:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:04 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:03:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:04 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:04.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:04 smithi153 ceph-mon[35609]: Detected new or changed devices on smithi100 2024-09-10T08:03:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:04 smithi153 ceph-mon[35609]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:03:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:04 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-10T08:03:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:04 smithi153 ceph-mon[35609]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-10T08:03:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:04 smithi153 ceph-mon[35609]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T08:03:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:04 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:03:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:04 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:03:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:04 smithi153 ceph-mon[35609]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:03:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:04 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:03:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:04 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:03:04.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:04 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:04 smithi022 ceph-mon[30854]: Detected new or changed devices on smithi100 2024-09-10T08:03:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:04 smithi022 ceph-mon[30854]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:03:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:04 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-10T08:03:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:04 smithi022 ceph-mon[30854]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-10T08:03:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:04 smithi022 ceph-mon[30854]: osdmap e31: 5 total, 4 up, 5 in 2024-09-10T08:03:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:04 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:03:05.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:04 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:03:05.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:04 smithi022 ceph-mon[30854]: from='client.24241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:03:05.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:04 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:03:05.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:04 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:03:05.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:04 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:05.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:05 smithi100 ceph-mon[35102]: purged_snaps scrub starts 2024-09-10T08:03:05.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:05 smithi100 ceph-mon[35102]: purged_snaps scrub ok 2024-09-10T08:03:05.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:05 smithi100 ceph-mon[35102]: osd.4 [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513] boot 2024-09-10T08:03:05.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:05 smithi100 ceph-mon[35102]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T08:03:05.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:05 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:03:05.898 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:05 smithi153 ceph-mon[35609]: purged_snaps scrub starts 2024-09-10T08:03:05.898 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:05 smithi153 ceph-mon[35609]: purged_snaps scrub ok 2024-09-10T08:03:05.898 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:05 smithi153 ceph-mon[35609]: osd.4 [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513] boot 2024-09-10T08:03:05.898 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:05 smithi153 ceph-mon[35609]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T08:03:05.898 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:05 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:03:06.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:05 smithi022 ceph-mon[30854]: purged_snaps scrub starts 2024-09-10T08:03:06.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:05 smithi022 ceph-mon[30854]: purged_snaps scrub ok 2024-09-10T08:03:06.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:05 smithi022 ceph-mon[30854]: osd.4 [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513] boot 2024-09-10T08:03:06.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:05 smithi022 ceph-mon[30854]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T08:03:06.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:05 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:03:06.817 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:06 smithi153 ceph-mon[35609]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:03:06.817 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:06 smithi153 ceph-mon[35609]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T08:03:06.817 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:06 smithi153 ceph-mon[35609]: from='client.? 172.21.15.153:0/2161119474' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6cb989a0-80a1-4a9a-8b45-51b47772b203"}]: dispatch 2024-09-10T08:03:06.818 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:06 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6cb989a0-80a1-4a9a-8b45-51b47772b203"}]: dispatch 2024-09-10T08:03:06.818 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:06 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6cb989a0-80a1-4a9a-8b45-51b47772b203"}]': finished 2024-09-10T08:03:06.818 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:06 smithi153 ceph-mon[35609]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T08:03:06.818 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:06 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:06.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:06 smithi100 ceph-mon[35102]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:03:06.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:06 smithi100 ceph-mon[35102]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T08:03:06.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:06 smithi100 ceph-mon[35102]: from='client.? 172.21.15.153:0/2161119474' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6cb989a0-80a1-4a9a-8b45-51b47772b203"}]: dispatch 2024-09-10T08:03:06.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:06 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6cb989a0-80a1-4a9a-8b45-51b47772b203"}]: dispatch 2024-09-10T08:03:06.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:06 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6cb989a0-80a1-4a9a-8b45-51b47772b203"}]': finished 2024-09-10T08:03:06.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:06 smithi100 ceph-mon[35102]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T08:03:06.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:06 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:06 smithi022 ceph-mon[30854]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-10T08:03:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:06 smithi022 ceph-mon[30854]: osdmap e33: 5 total, 5 up, 5 in 2024-09-10T08:03:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:06 smithi022 ceph-mon[30854]: from='client.? 172.21.15.153:0/2161119474' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6cb989a0-80a1-4a9a-8b45-51b47772b203"}]: dispatch 2024-09-10T08:03:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:06 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6cb989a0-80a1-4a9a-8b45-51b47772b203"}]: dispatch 2024-09-10T08:03:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:06 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6cb989a0-80a1-4a9a-8b45-51b47772b203"}]': finished 2024-09-10T08:03:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:06 smithi022 ceph-mon[30854]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T08:03:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:06 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:07.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:07 smithi153 ceph-mon[35609]: from='client.? 172.21.15.153:0/3079185108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:03:08.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:07 smithi022 ceph-mon[30854]: from='client.? 172.21.15.153:0/3079185108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:03:08.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:07 smithi100 ceph-mon[35102]: from='client.? 172.21.15.153:0/3079185108' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:03:08.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:08 smithi153 ceph-mon[35609]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:08 smithi022 ceph-mon[30854]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:09.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:08 smithi100 ceph-mon[35102]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:10.920 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:10 smithi100 ceph-mon[35102]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:10.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:10 smithi153 ceph-mon[35609]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:10 smithi022 ceph-mon[30854]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:12.916 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:12 smithi153 ceph-mon[35609]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:13.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:12 smithi022 ceph-mon[30854]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:12 smithi100 ceph-mon[35102]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:14.936 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:14 smithi153 ceph-mon[35609]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:14.936 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:14 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T08:03:14.937 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:14 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:14 smithi022 ceph-mon[30854]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:14 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T08:03:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:14 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:14 smithi100 ceph-mon[35102]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:14 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-10T08:03:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:14 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:15.929 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:15 smithi153 ceph-mon[35609]: Deploying daemon osd.5 on smithi153 2024-09-10T08:03:16.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:15 smithi022 ceph-mon[30854]: Deploying daemon osd.5 on smithi153 2024-09-10T08:03:16.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:15 smithi100 ceph-mon[35102]: Deploying daemon osd.5 on smithi153 2024-09-10T08:03:16.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:16 smithi153 ceph-mon[35609]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:16 smithi022 ceph-mon[30854]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:17.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:16 smithi100 ceph-mon[35102]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:18.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:18 smithi153 ceph-mon[35609]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:19.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:18 smithi022 ceph-mon[30854]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:19.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:18 smithi100 ceph-mon[35102]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:20.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:20 smithi153 ceph-mon[35609]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:21.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:20 smithi022 ceph-mon[30854]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:21.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:20 smithi100 ceph-mon[35102]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:21.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:21 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:21.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:21 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:21.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:21 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:22.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:21 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:22.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:21 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:22.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:21 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:21 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:21 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:21 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:23.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:22 smithi022 ceph-mon[30854]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:23.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:22 smithi100 ceph-mon[35102]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:23.161 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:22 smithi153 ceph-mon[35609]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:24.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.422+0000 7faa9a7fc640 1 -- 172.21.15.153:0/886122374 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faaa4062630 con 0x7faa900a2bb0 2024-09-10T08:03:24.422 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 5 on host 'smithi153' 2024-09-10T08:03:24.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.424+0000 7faaab5c3640 1 -- 172.21.15.153:0/886122374 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7faa900a2bb0 msgr2=0x7faa900a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.424+0000 7faaab5c3640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7faa900a2bb0 0x7faa900a5070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faaa4199490 tx=0x7faa94009110 comp rx=0 tx=0).stop 2024-09-10T08:03:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.424+0000 7faaab5c3640 1 -- 172.21.15.153:0/886122374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa4100ad0 msgr2=0x7faaa4197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.424+0000 7faaab5c3640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa4100ad0 0x7faaa4197f70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faaa0031610 tx=0x7faaa00043b0 comp rx=0 tx=0).stop 2024-09-10T08:03:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.424+0000 7faaab5c3640 1 -- 172.21.15.153:0/886122374 shutdown_connections 2024-09-10T08:03:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.424+0000 7faaab5c3640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7faa900a2bb0 0x7faa900a5070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.424+0000 7faaab5c3640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaa4102690 0x7faaa419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.424+0000 7faaab5c3640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaa4101cd0 0x7faaa41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.424+0000 7faaab5c3640 1 --2- 172.21.15.153:0/886122374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa4100ad0 0x7faaa4197f70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.424+0000 7faaab5c3640 1 -- 172.21.15.153:0/886122374 >> 172.21.15.153:0/886122374 conn(0x7faaa40fc280 msgr2=0x7faaa41050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:03:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.424+0000 7faaab5c3640 1 -- 172.21.15.153:0/886122374 shutdown_connections 2024-09-10T08:03:24.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:03:24.424+0000 7faaab5c3640 1 -- 172.21.15.153:0/886122374 wait complete. 2024-09-10T08:03:24.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:24 smithi153 ceph-mon[35609]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:24.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:24 smithi100 ceph-mon[35102]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:24.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:24.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:24.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:24.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:24.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:24.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:24.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:24.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:24 smithi022 ceph-mon[30854]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:25.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:25.056 DEBUG:teuthology.orchestra.run.smithi153:osd.5> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T08:03:25.058 INFO:tasks.cephadm:Deploying osd.6 on smithi022 with /dev/vg_nvme/lv_2... 2024-09-10T08:03:25.059 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T08:03:25.327 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:03:26.497 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:03:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:03:26.339+0000 7fa99d881640 -1 osd.5 0 log_to_monitors true 2024-09-10T08:03:26.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:26 smithi022 ceph-mon[30854]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:26.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:26 smithi022 ceph-mon[30854]: from='osd.5 [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T08:03:26.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:26 smithi022 ceph-mon[30854]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T08:03:26.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:26 smithi100 ceph-mon[35102]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:26.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:26 smithi100 ceph-mon[35102]: from='osd.5 [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T08:03:26.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:26 smithi100 ceph-mon[35102]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T08:03:26.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:26 smithi153 ceph-mon[35609]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:26.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:26 smithi153 ceph-mon[35609]: from='osd.5 [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T08:03:26.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:26 smithi153 ceph-mon[35609]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-10T08:03:27.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:27 smithi022 ceph-mon[30854]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T08:03:27.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:27 smithi022 ceph-mon[30854]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T08:03:27.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:27 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:27.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:27 smithi022 ceph-mon[30854]: from='osd.5 [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:03:27.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:27 smithi022 ceph-mon[30854]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:03:27.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:27 smithi100 ceph-mon[35102]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T08:03:27.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:27 smithi100 ceph-mon[35102]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T08:03:27.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:27 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:27.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:27 smithi100 ceph-mon[35102]: from='osd.5 [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:03:27.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:27 smithi100 ceph-mon[35102]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:03:27.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:27 smithi153 ceph-mon[35609]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T08:03:27.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:27 smithi153 ceph-mon[35609]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T08:03:27.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:27 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:27.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:27 smithi153 ceph-mon[35609]: from='osd.5 [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:03:27.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:27 smithi153 ceph-mon[35609]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:03:28.193 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:03:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:03:27.947+0000 7fa99a018640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T08:03:28.193 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:03:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:03:27.955+0000 7fa991624640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:03:28.342 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:03:28.369 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_2 2024-09-10T08:03:28.623 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:03:28.744 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:28.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-10T08:03:28.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T08:03:28.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:28.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:28.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:28.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:28.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:28.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:28.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:28.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:28.746 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:28.746 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:28.746 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:28 smithi022 ceph-mon[30854]: from='osd.5 ' entity='osd.5' 2024-09-10T08:03:28.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:28.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-10T08:03:28.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T08:03:28.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:28.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:28.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:28.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:28.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:28.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:28.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:28.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:28.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:28.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:28.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:28 smithi100 ceph-mon[35102]: from='osd.5 ' entity='osd.5' 2024-09-10T08:03:28.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:28.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-10T08:03:28.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: osdmap e36: 6 total, 5 up, 6 in 2024-09-10T08:03:28.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:28.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:28.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:28.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:28.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:28.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:28.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:28.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:28.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:28.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:28.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:28 smithi153 ceph-mon[35609]: from='osd.5 ' entity='osd.5' 2024-09-10T08:03:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.136+0000 7fa81219c640 1 -- 172.21.15.22:0/139208880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80c100b10 msgr2=0x7fa80c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.136+0000 7fa81219c640 1 --2- 172.21.15.22:0/139208880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80c100b10 0x7fa80c100f10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009ca0 tx=0x7fa7f402a8c0 comp rx=0 tx=0).stop 2024-09-10T08:03:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.136+0000 7fa81219c640 1 -- 172.21.15.22:0/139208880 shutdown_connections 2024-09-10T08:03:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.136+0000 7fa81219c640 1 --2- 172.21.15.22:0/139208880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa80c1026d0 0x7fa80c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.136+0000 7fa81219c640 1 --2- 172.21.15.22:0/139208880 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c101d10 0x7fa80c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.136+0000 7fa81219c640 1 --2- 172.21.15.22:0/139208880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80c100b10 0x7fa80c100f10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.136+0000 7fa81219c640 1 -- 172.21.15.22:0/139208880 >> 172.21.15.22:0/139208880 conn(0x7fa80c0fc2a0 msgr2=0x7fa80c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:03:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.136+0000 7fa81219c640 1 -- 172.21.15.22:0/139208880 shutdown_connections 2024-09-10T08:03:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.136+0000 7fa81219c640 1 -- 172.21.15.22:0/139208880 wait complete. 2024-09-10T08:03:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.137+0000 7fa81219c640 1 Processor -- start 2024-09-10T08:03:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.137+0000 7fa81219c640 1 -- start start 2024-09-10T08:03:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.137+0000 7fa81219c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa80c100b10 0x7fa80c19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:03:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.137+0000 7fa81219c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80c101d10 0x7fa80c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:03:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.137+0000 7fa81219c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1026d0 0x7fa80c1a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:03:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.137+0000 7fa81219c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c10c7a0 con 0x7fa80c101d10 2024-09-10T08:03:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.137+0000 7fa81219c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c10c620 con 0x7fa80c1026d0 2024-09-10T08:03:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.137+0000 7fa81219c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c10c920 con 0x7fa80c100b10 2024-09-10T08:03:29.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.137+0000 7fa80affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80c101d10 0x7fa80c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:03:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.137+0000 7fa80affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80c101d10 0x7fa80c19a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57532/0 (socket says 172.21.15.22:57532) 2024-09-10T08:03:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.137+0000 7fa80affd640 1 -- 172.21.15.22:0/2343286450 learned_addr learned my addr 172.21.15.22:0/2343286450 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:03:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa80b7fe640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa80c100b10 0x7fa80c19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:03:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa80bfff640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1026d0 0x7fa80c1a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:03:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa80affd640 1 -- 172.21.15.22:0/2343286450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa80c100b10 msgr2=0x7fa80c19a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa80affd640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa80c100b10 0x7fa80c19a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa80affd640 1 -- 172.21.15.22:0/2343286450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1026d0 msgr2=0x7fa80c1a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa80affd640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1026d0 0x7fa80c1a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa80affd640 1 -- 172.21.15.22:0/2343286450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80c1a1cb0 con 0x7fa80c101d10 2024-09-10T08:03:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa80bfff640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1026d0 0x7fa80c1a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:03:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa80affd640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80c101d10 0x7fa80c19a5c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00c920 tx=0x7fa7fc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:03:29.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa808ff9640 1 -- 172.21.15.22:0/2343286450 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc007c70 con 0x7fa80c101d10 2024-09-10T08:03:29.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa81219c640 1 -- 172.21.15.22:0/2343286450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80c1a1fa0 con 0x7fa80c101d10 2024-09-10T08:03:29.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa808ff9640 1 -- 172.21.15.22:0/2343286450 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7fc007e10 con 0x7fa80c101d10 2024-09-10T08:03:29.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa808ff9640 1 -- 172.21.15.22:0/2343286450 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc018890 con 0x7fa80c101d10 2024-09-10T08:03:29.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.138+0000 7fa81219c640 1 -- 172.21.15.22:0/2343286450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa80c1a2450 con 0x7fa80c101d10 2024-09-10T08:03:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.139+0000 7fa81219c640 1 -- 172.21.15.22:0/2343286450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa80c1a2740 con 0x7fa80c101d10 2024-09-10T08:03:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.140+0000 7fa808ff9640 1 -- 172.21.15.22:0/2343286450 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa7fc018a30 con 0x7fa80c101d10 2024-09-10T08:03:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.142+0000 7fa808ff9640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7f80a2bb0 0x7fa7f80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:03:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.142+0000 7fa80b7fe640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7f80a2bb0 0x7fa7f80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:03:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.142+0000 7fa808ff9640 1 -- 172.21.15.22:0/2343286450 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4566+0+0 (secure 0 0 0) 0x7fa7fc0ce350 con 0x7fa80c101d10 2024-09-10T08:03:29.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.142+0000 7fa80b7fe640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7f80a2bb0 0x7fa7f80a5070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4006010 tx=0x7fa7f4000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:03:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.146+0000 7fa808ff9640 1 -- 172.21.15.22:0/2343286450 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa7fc014030 con 0x7fa80c101d10 2024-09-10T08:03:29.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:29.331+0000 7fa81219c640 1 -- 172.21.15.22:0/2343286450 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa80c1a2910 con 0x7fa7f80a2bb0 2024-09-10T08:03:29.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:29 smithi022 ceph-mon[30854]: purged_snaps scrub starts 2024-09-10T08:03:29.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:29 smithi022 ceph-mon[30854]: purged_snaps scrub ok 2024-09-10T08:03:29.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:29 smithi022 ceph-mon[30854]: Detected new or changed devices on smithi153 2024-09-10T08:03:29.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:29 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi153 to 8544M 2024-09-10T08:03:29.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:29.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:29 smithi022 ceph-mon[30854]: osd.5 [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073] boot 2024-09-10T08:03:29.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:29 smithi022 ceph-mon[30854]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T08:03:29.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:29.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:03:29.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:03:29.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:29.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:29 smithi022 ceph-mon[30854]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T08:03:29.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:29 smithi100 ceph-mon[35102]: purged_snaps scrub starts 2024-09-10T08:03:29.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:29 smithi100 ceph-mon[35102]: purged_snaps scrub ok 2024-09-10T08:03:29.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:29 smithi100 ceph-mon[35102]: Detected new or changed devices on smithi153 2024-09-10T08:03:29.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:29 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi153 to 8544M 2024-09-10T08:03:29.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:29 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:29.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:29 smithi100 ceph-mon[35102]: osd.5 [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073] boot 2024-09-10T08:03:29.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:29 smithi100 ceph-mon[35102]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T08:03:29.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:29 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:29.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:29 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:03:29.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:29 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:03:29.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:29 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:29.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:29 smithi100 ceph-mon[35102]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T08:03:29.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:29 smithi153 ceph-mon[35609]: purged_snaps scrub starts 2024-09-10T08:03:29.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:29 smithi153 ceph-mon[35609]: purged_snaps scrub ok 2024-09-10T08:03:29.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:29 smithi153 ceph-mon[35609]: Detected new or changed devices on smithi153 2024-09-10T08:03:29.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:29 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi153 to 8544M 2024-09-10T08:03:29.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:29 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:29.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:29 smithi153 ceph-mon[35609]: osd.5 [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073] boot 2024-09-10T08:03:29.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:29 smithi153 ceph-mon[35609]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T08:03:29.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:29 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:03:29.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:29 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:03:29.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:29 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:03:29.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:29 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:29.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:29 smithi153 ceph-mon[35609]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T08:03:30.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:30 smithi100 ceph-mon[35102]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:30.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:30 smithi100 ceph-mon[35102]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:03:30.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:30 smithi100 ceph-mon[35102]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T08:03:30.937 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:30 smithi022 ceph-mon[30854]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:30.938 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:30 smithi022 ceph-mon[30854]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:03:30.938 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:30 smithi022 ceph-mon[30854]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T08:03:30.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:30 smithi153 ceph-mon[35609]: pgmap v131: 1 pgs: 1 peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-10T08:03:30.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:30 smithi153 ceph-mon[35609]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:03:30.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:30 smithi153 ceph-mon[35609]: osdmap e39: 6 total, 6 up, 6 in 2024-09-10T08:03:32.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:32 smithi022 ceph-mon[30854]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:32.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:32 smithi022 ceph-mon[30854]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T08:03:32.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:32 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1751262943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "294887f3-3e58-4b02-884d-4e0a70a86d16"}]: dispatch 2024-09-10T08:03:32.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:32 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1751262943' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "294887f3-3e58-4b02-884d-4e0a70a86d16"}]': finished 2024-09-10T08:03:32.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:32 smithi022 ceph-mon[30854]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T08:03:32.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:32 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:32.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:32 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3846399230' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:03:32.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:32 smithi100 ceph-mon[35102]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:32.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:32 smithi100 ceph-mon[35102]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T08:03:32.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:32 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1751262943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "294887f3-3e58-4b02-884d-4e0a70a86d16"}]: dispatch 2024-09-10T08:03:32.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:32 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1751262943' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "294887f3-3e58-4b02-884d-4e0a70a86d16"}]': finished 2024-09-10T08:03:32.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:32 smithi100 ceph-mon[35102]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T08:03:32.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:32 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:32.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:32 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3846399230' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:03:32.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:32 smithi153 ceph-mon[35609]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:32.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:32 smithi153 ceph-mon[35609]: osdmap e40: 6 total, 6 up, 6 in 2024-09-10T08:03:32.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:32 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1751262943' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "294887f3-3e58-4b02-884d-4e0a70a86d16"}]: dispatch 2024-09-10T08:03:32.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:32 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1751262943' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "294887f3-3e58-4b02-884d-4e0a70a86d16"}]': finished 2024-09-10T08:03:32.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:32 smithi153 ceph-mon[35609]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T08:03:32.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:32 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:32.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:32 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3846399230' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:03:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:34 smithi100 ceph-mon[35102]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:34.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:34 smithi153 ceph-mon[35609]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:35.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:34 smithi022 ceph-mon[30854]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:36.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:36 smithi100 ceph-mon[35102]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-10T08:03:36.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:36 smithi153 ceph-mon[35609]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-10T08:03:36.956 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:36 smithi022 ceph-mon[30854]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-10T08:03:38.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:38 smithi022 ceph-mon[30854]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-10T08:03:38.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:38 smithi100 ceph-mon[35102]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-10T08:03:38.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:38 smithi153 ceph-mon[35609]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-10T08:03:40.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:40 smithi022 ceph-mon[30854]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T08:03:40.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T08:03:40.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:40.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:40 smithi100 ceph-mon[35102]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T08:03:40.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:40 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T08:03:40.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:40 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:40.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:40 smithi153 ceph-mon[35609]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T08:03:40.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-10T08:03:40.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:41.859 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:41 smithi022 ceph-mon[30854]: Deploying daemon osd.6 on smithi022 2024-09-10T08:03:41.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:41 smithi100 ceph-mon[35102]: Deploying daemon osd.6 on smithi022 2024-09-10T08:03:41.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:41 smithi153 ceph-mon[35609]: Deploying daemon osd.6 on smithi022 2024-09-10T08:03:42.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:42 smithi022 ceph-mon[30854]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T08:03:42.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:42 smithi100 ceph-mon[35102]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T08:03:42.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:42 smithi153 ceph-mon[35609]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T08:03:44.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:44 smithi100 ceph-mon[35102]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T08:03:44.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:44 smithi153 ceph-mon[35609]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T08:03:45.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:44 smithi022 ceph-mon[30854]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T08:03:46.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:46 smithi100 ceph-mon[35102]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T08:03:46.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:46 smithi153 ceph-mon[35609]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T08:03:47.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:46 smithi022 ceph-mon[30854]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T08:03:47.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:47.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:47.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:47.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:47.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:47.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:47.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:47.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:47.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:48 smithi022 ceph-mon[30854]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:49.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:48 smithi100 ceph-mon[35102]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:49.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:48 smithi153 ceph-mon[35609]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:50.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.551+0000 7fa808ff9640 1 -- 172.21.15.22:0/2343286450 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa80c1a2910 con 0x7fa7f80a2bb0 2024-09-10T08:03:50.551 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 6 on host 'smithi022' 2024-09-10T08:03:50.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.554+0000 7fa81219c640 1 -- 172.21.15.22:0/2343286450 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7f80a2bb0 msgr2=0x7fa7f80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:50.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.554+0000 7fa81219c640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7f80a2bb0 0x7fa7f80a5070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4006010 tx=0x7fa7f4000f40 comp rx=0 tx=0).stop 2024-09-10T08:03:50.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.554+0000 7fa81219c640 1 -- 172.21.15.22:0/2343286450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80c101d10 msgr2=0x7fa80c19a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:50.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.554+0000 7fa81219c640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80c101d10 0x7fa80c19a5c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00c920 tx=0x7fa7fc00cde0 comp rx=0 tx=0).stop 2024-09-10T08:03:50.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.554+0000 7fa81219c640 1 -- 172.21.15.22:0/2343286450 shutdown_connections 2024-09-10T08:03:50.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.554+0000 7fa81219c640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7f80a2bb0 0x7fa7f80a5070 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:50.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.554+0000 7fa81219c640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1026d0 0x7fa80c1a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:50.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.554+0000 7fa81219c640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa80c101d10 0x7fa80c19a5c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:50.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.554+0000 7fa81219c640 1 --2- 172.21.15.22:0/2343286450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa80c100b10 0x7fa80c19a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:50.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.554+0000 7fa81219c640 1 -- 172.21.15.22:0/2343286450 >> 172.21.15.22:0/2343286450 conn(0x7fa80c0fc2a0 msgr2=0x7fa80c0fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:03:50.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.554+0000 7fa81219c640 1 -- 172.21.15.22:0/2343286450 shutdown_connections 2024-09-10T08:03:50.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:03:50.554+0000 7fa81219c640 1 -- 172.21.15.22:0/2343286450 wait complete. 2024-09-10T08:03:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:50 smithi022 ceph-mon[30854]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:50 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:50 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:50 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:50 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:50 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:50 smithi100 ceph-mon[35102]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:50 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:50 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:50 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:50 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:50 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:50.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:50 smithi153 ceph-mon[35609]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:50.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:50 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:50.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:50 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:50.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:50 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:50.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:50 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:50.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:50 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:51.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:51.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:51.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:51.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:51.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:51.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:51.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:03:51.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:51.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:52.173 DEBUG:teuthology.orchestra.run.smithi022:osd.6> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T08:03:52.176 INFO:tasks.cephadm:Deploying osd.7 on smithi100 with /dev/vg_nvme/lv_2... 2024-09-10T08:03:52.176 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T08:03:52.432 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T08:03:52.800 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:52 smithi100 ceph-mon[35102]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:52.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:52 smithi022 ceph-mon[30854]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:52.922 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:03:52 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:03:52.717+0000 7fa16f992640 -1 osd.6 0 log_to_monitors true 2024-09-10T08:03:52.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:52 smithi153 ceph-mon[35609]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:53.818 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:53 smithi100 ceph-mon[35102]: from='osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T08:03:53.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:53 smithi153 ceph-mon[35609]: from='osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T08:03:54.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:53 smithi022 ceph-mon[30854]: from='osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-10T08:03:54.725 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:54 smithi100 ceph-mon[35102]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:54.725 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:54 smithi100 ceph-mon[35102]: from='osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T08:03:54.725 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:54 smithi100 ceph-mon[35102]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T08:03:54.725 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:54 smithi100 ceph-mon[35102]: from='osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-10T08:03:54.725 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:54 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:54.725 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:54 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:54.725 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:54 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:54.725 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:54 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:54.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:54 smithi153 ceph-mon[35609]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:54.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:54 smithi153 ceph-mon[35609]: from='osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T08:03:54.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:54 smithi153 ceph-mon[35609]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T08:03:54.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:54 smithi153 ceph-mon[35609]: from='osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-10T08:03:54.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:54 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:54.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:54 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:54.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:54 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:54.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:54 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:55.003 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:03:54 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:03:54.564+0000 7fa16b915640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T08:03:55.003 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:03:54 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:03:54.575+0000 7fa16773d640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:03:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:54 smithi022 ceph-mon[30854]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:54 smithi022 ceph-mon[30854]: from='osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T08:03:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:54 smithi022 ceph-mon[30854]: osdmap e42: 7 total, 6 up, 7 in 2024-09-10T08:03:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:54 smithi022 ceph-mon[30854]: from='osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-10T08:03:55.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:54 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:55.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:54 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:55.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:54 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:55.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:54 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:55.028 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T08:03:55.053 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_2 2024-09-10T08:03:55.296 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T08:03:55.705 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: Detected new or changed devices on smithi022 2024-09-10T08:03:55.705 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:55.705 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:55.705 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-10T08:03:55.705 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: from='osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-10T08:03:55.705 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T08:03:55.705 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:55.706 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:55.706 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:55.706 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:55.706 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:55.706 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:55.706 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:55 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.789+0000 7feb34abc640 1 -- 172.21.15.100:0/3676890920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb30101c00 msgr2=0x7feb30102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.789+0000 7feb34abc640 1 --2- 172.21.15.100:0/3676890920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb30101c00 0x7feb30102000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb20009ca0 tx=0x7feb2002a8c0 comp rx=0 tx=0).stop 2024-09-10T08:03:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.789+0000 7feb34abc640 1 -- 172.21.15.100:0/3676890920 shutdown_connections 2024-09-10T08:03:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.789+0000 7feb34abc640 1 --2- 172.21.15.100:0/3676890920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb301037c0 0x7feb3010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.789+0000 7feb34abc640 1 --2- 172.21.15.100:0/3676890920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb30102e00 0x7feb30103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.789+0000 7feb34abc640 1 --2- 172.21.15.100:0/3676890920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb30101c00 0x7feb30102000 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.789+0000 7feb34abc640 1 -- 172.21.15.100:0/3676890920 >> 172.21.15.100:0/3676890920 conn(0x7feb300fd390 msgr2=0x7feb300ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:03:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.789+0000 7feb34abc640 1 -- 172.21.15.100:0/3676890920 shutdown_connections 2024-09-10T08:03:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.789+0000 7feb34abc640 1 -- 172.21.15.100:0/3676890920 wait complete. 2024-09-10T08:03:55.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.789+0000 7feb34abc640 1 Processor -- start 2024-09-10T08:03:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.789+0000 7feb34abc640 1 -- start start 2024-09-10T08:03:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb34abc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb30101c00 0x7feb30075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:03:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb34abc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb30102e00 0x7feb300745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:03:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb34abc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb301037c0 0x7feb30074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:03:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb34abc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7feb3010d960 con 0x7feb30102e00 2024-09-10T08:03:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb34abc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feb3010d7e0 con 0x7feb30101c00 2024-09-10T08:03:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb34abc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feb3010dae0 con 0x7feb301037c0 2024-09-10T08:03:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb30101c00 0x7feb30075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:03:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2e59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb30101c00 0x7feb30075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50674/0 (socket says 172.21.15.100:50674) 2024-09-10T08:03:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2e59c640 1 -- 172.21.15.100:0/689519329 learned_addr learned my addr 172.21.15.100:0/689519329 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T08:03:55.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2ed9d640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb301037c0 0x7feb30074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:03:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2dd9b640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb30102e00 0x7feb300745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:03:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2e59c640 1 -- 172.21.15.100:0/689519329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb301037c0 msgr2=0x7feb30074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2e59c640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb301037c0 0x7feb30074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2e59c640 1 -- 172.21.15.100:0/689519329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb30102e00 msgr2=0x7feb300745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:03:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2e59c640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb30102e00 0x7feb300745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:03:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2e59c640 1 -- 172.21.15.100:0/689519329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb300753e0 con 0x7feb30101c00 2024-09-10T08:03:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2dd9b640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb30102e00 0x7feb300745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:03:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2ed9d640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb301037c0 0x7feb30074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:03:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb2e59c640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb30101c00 0x7feb30075f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb20009430 tx=0x7feb2002f840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:03:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb1f7fe640 1 -- 172.21.15.100:0/689519329 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2002fe40 con 0x7feb30101c00 2024-09-10T08:03:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb34abc640 1 -- 172.21.15.100:0/689519329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb301a2170 con 0x7feb30101c00 2024-09-10T08:03:55.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb1f7fe640 1 -- 172.21.15.100:0/689519329 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb20030aa0 con 0x7feb30101c00 2024-09-10T08:03:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb1f7fe640 1 -- 172.21.15.100:0/689519329 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20046ab0 con 0x7feb30101c00 2024-09-10T08:03:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.790+0000 7feb34abc640 1 -- 172.21.15.100:0/689519329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb301a2700 con 0x7feb30101c00 2024-09-10T08:03:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.791+0000 7feb34abc640 1 -- 172.21.15.100:0/689519329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb30109070 con 0x7feb30101c00 2024-09-10T08:03:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.792+0000 7feb1f7fe640 1 -- 172.21.15.100:0/689519329 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7feb20030c50 con 0x7feb30101c00 2024-09-10T08:03:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.793+0000 7feb1f7fe640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7feb180a2b80 0x7feb180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:03:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.793+0000 7feb1f7fe640 1 -- 172.21.15.100:0/689519329 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7feb200efa80 con 0x7feb30101c00 2024-09-10T08:03:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.793+0000 7feb2dd9b640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7feb180a2b80 0x7feb180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:03:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.794+0000 7feb2dd9b640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7feb180a2b80 0x7feb180a5040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feb24006fd0 tx=0x7feb24008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:03:55.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.797+0000 7feb1f7fe640 1 -- 172.21.15.100:0/689519329 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb200bd6f0 con 0x7feb30101c00 2024-09-10T08:03:55.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: Detected new or changed devices on smithi022 2024-09-10T08:03:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-10T08:03:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: from='osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-10T08:03:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T08:03:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:55 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:55.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:03:55.972+0000 7feb34abc640 1 -- 172.21.15.100:0/689519329 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7feb30062630 con 0x7feb180a2b80 2024-09-10T08:03:56.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: Detected new or changed devices on smithi022 2024-09-10T08:03:56.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:56.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:03:56.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-10T08:03:56.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: from='osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-10T08:03:56.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: osdmap e43: 7 total, 6 up, 7 in 2024-09-10T08:03:56.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:56.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:56.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:56.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:56.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:03:56.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:03:56.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:55 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:56.633 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:56 smithi100 ceph-mon[35102]: purged_snaps scrub starts 2024-09-10T08:03:56.633 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:56 smithi100 ceph-mon[35102]: purged_snaps scrub ok 2024-09-10T08:03:56.633 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:56 smithi100 ceph-mon[35102]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:56.633 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:56 smithi100 ceph-mon[35102]: osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487] boot 2024-09-10T08:03:56.633 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:56 smithi100 ceph-mon[35102]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T08:03:56.633 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:56 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:56.633 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:56 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:03:56.633 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:56 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:03:56.633 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:56 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:56.904 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:56 smithi022 ceph-mon[30854]: purged_snaps scrub starts 2024-09-10T08:03:56.905 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:56 smithi022 ceph-mon[30854]: purged_snaps scrub ok 2024-09-10T08:03:56.905 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:56 smithi022 ceph-mon[30854]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:56.905 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:56 smithi022 ceph-mon[30854]: osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487] boot 2024-09-10T08:03:56.905 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:56 smithi022 ceph-mon[30854]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T08:03:56.905 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:56 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:56.905 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:56 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:03:56.905 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:56 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:03:56.905 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:56 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:56.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:56 smithi153 ceph-mon[35609]: purged_snaps scrub starts 2024-09-10T08:03:56.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:56 smithi153 ceph-mon[35609]: purged_snaps scrub ok 2024-09-10T08:03:56.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:56 smithi153 ceph-mon[35609]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-10T08:03:56.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:56 smithi153 ceph-mon[35609]: osd.6 [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487] boot 2024-09-10T08:03:56.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:56 smithi153 ceph-mon[35609]: osdmap e44: 7 total, 7 up, 7 in 2024-09-10T08:03:56.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:56 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:03:56.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:56 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:03:56.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:56 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:03:56.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:56 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:03:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:57 smithi100 ceph-mon[35102]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:03:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:57 smithi100 ceph-mon[35102]: osdmap e45: 7 total, 7 up, 7 in 2024-09-10T08:03:57.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:57 smithi022 ceph-mon[30854]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:03:57.922 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:57 smithi022 ceph-mon[30854]: osdmap e45: 7 total, 7 up, 7 in 2024-09-10T08:03:57.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:57 smithi153 ceph-mon[35609]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:03:57.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:57 smithi153 ceph-mon[35609]: osdmap e45: 7 total, 7 up, 7 in 2024-09-10T08:03:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:58 smithi100 ceph-mon[35102]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:03:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:58 smithi100 ceph-mon[35102]: from='client.? 172.21.15.100:0/1186908696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0c0ec61-4055-46f3-a4b0-39f04c735452"}]: dispatch 2024-09-10T08:03:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:58 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0c0ec61-4055-46f3-a4b0-39f04c735452"}]: dispatch 2024-09-10T08:03:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:58 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0c0ec61-4055-46f3-a4b0-39f04c735452"}]': finished 2024-09-10T08:03:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:58 smithi100 ceph-mon[35102]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T08:03:58.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:58 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:03:58.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:58 smithi153 ceph-mon[35609]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:03:58.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:58 smithi153 ceph-mon[35609]: from='client.? 172.21.15.100:0/1186908696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0c0ec61-4055-46f3-a4b0-39f04c735452"}]: dispatch 2024-09-10T08:03:58.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:58 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0c0ec61-4055-46f3-a4b0-39f04c735452"}]: dispatch 2024-09-10T08:03:58.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:58 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0c0ec61-4055-46f3-a4b0-39f04c735452"}]': finished 2024-09-10T08:03:58.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:58 smithi153 ceph-mon[35609]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T08:03:58.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:58 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:03:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:58 smithi022 ceph-mon[30854]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:03:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:58 smithi022 ceph-mon[30854]: from='client.? 172.21.15.100:0/1186908696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0c0ec61-4055-46f3-a4b0-39f04c735452"}]: dispatch 2024-09-10T08:03:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:58 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d0c0ec61-4055-46f3-a4b0-39f04c735452"}]: dispatch 2024-09-10T08:03:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:58 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d0c0ec61-4055-46f3-a4b0-39f04c735452"}]': finished 2024-09-10T08:03:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:58 smithi022 ceph-mon[30854]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T08:03:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:58 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:03:59.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:03:59 smithi100 ceph-mon[35102]: from='client.? 172.21.15.100:0/3289503293' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:03:59.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:03:59 smithi153 ceph-mon[35609]: from='client.? 172.21.15.100:0/3289503293' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:04:00.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:03:59 smithi022 ceph-mon[30854]: from='client.? 172.21.15.100:0/3289503293' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:04:00.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:00 smithi100 ceph-mon[35102]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:00.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:00 smithi153 ceph-mon[35609]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:01.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:00 smithi022 ceph-mon[30854]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:02.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:02 smithi100 ceph-mon[35102]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:02.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:02 smithi153 ceph-mon[35609]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:02 smithi022 ceph-mon[30854]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:04.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:04 smithi100 ceph-mon[35102]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:04.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:04 smithi153 ceph-mon[35609]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:04 smithi022 ceph-mon[30854]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:06.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:06 smithi100 ceph-mon[35102]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:06.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:06 smithi153 ceph-mon[35609]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:06 smithi022 ceph-mon[30854]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:07.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:07 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T08:04:07.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:07 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:07.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:07 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T08:04:07.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:07 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:08.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:07 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-10T08:04:08.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:07 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:08.858 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:08 smithi100 ceph-mon[35102]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:08.858 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:08 smithi100 ceph-mon[35102]: Deploying daemon osd.7 on smithi100 2024-09-10T08:04:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:08 smithi153 ceph-mon[35609]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:08 smithi153 ceph-mon[35609]: Deploying daemon osd.7 on smithi100 2024-09-10T08:04:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:08 smithi022 ceph-mon[30854]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:08 smithi022 ceph-mon[30854]: Deploying daemon osd.7 on smithi100 2024-09-10T08:04:10.642 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:10 smithi100 ceph-mon[35102]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:10.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:10 smithi153 ceph-mon[35609]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:10 smithi022 ceph-mon[30854]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:12.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:12 smithi100 ceph-mon[35102]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:12.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:12 smithi153 ceph-mon[35609]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:13.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:12 smithi022 ceph-mon[30854]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:13.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:04:13.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:13.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:13.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:04:13.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:13.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:14.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:04:14.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:14.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:14.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:14 smithi100 ceph-mon[35102]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:14.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:14 smithi153 ceph-mon[35609]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:14 smithi022 ceph-mon[30854]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:16.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.628+0000 7feb1f7fe640 1 -- 172.21.15.100:0/689519329 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feb30062630 con 0x7feb180a2b80 2024-09-10T08:04:16.628 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 7 on host 'smithi100' 2024-09-10T08:04:16.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.630+0000 7feb34abc640 1 -- 172.21.15.100:0/689519329 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7feb180a2b80 msgr2=0x7feb180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:04:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.630+0000 7feb34abc640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7feb180a2b80 0x7feb180a5040 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feb24006fd0 tx=0x7feb24008040 comp rx=0 tx=0).stop 2024-09-10T08:04:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.630+0000 7feb34abc640 1 -- 172.21.15.100:0/689519329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb30101c00 msgr2=0x7feb30075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:04:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.630+0000 7feb34abc640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb30101c00 0x7feb30075f90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb20009430 tx=0x7feb2002f840 comp rx=0 tx=0).stop 2024-09-10T08:04:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.630+0000 7feb34abc640 1 -- 172.21.15.100:0/689519329 shutdown_connections 2024-09-10T08:04:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.630+0000 7feb34abc640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7feb180a2b80 0x7feb180a5040 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.630+0000 7feb34abc640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb301037c0 0x7feb30074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.630+0000 7feb34abc640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7feb30102e00 0x7feb300745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.630+0000 7feb34abc640 1 --2- 172.21.15.100:0/689519329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb30101c00 0x7feb30075f90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.630+0000 7feb34abc640 1 -- 172.21.15.100:0/689519329 >> 172.21.15.100:0/689519329 conn(0x7feb300fd390 msgr2=0x7feb30106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:04:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.630+0000 7feb34abc640 1 -- 172.21.15.100:0/689519329 shutdown_connections 2024-09-10T08:04:16.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:04:16.630+0000 7feb34abc640 1 -- 172.21.15.100:0/689519329 wait complete. 2024-09-10T08:04:16.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:16 smithi100 ceph-mon[35102]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:16.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:16.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:16.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:16.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:04:16.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:16.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:16 smithi153 ceph-mon[35609]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:16.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:04:16.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:16 smithi022 ceph-mon[30854]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:04:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:17.328 DEBUG:teuthology.orchestra.run.smithi100:osd.7> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T08:04:17.330 INFO:tasks.cephadm:Deploying osd.8 on smithi153 with /dev/vg_nvme/lv_2... 2024-09-10T08:04:17.330 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T08:04:17.559 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:17 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:04:17.559 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:17 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:17.559 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:17 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:17.585 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:04:17.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:17 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:04:17.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:17 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:17.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:17 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:18.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:17 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:04:18.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:17 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:18.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:17 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:18.592 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:04:18 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:04:18.498+0000 7f224250b640 -1 osd.7 0 log_to_monitors true 2024-09-10T08:04:18.860 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:18 smithi100 ceph-mon[35102]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:18.860 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:18 smithi100 ceph-mon[35102]: from='osd.7 [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T08:04:18.860 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:18 smithi100 ceph-mon[35102]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T08:04:18.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:18 smithi153 ceph-mon[35609]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:18.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:18 smithi153 ceph-mon[35609]: from='osd.7 [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T08:04:18.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:18 smithi153 ceph-mon[35609]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T08:04:19.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:18 smithi022 ceph-mon[30854]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:19.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:18 smithi022 ceph-mon[30854]: from='osd.7 [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T08:04:19.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:18 smithi022 ceph-mon[30854]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-10T08:04:19.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:19 smithi100 ceph-mon[35102]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T08:04:19.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:19 smithi100 ceph-mon[35102]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T08:04:19.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:04:19.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:19 smithi100 ceph-mon[35102]: from='osd.7 [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:04:19.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:19 smithi100 ceph-mon[35102]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:04:19.909 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:19 smithi153 ceph-mon[35609]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T08:04:19.909 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:19 smithi153 ceph-mon[35609]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T08:04:19.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:04:19.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:19 smithi153 ceph-mon[35609]: from='osd.7 [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:04:19.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:19 smithi153 ceph-mon[35609]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:04:20.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:19 smithi022 ceph-mon[30854]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T08:04:20.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:19 smithi022 ceph-mon[30854]: osdmap e47: 8 total, 7 up, 8 in 2024-09-10T08:04:20.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:04:20.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:19 smithi022 ceph-mon[30854]: from='osd.7 [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:04:20.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:19 smithi022 ceph-mon[30854]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:04:20.235 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:04:20.052+0000 7f223eca2640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T08:04:20.235 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:04:20.060+0000 7f22362ae640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:04:20.307 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T08:04:20.334 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi153:vg_nvme/lv_2 2024-09-10T08:04:20.588 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:04:20.909 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:20.909 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-10T08:04:20.909 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T08:04:20.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:04:20.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:04:20.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='osd.7 ' entity='osd.7' 2024-09-10T08:04:20.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:20.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:20.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:20.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:20.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:20.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:20.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:20.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:04:20.910 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:20 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:21.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:21.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-10T08:04:21.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T08:04:21.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:04:21.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:04:21.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='osd.7 ' entity='osd.7' 2024-09-10T08:04:21.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:21.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:21.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:21.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:21.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:21.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:21.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:21.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:04:21.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:20 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:21.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-10T08:04:21.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-10T08:04:21.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: osdmap e48: 8 total, 7 up, 8 in 2024-09-10T08:04:21.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:04:21.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:04:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='osd.7 ' entity='osd.7' 2024-09-10T08:04:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:04:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:20 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.126+0000 7f43bf9fc640 1 -- 172.21.15.153:0/1350874379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b8102df0 msgr2=0x7f43b8103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:04:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.126+0000 7f43bf9fc640 1 --2- 172.21.15.153:0/1350874379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b8102df0 0x7f43b8103270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009860 tx=0x7f43ac02a340 comp rx=0 tx=0).stop 2024-09-10T08:04:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.126+0000 7f43bf9fc640 1 -- 172.21.15.153:0/1350874379 shutdown_connections 2024-09-10T08:04:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.126+0000 7f43bf9fc640 1 --2- 172.21.15.153:0/1350874379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b81037b0 0x7f43b810a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.126+0000 7f43bf9fc640 1 --2- 172.21.15.153:0/1350874379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b8102df0 0x7f43b8103270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.126+0000 7f43bf9fc640 1 --2- 172.21.15.153:0/1350874379 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43b8101bf0 0x7f43b8101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.126+0000 7f43bf9fc640 1 -- 172.21.15.153:0/1350874379 >> 172.21.15.153:0/1350874379 conn(0x7f43b80fd3c0 msgr2=0x7f43b80ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:04:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.126+0000 7f43bf9fc640 1 -- 172.21.15.153:0/1350874379 shutdown_connections 2024-09-10T08:04:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.126+0000 7f43bf9fc640 1 -- 172.21.15.153:0/1350874379 wait complete. 2024-09-10T08:04:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.126+0000 7f43bf9fc640 1 Processor -- start 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bf9fc640 1 -- start start 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bf9fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b8101bf0 0x7f43b8197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bf9fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b8102df0 0x7f43b8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bf9fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43b81037b0 0x7f43b819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bf9fc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43b810d850 con 0x7f43b81037b0 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bf9fc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f43b810d6d0 con 0x7f43b8101bf0 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bf9fc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f43b810d9d0 con 0x7f43b8102df0 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bcf97640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b8102df0 0x7f43b8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bcf97640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b8102df0 0x7f43b8198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59950/0 (socket says 172.21.15.153:59950) 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bcf97640 1 -- 172.21.15.153:0/2410538502 learned_addr learned my addr 172.21.15.153:0/2410538502 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bd798640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b8101bf0 0x7f43b8197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bdf99640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43b81037b0 0x7f43b819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:04:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bcf97640 1 -- 172.21.15.153:0/2410538502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b8101bf0 msgr2=0x7f43b8197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bcf97640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b8101bf0 0x7f43b8197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bcf97640 1 -- 172.21.15.153:0/2410538502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43b81037b0 msgr2=0x7f43b819f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bcf97640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43b81037b0 0x7f43b819f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bcf97640 1 -- 172.21.15.153:0/2410538502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b819fb00 con 0x7f43b8102df0 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bcf97640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b8102df0 0x7f43b8198410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f43ac005940 tx=0x7f43ac033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43b67fc640 1 -- 172.21.15.153:0/2410538502 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac03f020 con 0x7f43b8102df0 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43b67fc640 1 -- 172.21.15.153:0/2410538502 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43ac030850 con 0x7f43b8102df0 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43bf9fc640 1 -- 172.21.15.153:0/2410538502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b819fd90 con 0x7f43b8102df0 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.127+0000 7f43b67fc640 1 -- 172.21.15.153:0/2410538502 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac037040 con 0x7f43b8102df0 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.128+0000 7f43bf9fc640 1 -- 172.21.15.153:0/2410538502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b81a0210 con 0x7f43b8102df0 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.128+0000 7f43bf9fc640 1 -- 172.21.15.153:0/2410538502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b8108fc0 con 0x7f43b8102df0 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.130+0000 7f43b67fc640 1 -- 172.21.15.153:0/2410538502 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f43ac042020 con 0x7f43b8102df0 2024-09-10T08:04:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.130+0000 7f43b67fc640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f43a00a2bb0 0x7f43a00a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:04:21.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.130+0000 7f43b67fc640 1 -- 172.21.15.153:0/2410538502 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5430+0+0 (secure 0 0 0) 0x7f43ac0eec60 con 0x7f43b8102df0 2024-09-10T08:04:21.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.131+0000 7f43bd798640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f43a00a2bb0 0x7f43a00a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:04:21.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.131+0000 7f43bd798640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f43a00a2bb0 0x7f43a00a5070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f43b8102c50 tx=0x7f43a8009670 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:04:21.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.133+0000 7f43b67fc640 1 -- 172.21.15.153:0/2410538502 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f43ac049020 con 0x7f43b8102df0 2024-09-10T08:04:21.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:21.308+0000 7f43bf9fc640 1 -- 172.21.15.153:0/2410538502 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f43b8062630 con 0x7f43a00a2bb0 2024-09-10T08:04:21.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:21 smithi153 ceph-mon[35609]: purged_snaps scrub starts 2024-09-10T08:04:21.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:21 smithi153 ceph-mon[35609]: purged_snaps scrub ok 2024-09-10T08:04:21.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:21 smithi153 ceph-mon[35609]: Detected new or changed devices on smithi100 2024-09-10T08:04:21.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:21 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-10T08:04:21.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:21 smithi153 ceph-mon[35609]: osd.7 [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921] boot 2024-09-10T08:04:21.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:21 smithi153 ceph-mon[35609]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T08:04:21.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:21 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:04:21.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:21 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:04:21.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:21 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:04:21.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:21 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:22.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:21 smithi022 ceph-mon[30854]: purged_snaps scrub starts 2024-09-10T08:04:22.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:21 smithi022 ceph-mon[30854]: purged_snaps scrub ok 2024-09-10T08:04:22.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:21 smithi022 ceph-mon[30854]: Detected new or changed devices on smithi100 2024-09-10T08:04:22.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:21 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-10T08:04:22.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:21 smithi022 ceph-mon[30854]: osd.7 [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921] boot 2024-09-10T08:04:22.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:21 smithi022 ceph-mon[30854]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T08:04:22.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:21 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:04:22.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:21 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:04:22.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:21 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:04:22.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:21 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:21 smithi100 ceph-mon[35102]: purged_snaps scrub starts 2024-09-10T08:04:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:21 smithi100 ceph-mon[35102]: purged_snaps scrub ok 2024-09-10T08:04:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:21 smithi100 ceph-mon[35102]: Detected new or changed devices on smithi100 2024-09-10T08:04:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:21 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-10T08:04:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:21 smithi100 ceph-mon[35102]: osd.7 [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921] boot 2024-09-10T08:04:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:21 smithi100 ceph-mon[35102]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T08:04:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:21 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:04:22.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:21 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:04:22.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:21 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:04:22.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:21 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:22.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:22 smithi153 ceph-mon[35609]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:22 smithi153 ceph-mon[35609]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:04:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:22 smithi153 ceph-mon[35609]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T08:04:23.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:22 smithi022 ceph-mon[30854]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:23.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:22 smithi022 ceph-mon[30854]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:04:23.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:22 smithi022 ceph-mon[30854]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T08:04:23.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:22 smithi100 ceph-mon[35102]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:23.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:22 smithi100 ceph-mon[35102]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:04:23.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:22 smithi100 ceph-mon[35102]: osdmap e50: 8 total, 8 up, 8 in 2024-09-10T08:04:23.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:23 smithi100 ceph-mon[35102]: osdmap e51: 8 total, 8 up, 8 in 2024-09-10T08:04:23.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:23 smithi153 ceph-mon[35609]: osdmap e51: 8 total, 8 up, 8 in 2024-09-10T08:04:24.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:23 smithi022 ceph-mon[30854]: osdmap e51: 8 total, 8 up, 8 in 2024-09-10T08:04:24.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:24 smithi153 ceph-mon[35609]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:24 smithi153 ceph-mon[35609]: osdmap e52: 8 total, 8 up, 8 in 2024-09-10T08:04:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:24 smithi153 ceph-mon[35609]: from='client.? 172.21.15.153:0/1635600545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bda45a16-742e-4eda-b4d4-e01d6f3dc92e"}]: dispatch 2024-09-10T08:04:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:24 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bda45a16-742e-4eda-b4d4-e01d6f3dc92e"}]: dispatch 2024-09-10T08:04:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:24 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bda45a16-742e-4eda-b4d4-e01d6f3dc92e"}]': finished 2024-09-10T08:04:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:24 smithi153 ceph-mon[35609]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T08:04:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:24 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:24.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:24 smithi153 ceph-mon[35609]: from='client.? 172.21.15.153:0/3971042017' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:04:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:24 smithi022 ceph-mon[30854]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:24 smithi022 ceph-mon[30854]: osdmap e52: 8 total, 8 up, 8 in 2024-09-10T08:04:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:24 smithi022 ceph-mon[30854]: from='client.? 172.21.15.153:0/1635600545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bda45a16-742e-4eda-b4d4-e01d6f3dc92e"}]: dispatch 2024-09-10T08:04:25.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:24 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bda45a16-742e-4eda-b4d4-e01d6f3dc92e"}]: dispatch 2024-09-10T08:04:25.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:24 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bda45a16-742e-4eda-b4d4-e01d6f3dc92e"}]': finished 2024-09-10T08:04:25.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:24 smithi022 ceph-mon[30854]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T08:04:25.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:24 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:25.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:24 smithi022 ceph-mon[30854]: from='client.? 172.21.15.153:0/3971042017' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:04:25.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:24 smithi100 ceph-mon[35102]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:25.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:24 smithi100 ceph-mon[35102]: osdmap e52: 8 total, 8 up, 8 in 2024-09-10T08:04:25.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:24 smithi100 ceph-mon[35102]: from='client.? 172.21.15.153:0/1635600545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bda45a16-742e-4eda-b4d4-e01d6f3dc92e"}]: dispatch 2024-09-10T08:04:25.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:24 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bda45a16-742e-4eda-b4d4-e01d6f3dc92e"}]: dispatch 2024-09-10T08:04:25.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:24 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bda45a16-742e-4eda-b4d4-e01d6f3dc92e"}]': finished 2024-09-10T08:04:25.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:24 smithi100 ceph-mon[35102]: osdmap e53: 9 total, 8 up, 9 in 2024-09-10T08:04:25.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:24 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:25.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:24 smithi100 ceph-mon[35102]: from='client.? 172.21.15.153:0/3971042017' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:04:26.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:26 smithi153 ceph-mon[35609]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:27.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:26 smithi022 ceph-mon[30854]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:27.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:26 smithi100 ceph-mon[35102]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:28.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:28 smithi153 ceph-mon[35609]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:29.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:28 smithi022 ceph-mon[30854]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:29.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:28 smithi100 ceph-mon[35102]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:30.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:30 smithi153 ceph-mon[35609]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:31.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:30 smithi022 ceph-mon[30854]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:31.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:30 smithi100 ceph-mon[35102]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:32.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:32 smithi153 ceph-mon[35609]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:32.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:32 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T08:04:32.925 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:32 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:33.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:32 smithi022 ceph-mon[30854]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:33.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:32 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T08:04:33.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:32 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:33.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:32 smithi100 ceph-mon[35102]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:33.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:32 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-10T08:04:33.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:32 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:33.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:33 smithi153 ceph-mon[35609]: Deploying daemon osd.8 on smithi153 2024-09-10T08:04:34.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:33 smithi022 ceph-mon[30854]: Deploying daemon osd.8 on smithi153 2024-09-10T08:04:34.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:33 smithi100 ceph-mon[35102]: Deploying daemon osd.8 on smithi153 2024-09-10T08:04:34.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:34 smithi153 ceph-mon[35609]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:35.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:34 smithi022 ceph-mon[30854]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:35.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:34 smithi100 ceph-mon[35102]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:36.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:36 smithi153 ceph-mon[35609]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:37.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:36 smithi022 ceph-mon[30854]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:37.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:36 smithi100 ceph-mon[35102]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:38 smithi153 ceph-mon[35609]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:04:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:38.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:39.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:38 smithi022 ceph-mon[30854]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:39.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:04:39.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:39.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:39.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:38 smithi100 ceph-mon[35102]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:39.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:04:39.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:39.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:40.941 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:40 smithi100 ceph-mon[35102]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:40.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:40 smithi153 ceph-mon[35609]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:41.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:40 smithi022 ceph-mon[30854]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:41.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.657+0000 7f43b67fc640 1 -- 172.21.15.153:0/2410538502 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f43b8062630 con 0x7f43a00a2bb0 2024-09-10T08:04:41.657 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 8 on host 'smithi153' 2024-09-10T08:04:41.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.660+0000 7f43bf9fc640 1 -- 172.21.15.153:0/2410538502 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f43a00a2bb0 msgr2=0x7f43a00a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:04:41.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.660+0000 7f43bf9fc640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f43a00a2bb0 0x7f43a00a5070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f43b8102c50 tx=0x7f43a8009670 comp rx=0 tx=0).stop 2024-09-10T08:04:41.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.660+0000 7f43bf9fc640 1 -- 172.21.15.153:0/2410538502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b8102df0 msgr2=0x7f43b8198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:04:41.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.660+0000 7f43bf9fc640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b8102df0 0x7f43b8198410 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f43ac005940 tx=0x7f43ac033d90 comp rx=0 tx=0).stop 2024-09-10T08:04:41.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.660+0000 7f43bf9fc640 1 -- 172.21.15.153:0/2410538502 shutdown_connections 2024-09-10T08:04:41.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.660+0000 7f43bf9fc640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f43a00a2bb0 0x7f43a00a5070 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:41.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.660+0000 7f43bf9fc640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43b81037b0 0x7f43b819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:41.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.660+0000 7f43bf9fc640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b8102df0 0x7f43b8198410 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:41.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.660+0000 7f43bf9fc640 1 --2- 172.21.15.153:0/2410538502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b8101bf0 0x7f43b8197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:41.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.660+0000 7f43bf9fc640 1 -- 172.21.15.153:0/2410538502 >> 172.21.15.153:0/2410538502 conn(0x7f43b80fd3c0 msgr2=0x7f43b8106190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:04:41.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.660+0000 7f43bf9fc640 1 -- 172.21.15.153:0/2410538502 shutdown_connections 2024-09-10T08:04:41.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:04:41.660+0000 7f43bf9fc640 1 -- 172.21.15.153:0/2410538502 wait complete. 2024-09-10T08:04:42.340 DEBUG:teuthology.orchestra.run.smithi153:osd.8> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T08:04:42.342 INFO:tasks.cephadm:Deploying osd.9 on smithi022 with /dev/vg_nvme/lv_1... 2024-09-10T08:04:42.343 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T08:04:42.613 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:04:42.824 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:42 smithi153 ceph-mon[35609]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:42.824 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:42.824 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:42.824 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:42.824 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:42.980 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:42 smithi022 ceph-mon[30854]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:42.980 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:42.980 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:42.980 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:42.981 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:43.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:42 smithi100 ceph-mon[35102]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:43.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:43.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:43.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:43.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:44.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:04:44 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:04:44.060+0000 7ffb6693f640 -1 osd.8 0 log_to_monitors true 2024-09-10T08:04:44.777 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:44 smithi022 ceph-mon[30854]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:44.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:44 smithi022 ceph-mon[30854]: from='osd.8 [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T08:04:44.778 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:44 smithi022 ceph-mon[30854]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T08:04:44.889 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:44 smithi153 ceph-mon[35609]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:44.889 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:44 smithi153 ceph-mon[35609]: from='osd.8 [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T08:04:44.889 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:44 smithi153 ceph-mon[35609]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T08:04:45.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:44 smithi100 ceph-mon[35102]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:45.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:44 smithi100 ceph-mon[35102]: from='osd.8 [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T08:04:45.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:44 smithi100 ceph-mon[35102]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-10T08:04:45.530 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:04:45.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi022:vg_nvme/lv_1 2024-09-10T08:04:45.812 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:04:45.934 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T08:04:45.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: osdmap e54: 9 total, 8 up, 9 in 2024-09-10T08:04:45.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:45.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='osd.8 [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:04:45.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:04:45.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:45.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:45.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:45.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:45.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:45.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:45.935 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:45.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:04:45.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:45.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:04:45.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:45.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:04:45.936 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:45.943 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:04:45.667+0000 7ffb628c2640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T08:04:45.943 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:04:45.676+0000 7ffb5e6ea640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:04:45.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T08:04:45.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: osdmap e54: 9 total, 8 up, 9 in 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='osd.8 [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:45.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:04:45.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:45.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:04:45.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:46.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: osdmap e54: 9 total, 8 up, 9 in 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='osd.8 [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:04:46.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:46.120 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:04:46.120 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:46.120 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:04:46.120 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:04:46.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.324+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2446765536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb948102e00 msgr2=0x7fb948103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:04:46.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.324+0000 7fb94d3c4640 1 --2- 172.21.15.22:0/2446765536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb948102e00 0x7fb948103280 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009900 tx=0x7fb93c02a410 comp rx=0 tx=0).stop 2024-09-10T08:04:46.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.324+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2446765536 shutdown_connections 2024-09-10T08:04:46.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.324+0000 7fb94d3c4640 1 --2- 172.21.15.22:0/2446765536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9481037c0 0x7fb94810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:46.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.324+0000 7fb94d3c4640 1 --2- 172.21.15.22:0/2446765536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb948102e00 0x7fb948103280 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:46.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.324+0000 7fb94d3c4640 1 --2- 172.21.15.22:0/2446765536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb948101c00 0x7fb948102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.324+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2446765536 >> 172.21.15.22:0/2446765536 conn(0x7fb9480fd390 msgr2=0x7fb9480ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.324+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2446765536 shutdown_connections 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.324+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2446765536 wait complete. 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.325+0000 7fb94d3c4640 1 Processor -- start 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.325+0000 7fb94d3c4640 1 -- start start 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.325+0000 7fb94d3c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb948101c00 0x7fb948197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.325+0000 7fb94d3c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb948102e00 0x7fb948198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.325+0000 7fb94d3c4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9481037c0 0x7fb94819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.325+0000 7fb94d3c4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb94810d860 con 0x7fb948101c00 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.325+0000 7fb94d3c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb94810d6e0 con 0x7fb948102e00 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.325+0000 7fb94d3c4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb94810d9e0 con 0x7fb9481037c0 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.325+0000 7fb946ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb948101c00 0x7fb948197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:04:46.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.325+0000 7fb946ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb948101c00 0x7fb948197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41496/0 (socket says 172.21.15.22:41496) 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.325+0000 7fb946ffd640 1 -- 172.21.15.22:0/2457775720 learned_addr learned my addr 172.21.15.22:0/2457775720 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb9467fc640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb948102e00 0x7fb948198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb9477fe640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9481037c0 0x7fb94819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb946ffd640 1 -- 172.21.15.22:0/2457775720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9481037c0 msgr2=0x7fb94819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb946ffd640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9481037c0 0x7fb94819f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb946ffd640 1 -- 172.21.15.22:0/2457775720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb948102e00 msgr2=0x7fb948198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb946ffd640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb948102e00 0x7fb948198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb946ffd640 1 -- 172.21.15.22:0/2457775720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb94819fb10 con 0x7fb948101c00 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb9467fc640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb948102e00 0x7fb948198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb946ffd640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb948101c00 0x7fb948197ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb93800d770 tx=0x7fb93800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb92ffff640 1 -- 172.21.15.22:0/2457775720 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938017070 con 0x7fb948101c00 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb92ffff640 1 -- 172.21.15.22:0/2457775720 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb938009c30 con 0x7fb948101c00 2024-09-10T08:04:46.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2457775720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb94819fe00 con 0x7fb948101c00 2024-09-10T08:04:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb92ffff640 1 -- 172.21.15.22:0/2457775720 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938003dd0 con 0x7fb948101c00 2024-09-10T08:04:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.326+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2457775720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9481a0250 con 0x7fb948101c00 2024-09-10T08:04:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.327+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2457775720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9481090a0 con 0x7fb948101c00 2024-09-10T08:04:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.328+0000 7fb92ffff640 1 -- 172.21.15.22:0/2457775720 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fb938004000 con 0x7fb948101c00 2024-09-10T08:04:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.329+0000 7fb92ffff640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb9300a2bb0 0x7fb9300a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:04:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.329+0000 7fb9467fc640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb9300a2bb0 0x7fb9300a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:04:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.329+0000 7fb92ffff640 1 -- 172.21.15.22:0/2457775720 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5549+0+0 (secure 0 0 0) 0x7fb9380ce360 con 0x7fb948101c00 2024-09-10T08:04:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.329+0000 7fb9467fc640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb9300a2bb0 0x7fb9300a5070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb93c000c00 tx=0x7fb93c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:04:46.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.334+0000 7fb92ffff640 1 -- 172.21.15.22:0/2457775720 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb93809bd90 con 0x7fb948101c00 2024-09-10T08:04:46.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:04:46.519+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2457775720 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb948062630 con 0x7fb9300a2bb0 2024-09-10T08:04:46.940 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:46 smithi022 ceph-mon[30854]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:46.940 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:46 smithi022 ceph-mon[30854]: Detected new or changed devices on smithi153 2024-09-10T08:04:46.941 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:46 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi153 to 5696M 2024-09-10T08:04:46.941 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:46 smithi022 ceph-mon[30854]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-10T08:04:46.941 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:46 smithi022 ceph-mon[30854]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T08:04:46.941 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:46.941 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:46.941 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:04:46.941 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:04:46.941 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:46.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:46 smithi153 ceph-mon[35609]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:46 smithi153 ceph-mon[35609]: Detected new or changed devices on smithi153 2024-09-10T08:04:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:46 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi153 to 5696M 2024-09-10T08:04:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:46 smithi153 ceph-mon[35609]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-10T08:04:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:46 smithi153 ceph-mon[35609]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T08:04:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:04:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:04:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:47.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:46 smithi100 ceph-mon[35102]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:47.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:46 smithi100 ceph-mon[35102]: Detected new or changed devices on smithi153 2024-09-10T08:04:47.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:46 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi153 to 5696M 2024-09-10T08:04:47.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:46 smithi100 ceph-mon[35102]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-10T08:04:47.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:46 smithi100 ceph-mon[35102]: osdmap e55: 9 total, 8 up, 9 in 2024-09-10T08:04:47.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:04:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:04:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:47.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:47 smithi153 ceph-mon[35609]: purged_snaps scrub starts 2024-09-10T08:04:47.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:47 smithi153 ceph-mon[35609]: purged_snaps scrub ok 2024-09-10T08:04:47.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:47 smithi153 ceph-mon[35609]: from='client.14433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:04:47.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:47.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:47 smithi153 ceph-mon[35609]: osd.8 [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941] boot 2024-09-10T08:04:47.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:47 smithi153 ceph-mon[35609]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T08:04:47.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:47 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:47.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:47 smithi022 ceph-mon[30854]: purged_snaps scrub starts 2024-09-10T08:04:47.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:47 smithi022 ceph-mon[30854]: purged_snaps scrub ok 2024-09-10T08:04:47.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:47 smithi022 ceph-mon[30854]: from='client.14433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:04:47.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:47.948 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:47 smithi022 ceph-mon[30854]: osd.8 [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941] boot 2024-09-10T08:04:47.948 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:47 smithi022 ceph-mon[30854]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T08:04:47.948 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:47 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:48.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:47 smithi100 ceph-mon[35102]: purged_snaps scrub starts 2024-09-10T08:04:48.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:47 smithi100 ceph-mon[35102]: purged_snaps scrub ok 2024-09-10T08:04:48.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:47 smithi100 ceph-mon[35102]: from='client.14433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:04:48.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:48.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:47 smithi100 ceph-mon[35102]: osd.8 [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941] boot 2024-09-10T08:04:48.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:47 smithi100 ceph-mon[35102]: osdmap e56: 9 total, 9 up, 9 in 2024-09-10T08:04:48.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:47 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:04:48.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:48 smithi153 ceph-mon[35609]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:48.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:48 smithi153 ceph-mon[35609]: osdmap e57: 9 total, 9 up, 9 in 2024-09-10T08:04:49.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:48 smithi022 ceph-mon[30854]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:49.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:48 smithi022 ceph-mon[30854]: osdmap e57: 9 total, 9 up, 9 in 2024-09-10T08:04:49.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:48 smithi100 ceph-mon[35102]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-10T08:04:49.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:48 smithi100 ceph-mon[35102]: osdmap e57: 9 total, 9 up, 9 in 2024-09-10T08:04:49.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:49 smithi022 ceph-mon[30854]: osdmap e58: 9 total, 9 up, 9 in 2024-09-10T08:04:49.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:49 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/8045893' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48bd3544-9028-4535-801b-3d39ecadf48e"}]: dispatch 2024-09-10T08:04:49.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:49 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/8045893' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48bd3544-9028-4535-801b-3d39ecadf48e"}]': finished 2024-09-10T08:04:49.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:49 smithi022 ceph-mon[30854]: osdmap e59: 10 total, 9 up, 10 in 2024-09-10T08:04:49.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:49 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:04:49.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:49 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3527833355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:04:49.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:49 smithi153 ceph-mon[35609]: osdmap e58: 9 total, 9 up, 9 in 2024-09-10T08:04:49.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:49 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/8045893' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48bd3544-9028-4535-801b-3d39ecadf48e"}]: dispatch 2024-09-10T08:04:49.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:49 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/8045893' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48bd3544-9028-4535-801b-3d39ecadf48e"}]': finished 2024-09-10T08:04:49.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:49 smithi153 ceph-mon[35609]: osdmap e59: 10 total, 9 up, 10 in 2024-09-10T08:04:49.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:49 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:04:49.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:49 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3527833355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:04:50.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:49 smithi100 ceph-mon[35102]: osdmap e58: 9 total, 9 up, 9 in 2024-09-10T08:04:50.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:49 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/8045893' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48bd3544-9028-4535-801b-3d39ecadf48e"}]: dispatch 2024-09-10T08:04:50.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:49 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/8045893' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48bd3544-9028-4535-801b-3d39ecadf48e"}]': finished 2024-09-10T08:04:50.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:49 smithi100 ceph-mon[35102]: osdmap e59: 10 total, 9 up, 10 in 2024-09-10T08:04:50.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:49 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:04:50.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:49 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3527833355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:04:50.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:50 smithi153 ceph-mon[35609]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:04:50.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:50 smithi153 ceph-mon[35609]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T08:04:50.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:50 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:04:51.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:50 smithi022 ceph-mon[30854]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:04:51.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:50 smithi022 ceph-mon[30854]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T08:04:51.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:50 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:04:51.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:50 smithi100 ceph-mon[35102]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:04:51.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:50 smithi100 ceph-mon[35102]: osdmap e60: 10 total, 9 up, 10 in 2024-09-10T08:04:51.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:50 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:04:52.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:52 smithi153 ceph-mon[35609]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T08:04:53.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:52 smithi022 ceph-mon[30854]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T08:04:53.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:52 smithi100 ceph-mon[35102]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T08:04:54.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:54 smithi153 ceph-mon[35609]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T08:04:54.988 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:54 smithi022 ceph-mon[30854]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T08:04:55.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:54 smithi100 ceph-mon[35102]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T08:04:56.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:56 smithi153 ceph-mon[35609]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T08:04:57.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:56 smithi022 ceph-mon[30854]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T08:04:57.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:56 smithi100 ceph-mon[35102]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T08:04:57.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:57 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T08:04:57.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:57 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:58.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:57 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T08:04:58.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:57 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:58.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:57 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-10T08:04:58.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:57 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:04:58.873 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:58 smithi022 ceph-mon[30854]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T08:04:58.873 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:04:58 smithi022 ceph-mon[30854]: Deploying daemon osd.9 on smithi022 2024-09-10T08:04:59.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:58 smithi100 ceph-mon[35102]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T08:04:59.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:04:58 smithi100 ceph-mon[35102]: Deploying daemon osd.9 on smithi022 2024-09-10T08:04:59.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:58 smithi153 ceph-mon[35609]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T08:04:59.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:04:58 smithi153 ceph-mon[35609]: Deploying daemon osd.9 on smithi022 2024-09-10T08:05:01.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:00 smithi022 ceph-mon[30854]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T08:05:01.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:00 smithi100 ceph-mon[35102]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T08:05:01.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:00 smithi153 ceph-mon[35609]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T08:05:02.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:02 smithi022 ceph-mon[30854]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T08:05:03.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:02 smithi100 ceph-mon[35102]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T08:05:03.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:02 smithi153 ceph-mon[35609]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-10T08:05:04.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:04.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:04.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:04.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:04.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:04.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:04.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:04.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:04.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:04.976 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:04 smithi022 ceph-mon[30854]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:05.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:04 smithi100 ceph-mon[35102]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:05.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:04 smithi153 ceph-mon[35609]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:06.970 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:06 smithi022 ceph-mon[30854]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:06.970 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:06 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:06.970 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:06 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:06 smithi100 ceph-mon[35102]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:06 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:06 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:07.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:06 smithi153 ceph-mon[35609]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:07.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:06 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:07.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:06 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:07.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.301+0000 7fb92ffff640 1 -- 172.21.15.22:0/2457775720 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb948062630 con 0x7fb9300a2bb0 2024-09-10T08:05:07.300 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 9 on host 'smithi022' 2024-09-10T08:05:07.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.303+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2457775720 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb9300a2bb0 msgr2=0x7fb9300a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:07.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.303+0000 7fb94d3c4640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb9300a2bb0 0x7fb9300a5070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb93c000c00 tx=0x7fb93c031400 comp rx=0 tx=0).stop 2024-09-10T08:05:07.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.303+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2457775720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb948101c00 msgr2=0x7fb948197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:07.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.303+0000 7fb94d3c4640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb948101c00 0x7fb948197ee0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb93800d770 tx=0x7fb93800dc30 comp rx=0 tx=0).stop 2024-09-10T08:05:07.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.303+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2457775720 shutdown_connections 2024-09-10T08:05:07.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.303+0000 7fb94d3c4640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb9300a2bb0 0x7fb9300a5070 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:07.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.303+0000 7fb94d3c4640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9481037c0 0x7fb94819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:07.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.303+0000 7fb94d3c4640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb948102e00 0x7fb948198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:07.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.303+0000 7fb94d3c4640 1 --2- 172.21.15.22:0/2457775720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb948101c00 0x7fb948197ee0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:07.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.303+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2457775720 >> 172.21.15.22:0/2457775720 conn(0x7fb9480fd390 msgr2=0x7fb948106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:05:07.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.303+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2457775720 shutdown_connections 2024-09-10T08:05:07.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:07.303+0000 7fb94d3c4640 1 -- 172.21.15.22:0/2457775720 wait complete. 2024-09-10T08:05:07.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:07 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:07.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:07 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:05:07.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:07 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:07.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:07 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:07.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:07 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:07.947 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:07 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:07.981 DEBUG:teuthology.orchestra.run.smithi022:osd.9> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T08:05:07.983 INFO:tasks.cephadm:Deploying osd.10 on smithi100 with /dev/vg_nvme/lv_1... 2024-09-10T08:05:07.983 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T08:05:08.011 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:07 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:08.011 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:07 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:05:08.011 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:07 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:08.011 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:07 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:08.011 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:07 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:08.012 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:07 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:08.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:07 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:08.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:07 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:05:08.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:07 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:08.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:07 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:08.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:07 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:08.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:07 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:08.241 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T08:05:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:08 smithi022 ceph-mon[30854]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:09.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:08 smithi100 ceph-mon[35102]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:09.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:08 smithi153 ceph-mon[35609]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:09.428 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:05:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:05:09.289+0000 7ff5d59e9640 -1 osd.9 0 log_to_monitors true 2024-09-10T08:05:10.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:09 smithi022 ceph-mon[30854]: from='osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T08:05:10.013 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:09 smithi100 ceph-mon[35102]: from='osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T08:05:10.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:09 smithi153 ceph-mon[35609]: from='osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-10T08:05:10.779 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-10T08:05:10.804 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_1 2024-09-10T08:05:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:10 smithi022 ceph-mon[30854]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:10 smithi022 ceph-mon[30854]: from='osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T08:05:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:10 smithi022 ceph-mon[30854]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T08:05:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:10 smithi022 ceph-mon[30854]: from='osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-10T08:05:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:10 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:05:11.004 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:05:10 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:05:10.727+0000 7ff5d196c640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T08:05:11.004 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:05:10 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:05:10.739+0000 7ff5cd794640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:05:11.091 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T08:05:11.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:10 smithi100 ceph-mon[35102]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:11.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:10 smithi100 ceph-mon[35102]: from='osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T08:05:11.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:10 smithi100 ceph-mon[35102]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T08:05:11.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:10 smithi100 ceph-mon[35102]: from='osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-10T08:05:11.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:10 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:05:11.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:10 smithi153 ceph-mon[35609]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:11.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:10 smithi153 ceph-mon[35609]: from='osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T08:05:11.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:10 smithi153 ceph-mon[35609]: osdmap e61: 10 total, 9 up, 10 in 2024-09-10T08:05:11.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:10 smithi153 ceph-mon[35609]: from='osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]: dispatch 2024-09-10T08:05:11.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:10 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:05:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.589+0000 7f3e4135c640 1 -- 172.21.15.100:0/1443048416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e3c101cd0 msgr2=0x7f3e3c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.589+0000 7f3e4135c640 1 --2- 172.21.15.100:0/1443048416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e3c101cd0 0x7f3e3c102150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3e30009900 tx=0x7f3e3002a410 comp rx=0 tx=0).stop 2024-09-10T08:05:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.589+0000 7f3e4135c640 1 -- 172.21.15.100:0/1443048416 shutdown_connections 2024-09-10T08:05:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.589+0000 7f3e4135c640 1 --2- 172.21.15.100:0/1443048416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e3c102690 0x7f3e3c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.589+0000 7f3e4135c640 1 --2- 172.21.15.100:0/1443048416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e3c101cd0 0x7f3e3c102150 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.589+0000 7f3e4135c640 1 --2- 172.21.15.100:0/1443048416 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e3c100ad0 0x7f3e3c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.589+0000 7f3e4135c640 1 -- 172.21.15.100:0/1443048416 >> 172.21.15.100:0/1443048416 conn(0x7f3e3c0fc280 msgr2=0x7f3e3c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:05:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.589+0000 7f3e4135c640 1 -- 172.21.15.100:0/1443048416 shutdown_connections 2024-09-10T08:05:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.589+0000 7f3e4135c640 1 -- 172.21.15.100:0/1443048416 wait complete. 2024-09-10T08:05:11.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.590+0000 7f3e4135c640 1 Processor -- start 2024-09-10T08:05:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.590+0000 7f3e4135c640 1 -- start start 2024-09-10T08:05:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.590+0000 7f3e4135c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e3c100ad0 0x7f3e3c06aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:05:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.590+0000 7f3e4135c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e3c101cd0 0x7f3e3c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:05:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.590+0000 7f3e4135c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e3c102690 0x7f3e3c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:05:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.590+0000 7f3e4135c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c10c850 con 0x7f3e3c101cd0 2024-09-10T08:05:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.590+0000 7f3e4135c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c10c6d0 con 0x7f3e3c100ad0 2024-09-10T08:05:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.590+0000 7f3e4135c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c10c9d0 con 0x7f3e3c102690 2024-09-10T08:05:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.590+0000 7f3e3affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e3c100ad0 0x7f3e3c06aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:05:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.590+0000 7f3e3affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e3c100ad0 0x7f3e3c06aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60654/0 (socket says 172.21.15.100:60654) 2024-09-10T08:05:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.590+0000 7f3e3affd640 1 -- 172.21.15.100:0/3824841059 learned_addr learned my addr 172.21.15.100:0/3824841059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-10T08:05:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.590+0000 7f3e3a7fc640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e3c101cd0 0x7f3e3c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:05:11.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.591+0000 7f3e3b7fe640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e3c102690 0x7f3e3c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.591+0000 7f3e3affd640 1 -- 172.21.15.100:0/3824841059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e3c102690 msgr2=0x7f3e3c19f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.591+0000 7f3e3affd640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e3c102690 0x7f3e3c19f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.591+0000 7f3e3affd640 1 -- 172.21.15.100:0/3824841059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e3c101cd0 msgr2=0x7f3e3c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.591+0000 7f3e3affd640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e3c101cd0 0x7f3e3c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.591+0000 7f3e3affd640 1 -- 172.21.15.100:0/3824841059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3c19fd20 con 0x7f3e3c100ad0 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.591+0000 7f3e3affd640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e3c100ad0 0x7f3e3c06aad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00b450 tx=0x7f3e2c00b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.591+0000 7f3e23fff640 1 -- 172.21.15.100:0/3824841059 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c015020 con 0x7f3e3c100ad0 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.591+0000 7f3e23fff640 1 -- 172.21.15.100:0/3824841059 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e2c011d70 con 0x7f3e3c100ad0 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.591+0000 7f3e4135c640 1 -- 172.21.15.100:0/3824841059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3c19ffb0 con 0x7f3e3c100ad0 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.591+0000 7f3e23fff640 1 -- 172.21.15.100:0/3824841059 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2c00f340 con 0x7f3e3c100ad0 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.591+0000 7f3e4135c640 1 -- 172.21.15.100:0/3824841059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e3c1a0430 con 0x7f3e3c100ad0 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.592+0000 7f3e4135c640 1 -- 172.21.15.100:0/3824841059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3c107f60 con 0x7f3e3c100ad0 2024-09-10T08:05:11.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.593+0000 7f3e23fff640 1 -- 172.21.15.100:0/3824841059 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3e2c018020 con 0x7f3e3c100ad0 2024-09-10T08:05:11.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.594+0000 7f3e23fff640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3e240a2b80 0x7f3e240a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:05:11.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.594+0000 7f3e23fff640 1 -- 172.21.15.100:0/3824841059 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5981+0+0 (secure 0 0 0) 0x7f3e2c0ce1a0 con 0x7f3e3c100ad0 2024-09-10T08:05:11.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.594+0000 7f3e3a7fc640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3e240a2b80 0x7f3e240a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:05:11.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.594+0000 7f3e3a7fc640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3e240a2b80 0x7f3e240a5040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e300314e0 tx=0x7f3e30000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:05:11.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.598+0000 7f3e23fff640 1 -- 172.21.15.100:0/3824841059 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e2c01f020 con 0x7f3e3c100ad0 2024-09-10T08:05:11.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:11.774+0000 7f3e4135c640 1 -- 172.21.15.100:0/3824841059 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3e3c062630 con 0x7f3e240a2b80 2024-09-10T08:05:11.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-10T08:05:11.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: osdmap e62: 10 total, 9 up, 10 in 2024-09-10T08:05:11.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:05:11.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:05:11.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:11.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:11.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:11.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:11.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:11.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:11.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:11.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:11.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:05:11.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:11 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:12.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-10T08:05:12.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: osdmap e62: 10 total, 9 up, 10 in 2024-09-10T08:05:12.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:05:12.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:05:12.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:12.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:12.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:12.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:12.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:12.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:12.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:12.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:12.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:05:12.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:11 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:12.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-10T08:05:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: osdmap e62: 10 total, 9 up, 10 in 2024-09-10T08:05:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:05:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:05:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:05:12.195 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:11 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:13.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:12 smithi022 ceph-mon[30854]: purged_snaps scrub starts 2024-09-10T08:05:13.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:12 smithi022 ceph-mon[30854]: purged_snaps scrub ok 2024-09-10T08:05:13.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:12 smithi022 ceph-mon[30854]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:13.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:12 smithi022 ceph-mon[30854]: Detected new or changed devices on smithi022 2024-09-10T08:05:13.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:12 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-10T08:05:13.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:12 smithi022 ceph-mon[30854]: osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876] boot 2024-09-10T08:05:13.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:12 smithi022 ceph-mon[30854]: osdmap e63: 10 total, 10 up, 10 in 2024-09-10T08:05:13.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:05:13.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:12 smithi022 ceph-mon[30854]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:05:13.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:05:13.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:05:13.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:12 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:12 smithi100 ceph-mon[35102]: purged_snaps scrub starts 2024-09-10T08:05:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:12 smithi100 ceph-mon[35102]: purged_snaps scrub ok 2024-09-10T08:05:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:12 smithi100 ceph-mon[35102]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:12 smithi100 ceph-mon[35102]: Detected new or changed devices on smithi022 2024-09-10T08:05:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:12 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-10T08:05:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:12 smithi100 ceph-mon[35102]: osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876] boot 2024-09-10T08:05:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:12 smithi100 ceph-mon[35102]: osdmap e63: 10 total, 10 up, 10 in 2024-09-10T08:05:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:05:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:12 smithi100 ceph-mon[35102]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:05:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:05:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:05:13.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:12 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:13.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:12 smithi153 ceph-mon[35609]: purged_snaps scrub starts 2024-09-10T08:05:13.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:12 smithi153 ceph-mon[35609]: purged_snaps scrub ok 2024-09-10T08:05:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:12 smithi153 ceph-mon[35609]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 263 MiB used, 804 GiB / 805 GiB avail 2024-09-10T08:05:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:12 smithi153 ceph-mon[35609]: Detected new or changed devices on smithi022 2024-09-10T08:05:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:12 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-10T08:05:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:12 smithi153 ceph-mon[35609]: osd.9 [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876] boot 2024-09-10T08:05:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:12 smithi153 ceph-mon[35609]: osdmap e63: 10 total, 10 up, 10 in 2024-09-10T08:05:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:05:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:12 smithi153 ceph-mon[35609]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:05:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:05:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:05:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:12 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:14.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:13 smithi022 ceph-mon[30854]: osdmap e64: 10 total, 10 up, 10 in 2024-09-10T08:05:14.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:13 smithi100 ceph-mon[35102]: osdmap e64: 10 total, 10 up, 10 in 2024-09-10T08:05:14.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:13 smithi153 ceph-mon[35609]: osdmap e64: 10 total, 10 up, 10 in 2024-09-10T08:05:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:14 smithi022 ceph-mon[30854]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:14 smithi022 ceph-mon[30854]: from='client.? 172.21.15.100:0/2591118958' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8716aa0-eb93-435d-a9d0-dd4c3dce1954"}]: dispatch 2024-09-10T08:05:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:14 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8716aa0-eb93-435d-a9d0-dd4c3dce1954"}]: dispatch 2024-09-10T08:05:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:14 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8716aa0-eb93-435d-a9d0-dd4c3dce1954"}]': finished 2024-09-10T08:05:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:14 smithi022 ceph-mon[30854]: osdmap e65: 11 total, 10 up, 11 in 2024-09-10T08:05:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:14 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:14 smithi100 ceph-mon[35102]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:14 smithi100 ceph-mon[35102]: from='client.? 172.21.15.100:0/2591118958' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8716aa0-eb93-435d-a9d0-dd4c3dce1954"}]: dispatch 2024-09-10T08:05:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:14 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8716aa0-eb93-435d-a9d0-dd4c3dce1954"}]: dispatch 2024-09-10T08:05:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:14 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8716aa0-eb93-435d-a9d0-dd4c3dce1954"}]': finished 2024-09-10T08:05:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:14 smithi100 ceph-mon[35102]: osdmap e65: 11 total, 10 up, 11 in 2024-09-10T08:05:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:14 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:15.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:14 smithi153 ceph-mon[35609]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:15.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:14 smithi153 ceph-mon[35609]: from='client.? 172.21.15.100:0/2591118958' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8716aa0-eb93-435d-a9d0-dd4c3dce1954"}]: dispatch 2024-09-10T08:05:15.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:14 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8716aa0-eb93-435d-a9d0-dd4c3dce1954"}]: dispatch 2024-09-10T08:05:15.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:14 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8716aa0-eb93-435d-a9d0-dd4c3dce1954"}]': finished 2024-09-10T08:05:15.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:14 smithi153 ceph-mon[35609]: osdmap e65: 11 total, 10 up, 11 in 2024-09-10T08:05:15.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:14 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:16.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:15 smithi022 ceph-mon[30854]: from='client.? 172.21.15.100:0/1703468525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:05:16.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:15 smithi100 ceph-mon[35102]: from='client.? 172.21.15.100:0/1703468525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:05:16.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:15 smithi153 ceph-mon[35609]: from='client.? 172.21.15.100:0/1703468525' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:05:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:16 smithi022 ceph-mon[30854]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:17.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:16 smithi100 ceph-mon[35102]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:17.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:16 smithi153 ceph-mon[35609]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:19.028 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:18 smithi100 ceph-mon[35102]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:19.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:18 smithi153 ceph-mon[35609]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:19.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:18 smithi022 ceph-mon[30854]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:20.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:20 smithi100 ceph-mon[35102]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:21.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:20 smithi153 ceph-mon[35609]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:21.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:20 smithi022 ceph-mon[30854]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:22.924 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:22 smithi100 ceph-mon[35102]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:23.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:22 smithi153 ceph-mon[35609]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:22 smithi022 ceph-mon[30854]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:24.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:23 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T08:05:24.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:23 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:24.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:23 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T08:05:24.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:23 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:24.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:23 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-10T08:05:24.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:23 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:24.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:24 smithi100 ceph-mon[35102]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:24.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:24 smithi100 ceph-mon[35102]: Deploying daemon osd.10 on smithi100 2024-09-10T08:05:25.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:24 smithi153 ceph-mon[35609]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:25.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:24 smithi153 ceph-mon[35609]: Deploying daemon osd.10 on smithi100 2024-09-10T08:05:25.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:24 smithi022 ceph-mon[30854]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:25.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:24 smithi022 ceph-mon[30854]: Deploying daemon osd.10 on smithi100 2024-09-10T08:05:27.055 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:26 smithi022 ceph-mon[30854]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:27.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:26 smithi100 ceph-mon[35102]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:27.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:26 smithi153 ceph-mon[35609]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:29.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:28 smithi100 ceph-mon[35102]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:29.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:29.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:29.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:28 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:29.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:28 smithi153 ceph-mon[35609]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:29.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:29.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:29.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:28 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:29.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:28 smithi022 ceph-mon[30854]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:29.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:29.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:29.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:28 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:30.976 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:30 smithi100 ceph-mon[35102]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:31.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:30 smithi153 ceph-mon[35609]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:30 smithi022 ceph-mon[30854]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:32.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.025+0000 7f3e23fff640 1 -- 172.21.15.100:0/3824841059 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3e3c062630 con 0x7f3e240a2b80 2024-09-10T08:05:32.025 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 10 on host 'smithi100' 2024-09-10T08:05:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.027+0000 7f3e4135c640 1 -- 172.21.15.100:0/3824841059 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3e240a2b80 msgr2=0x7f3e240a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.027+0000 7f3e4135c640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3e240a2b80 0x7f3e240a5040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e300314e0 tx=0x7f3e30000bc0 comp rx=0 tx=0).stop 2024-09-10T08:05:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.027+0000 7f3e4135c640 1 -- 172.21.15.100:0/3824841059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e3c100ad0 msgr2=0x7f3e3c06aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.027+0000 7f3e4135c640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e3c100ad0 0x7f3e3c06aad0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c00b450 tx=0x7f3e2c00b910 comp rx=0 tx=0).stop 2024-09-10T08:05:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.027+0000 7f3e4135c640 1 -- 172.21.15.100:0/3824841059 shutdown_connections 2024-09-10T08:05:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.027+0000 7f3e4135c640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3e240a2b80 0x7f3e240a5040 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.027+0000 7f3e4135c640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e3c102690 0x7f3e3c19f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.027+0000 7f3e4135c640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e3c101cd0 0x7f3e3c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.027+0000 7f3e4135c640 1 --2- 172.21.15.100:0/3824841059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e3c100ad0 0x7f3e3c06aad0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:32.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.027+0000 7f3e4135c640 1 -- 172.21.15.100:0/3824841059 >> 172.21.15.100:0/3824841059 conn(0x7f3e3c0fc280 msgr2=0x7f3e3c105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:05:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.027+0000 7f3e4135c640 1 -- 172.21.15.100:0/3824841059 shutdown_connections 2024-09-10T08:05:32.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-10T08:05:32.028+0000 7f3e4135c640 1 -- 172.21.15.100:0/3824841059 wait complete. 2024-09-10T08:05:32.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:32 smithi100 ceph-mon[35102]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:32.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:32 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:32 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:32 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:32.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:32 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:05:32.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:32 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:32 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:32.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:32 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:32 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.673 DEBUG:teuthology.orchestra.run.smithi100:osd.10> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T08:05:32.675 INFO:tasks.cephadm:Deploying osd.11 on smithi153 with /dev/vg_nvme/lv_1... 2024-09-10T08:05:32.675 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T08:05:32.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:32 smithi153 ceph-mon[35609]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:32.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:32 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:32 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:32 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:32.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:32 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:05:32.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:32 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:32 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:32.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:32 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:32 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:32 smithi022 ceph-mon[30854]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:32.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:32 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:32 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:32 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:32.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:32 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:05:32.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:32 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:32 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:32.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:32 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:32 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:32.932 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:05:34.357 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:34 smithi153 ceph-mon[35609]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:34.567 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:34 smithi100 ceph-mon[35102]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:34.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:34 smithi022 ceph-mon[30854]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:34.827 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:05:34 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:05:34.566+0000 7fd5d7f16640 -1 osd.10 0 log_to_monitors true 2024-09-10T08:05:35.438 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:35 smithi100 ceph-mon[35102]: from='osd.10 [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T08:05:35.438 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:35 smithi100 ceph-mon[35102]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T08:05:35.617 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:35 smithi153 ceph-mon[35609]: from='osd.10 [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T08:05:35.617 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:35 smithi153 ceph-mon[35609]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T08:05:35.620 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-10T08:05:35.654 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi153:vg_nvme/lv_1 2024-09-10T08:05:35.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:35 smithi022 ceph-mon[30854]: from='osd.10 [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T08:05:35.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:35 smithi022 ceph-mon[30854]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-10T08:05:35.948 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:05:36.362 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:36.362 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T08:05:36.362 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='osd.10 [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:05:36.362 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: Detected new or changed devices on smithi100 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:36.363 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:05:36.364 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:36.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.446+0000 7f95c386a640 1 -- 172.21.15.153:0/2032558421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc101d10 msgr2=0x7f95bc102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:36.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.446+0000 7f95c386a640 1 --2- 172.21.15.153:0/2032558421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc101d10 0x7f95bc102190 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009900 tx=0x7f95b802a410 comp rx=0 tx=0).stop 2024-09-10T08:05:36.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.446+0000 7f95c386a640 1 -- 172.21.15.153:0/2032558421 shutdown_connections 2024-09-10T08:05:36.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.446+0000 7f95c386a640 1 --2- 172.21.15.153:0/2032558421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95bc1026d0 0x7f95bc108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:36.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.446+0000 7f95c386a640 1 --2- 172.21.15.153:0/2032558421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc101d10 0x7f95bc102190 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:36.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.446+0000 7f95c386a640 1 --2- 172.21.15.153:0/2032558421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95bc100b10 0x7f95bc100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:36.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.446+0000 7f95c386a640 1 -- 172.21.15.153:0/2032558421 >> 172.21.15.153:0/2032558421 conn(0x7f95bc0fc2a0 msgr2=0x7f95bc0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.446+0000 7f95c386a640 1 -- 172.21.15.153:0/2032558421 shutdown_connections 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.446+0000 7f95c386a640 1 -- 172.21.15.153:0/2032558421 wait complete. 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c386a640 1 Processor -- start 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c386a640 1 -- start start 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c386a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95bc100b10 0x7f95bc10b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c386a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc101d10 0x7f95bc109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c386a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95bc1026d0 0x7f95bc10a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c386a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc10d8c0 con 0x7f95bc100b10 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c386a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc10d740 con 0x7f95bc1026d0 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c386a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc10da40 con 0x7f95bc101d10 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c0e05640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc101d10 0x7f95bc109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c0e05640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc101d10 0x7f95bc109ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45942/0 (socket says 172.21.15.153:45942) 2024-09-10T08:05:36.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c0e05640 1 -- 172.21.15.153:0/2198765074 learned_addr learned my addr 172.21.15.153:0/2198765074 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-10T08:05:36.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c1e07640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95bc1026d0 0x7f95bc10a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:05:36.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.447+0000 7f95c1606640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95bc100b10 0x7f95bc10b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:05:36.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.448+0000 7f95c0e05640 1 -- 172.21.15.153:0/2198765074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95bc1026d0 msgr2=0x7f95bc10a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:36.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.448+0000 7f95c0e05640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95bc1026d0 0x7f95bc10a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:36.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.448+0000 7f95c0e05640 1 -- 172.21.15.153:0/2198765074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95bc100b10 msgr2=0x7f95bc10b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:36.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.448+0000 7f95c0e05640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95bc100b10 0x7f95bc10b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:36.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.448+0000 7f95c0e05640 1 -- 172.21.15.153:0/2198765074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc10a8e0 con 0x7f95bc101d10 2024-09-10T08:05:36.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.448+0000 7f95c0e05640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc101d10 0x7f95bc109ae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009230 tx=0x7f95b8004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:05:36.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.448+0000 7f95b27fc640 1 -- 172.21.15.153:0/2198765074 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b803f030 con 0x7f95bc101d10 2024-09-10T08:05:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.448+0000 7f95b27fc640 1 -- 172.21.15.153:0/2198765074 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95b8003ce0 con 0x7f95bc101d10 2024-09-10T08:05:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.448+0000 7f95c386a640 1 -- 172.21.15.153:0/2198765074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95bc1a2050 con 0x7f95bc101d10 2024-09-10T08:05:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.448+0000 7f95b27fc640 1 -- 172.21.15.153:0/2198765074 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8035070 con 0x7f95bc101d10 2024-09-10T08:05:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.448+0000 7f95c386a640 1 -- 172.21.15.153:0/2198765074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95bc1a2500 con 0x7f95bc101d10 2024-09-10T08:05:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.449+0000 7f95c386a640 1 -- 172.21.15.153:0/2198765074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95bc107eb0 con 0x7f95bc101d10 2024-09-10T08:05:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.450+0000 7f95b27fc640 1 -- 172.21.15.153:0/2198765074 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f95b8042030 con 0x7f95bc101d10 2024-09-10T08:05:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.451+0000 7f95b27fc640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f95a80a2b80 0x7f95a80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:05:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.451+0000 7f95b27fc640 1 -- 172.21.15.153:0/2198765074 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6414+0+0 (secure 0 0 0) 0x7f95b80ef030 con 0x7f95bc101d10 2024-09-10T08:05:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.451+0000 7f95c1606640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f95a80a2b80 0x7f95a80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:05:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.452+0000 7f95c1606640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f95a80a2b80 0x7f95a80a5040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f95ac005fd0 tx=0x7f95ac005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:05:36.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.455+0000 7f95b27fc640 1 -- 172.21.15.153:0/2198765074 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f95b80bc660 con 0x7f95bc101d10 2024-09-10T08:05:36.618 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:05:36.317+0000 7fd5d3e99640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T08:05:36.618 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:05:36.327+0000 7fd5cfcc1640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:05:36.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:36.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T08:05:36.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='osd.10 [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:05:36.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T08:05:36.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:36.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:05:36.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: Detected new or changed devices on smithi100 2024-09-10T08:05:36.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:36.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:36.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:36.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:36.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:36.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:36.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-10T08:05:36.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:36.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:36.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:05:36.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:36.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:36.631+0000 7f95c386a640 1 -- 172.21.15.153:0/2198765074 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f95bc062630 con 0x7f95a80a2b80 2024-09-10T08:05:36.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:36.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T08:05:36.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='osd.10 [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:05:36.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: osdmap e66: 11 total, 10 up, 11 in 2024-09-10T08:05:36.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:36.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-10T08:05:36.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: Detected new or changed devices on smithi100 2024-09-10T08:05:36.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:36.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:36.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:36.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:36.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:36.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:05:36.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-10T08:05:36.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:36.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:36.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:05:36.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:37.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:37 smithi100 ceph-mon[35102]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-10T08:05:37.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:37 smithi100 ceph-mon[35102]: osdmap e67: 11 total, 10 up, 11 in 2024-09-10T08:05:37.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:37 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:37.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:37 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:37.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:37 smithi100 ceph-mon[35102]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:05:37.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:37 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:05:37.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:37 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:05:37.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:37 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:37.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:37 smithi153 ceph-mon[35609]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-10T08:05:37.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:37 smithi153 ceph-mon[35609]: osdmap e67: 11 total, 10 up, 11 in 2024-09-10T08:05:37.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:37 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:37.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:37 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:37.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:37 smithi153 ceph-mon[35609]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:05:37.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:37 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:05:37.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:37 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:05:37.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:37 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:37.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:37 smithi022 ceph-mon[30854]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-10T08:05:37.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:37 smithi022 ceph-mon[30854]: osdmap e67: 11 total, 10 up, 11 in 2024-09-10T08:05:37.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:37 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:37.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:37 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:37.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:37 smithi022 ceph-mon[30854]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:05:37.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:37 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-10T08:05:37.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:37 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-10T08:05:37.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:37 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:38.590 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:38 smithi153 ceph-mon[35609]: purged_snaps scrub starts 2024-09-10T08:05:38.590 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:38 smithi153 ceph-mon[35609]: purged_snaps scrub ok 2024-09-10T08:05:38.590 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:38 smithi153 ceph-mon[35609]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:38.590 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:38.590 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:38 smithi153 ceph-mon[35609]: osd.10 [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643] boot 2024-09-10T08:05:38.590 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:38 smithi153 ceph-mon[35609]: osdmap e68: 11 total, 11 up, 11 in 2024-09-10T08:05:38.590 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:38 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:38.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:38 smithi100 ceph-mon[35102]: purged_snaps scrub starts 2024-09-10T08:05:38.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:38 smithi100 ceph-mon[35102]: purged_snaps scrub ok 2024-09-10T08:05:38.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:38 smithi100 ceph-mon[35102]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:38.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:38.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:38 smithi100 ceph-mon[35102]: osd.10 [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643] boot 2024-09-10T08:05:38.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:38 smithi100 ceph-mon[35102]: osdmap e68: 11 total, 11 up, 11 in 2024-09-10T08:05:38.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:38 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:38.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:38 smithi022 ceph-mon[30854]: purged_snaps scrub starts 2024-09-10T08:05:38.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:38 smithi022 ceph-mon[30854]: purged_snaps scrub ok 2024-09-10T08:05:38.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:38 smithi022 ceph-mon[30854]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-09-10T08:05:38.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:38.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:38 smithi022 ceph-mon[30854]: osd.10 [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643] boot 2024-09-10T08:05:38.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:38 smithi022 ceph-mon[30854]: osdmap e68: 11 total, 11 up, 11 in 2024-09-10T08:05:38.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:38 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:05:39.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:39 smithi100 ceph-mon[35102]: osdmap e69: 11 total, 11 up, 11 in 2024-09-10T08:05:39.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:39 smithi100 ceph-mon[35102]: from='client.? 172.21.15.153:0/138331526' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c427cfe-8d7c-431e-9eb4-b03cfac3068d"}]: dispatch 2024-09-10T08:05:39.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:39 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c427cfe-8d7c-431e-9eb4-b03cfac3068d"}]: dispatch 2024-09-10T08:05:39.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:39 smithi100 ceph-mon[35102]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c427cfe-8d7c-431e-9eb4-b03cfac3068d"}]': finished 2024-09-10T08:05:39.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:39 smithi100 ceph-mon[35102]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T08:05:39.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:39 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:05:39.634 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:39 smithi153 ceph-mon[35609]: osdmap e69: 11 total, 11 up, 11 in 2024-09-10T08:05:39.634 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:39 smithi153 ceph-mon[35609]: from='client.? 172.21.15.153:0/138331526' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c427cfe-8d7c-431e-9eb4-b03cfac3068d"}]: dispatch 2024-09-10T08:05:39.634 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:39 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c427cfe-8d7c-431e-9eb4-b03cfac3068d"}]: dispatch 2024-09-10T08:05:39.634 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:39 smithi153 ceph-mon[35609]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c427cfe-8d7c-431e-9eb4-b03cfac3068d"}]': finished 2024-09-10T08:05:39.634 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:39 smithi153 ceph-mon[35609]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T08:05:39.634 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:39 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:05:39.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:39 smithi022 ceph-mon[30854]: osdmap e69: 11 total, 11 up, 11 in 2024-09-10T08:05:39.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:39 smithi022 ceph-mon[30854]: from='client.? 172.21.15.153:0/138331526' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c427cfe-8d7c-431e-9eb4-b03cfac3068d"}]: dispatch 2024-09-10T08:05:39.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:39 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c427cfe-8d7c-431e-9eb4-b03cfac3068d"}]: dispatch 2024-09-10T08:05:39.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:39 smithi022 ceph-mon[30854]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c427cfe-8d7c-431e-9eb4-b03cfac3068d"}]': finished 2024-09-10T08:05:39.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:39 smithi022 ceph-mon[30854]: osdmap e70: 12 total, 11 up, 12 in 2024-09-10T08:05:39.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:39 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:05:40.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:40 smithi100 ceph-mon[35102]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:40.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:40 smithi100 ceph-mon[35102]: from='client.? 172.21.15.153:0/1217164569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:05:40.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:40 smithi153 ceph-mon[35609]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:40.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:40 smithi153 ceph-mon[35609]: from='client.? 172.21.15.153:0/1217164569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:05:40.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:40 smithi022 ceph-mon[30854]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:40.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:40 smithi022 ceph-mon[30854]: from='client.? 172.21.15.153:0/1217164569' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-10T08:05:41.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:41 smithi100 ceph-mon[35102]: osdmap e71: 12 total, 11 up, 12 in 2024-09-10T08:05:41.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:41 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:05:41.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:41 smithi153 ceph-mon[35609]: osdmap e71: 12 total, 11 up, 12 in 2024-09-10T08:05:41.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:41 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:05:41.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:41 smithi022 ceph-mon[30854]: osdmap e71: 12 total, 11 up, 12 in 2024-09-10T08:05:41.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:41 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:05:42.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:42 smithi100 ceph-mon[35102]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T08:05:42.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:42 smithi100 ceph-mon[35102]: osdmap e72: 12 total, 11 up, 12 in 2024-09-10T08:05:42.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:05:42.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:42 smithi153 ceph-mon[35609]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T08:05:42.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:42 smithi153 ceph-mon[35609]: osdmap e72: 12 total, 11 up, 12 in 2024-09-10T08:05:42.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:05:42.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:42 smithi022 ceph-mon[30854]: pgmap v231: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T08:05:42.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:42 smithi022 ceph-mon[30854]: osdmap e72: 12 total, 11 up, 12 in 2024-09-10T08:05:42.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:05:44.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:44 smithi100 ceph-mon[35102]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-10T08:05:44.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:44 smithi153 ceph-mon[35609]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-10T08:05:44.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:44 smithi022 ceph-mon[30854]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 125 KiB/s, 0 objects/s recovering 2024-09-10T08:05:46.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:46 smithi153 ceph-mon[35609]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T08:05:46.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:46 smithi100 ceph-mon[35102]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T08:05:46.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:46 smithi022 ceph-mon[30854]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T08:05:48.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:48 smithi153 ceph-mon[35609]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-10T08:05:48.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T08:05:48.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:48.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:48 smithi153 ceph-mon[35609]: Deploying daemon osd.11 on smithi153 2024-09-10T08:05:48.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:48 smithi100 ceph-mon[35102]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-10T08:05:48.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T08:05:48.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:48.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:48 smithi100 ceph-mon[35102]: Deploying daemon osd.11 on smithi153 2024-09-10T08:05:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:48 smithi022 ceph-mon[30854]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-10T08:05:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-10T08:05:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:05:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:48 smithi022 ceph-mon[30854]: Deploying daemon osd.11 on smithi153 2024-09-10T08:05:50.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:50 smithi153 ceph-mon[35609]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-10T08:05:50.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:50 smithi100 ceph-mon[35102]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-10T08:05:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:50 smithi022 ceph-mon[30854]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-10T08:05:52.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:52 smithi153 ceph-mon[35609]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:52.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:52 smithi100 ceph-mon[35102]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:52.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:52 smithi022 ceph-mon[30854]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:54.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:54 smithi100 ceph-mon[35102]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:54.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:54 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:54.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:54 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:54.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:54 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:54.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:54 smithi153 ceph-mon[35609]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:54.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:54 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:54.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:54 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:54.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:54 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:54.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:54 smithi022 ceph-mon[30854]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:54.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:54 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:05:54.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:54 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:54.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:54 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:56.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:56 smithi153 ceph-mon[35609]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:56 smithi022 ceph-mon[30854]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:56.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:56 smithi100 ceph-mon[35102]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:57.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.126+0000 7f95b27fc640 1 -- 172.21.15.153:0/2198765074 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f95bc062630 con 0x7f95a80a2b80 2024-09-10T08:05:57.127 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 11 on host 'smithi153' 2024-09-10T08:05:57.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.128+0000 7f95c386a640 1 -- 172.21.15.153:0/2198765074 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f95a80a2b80 msgr2=0x7f95a80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:57.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.128+0000 7f95c386a640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f95a80a2b80 0x7f95a80a5040 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f95ac005fd0 tx=0x7f95ac005c70 comp rx=0 tx=0).stop 2024-09-10T08:05:57.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.129+0000 7f95c386a640 1 -- 172.21.15.153:0/2198765074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc101d10 msgr2=0x7f95bc109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:57.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.129+0000 7f95c386a640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc101d10 0x7f95bc109ae0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009230 tx=0x7f95b8004360 comp rx=0 tx=0).stop 2024-09-10T08:05:57.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.129+0000 7f95c386a640 1 -- 172.21.15.153:0/2198765074 shutdown_connections 2024-09-10T08:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.129+0000 7f95c386a640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f95a80a2b80 0x7f95a80a5040 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.129+0000 7f95c386a640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95bc1026d0 0x7f95bc10a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.129+0000 7f95c386a640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95bc101d10 0x7f95bc109ae0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.129+0000 7f95c386a640 1 --2- 172.21.15.153:0/2198765074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95bc100b10 0x7f95bc10b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.129+0000 7f95c386a640 1 -- 172.21.15.153:0/2198765074 >> 172.21.15.153:0/2198765074 conn(0x7f95bc0fc2a0 msgr2=0x7f95bc105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.129+0000 7f95c386a640 1 -- 172.21.15.153:0/2198765074 shutdown_connections 2024-09-10T08:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:05:57.129+0000 7f95c386a640 1 -- 172.21.15.153:0/2198765074 wait complete. 2024-09-10T08:05:57.999 DEBUG:teuthology.orchestra.run.smithi153:osd.11> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T08:05:58.006 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T08:05:58.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T08:05:58.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:58 smithi153 ceph-mon[35609]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:58.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:58 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:58.235 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:58 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:58.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:58 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:58.236 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:58 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:58.280 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:05:58.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:58 smithi022 ceph-mon[30854]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:58.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:58 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:58 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:58 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:58.402 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:58 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:58.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:58 smithi100 ceph-mon[35102]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:05:58.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:58 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:58.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:58 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:58.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:58 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:58.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:58 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:05:58.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.858+0000 7f7067a72640 1 -- 172.21.15.22:0/3139542968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060100ad0 msgr2=0x7f7060100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:58.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.858+0000 7f7067a72640 1 --2- 172.21.15.22:0/3139542968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060100ad0 0x7f7060100ed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f705c009900 tx=0x7f705c02a410 comp rx=0 tx=0).stop 2024-09-10T08:05:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.858+0000 7f7067a72640 1 -- 172.21.15.22:0/3139542968 shutdown_connections 2024-09-10T08:05:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.858+0000 7f7067a72640 1 --2- 172.21.15.22:0/3139542968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7060102690 0x7f7060108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.858+0000 7f7067a72640 1 --2- 172.21.15.22:0/3139542968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7060101cd0 0x7f7060102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.858+0000 7f7067a72640 1 --2- 172.21.15.22:0/3139542968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060100ad0 0x7f7060100ed0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.858+0000 7f7067a72640 1 -- 172.21.15.22:0/3139542968 >> 172.21.15.22:0/3139542968 conn(0x7f70600fc280 msgr2=0x7f70600fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:05:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.858+0000 7f7067a72640 1 -- 172.21.15.22:0/3139542968 shutdown_connections 2024-09-10T08:05:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.858+0000 7f7067a72640 1 -- 172.21.15.22:0/3139542968 wait complete. 2024-09-10T08:05:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.858+0000 7f7067a72640 1 Processor -- start 2024-09-10T08:05:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.858+0000 7f7067a72640 1 -- start start 2024-09-10T08:05:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f7067a72640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7060100ad0 0x7f7060104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:05:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f7067a72640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060101cd0 0x7f70601030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:05:58.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f7067a72640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7060102690 0x7f70601035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:05:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f7067a72640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f706010c760 con 0x7f7060101cd0 2024-09-10T08:05:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f7067a72640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f706010c5e0 con 0x7f7060102690 2024-09-10T08:05:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f7067a72640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f706010c8e0 con 0x7f7060100ad0 2024-09-10T08:05:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f706500d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060101cd0 0x7f70601030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:05:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f706500d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060101cd0 0x7f70601030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48790/0 (socket says 172.21.15.22:48790) 2024-09-10T08:05:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f706580e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7060100ad0 0x7f7060104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:05:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f706500d640 1 -- 172.21.15.22:0/1174053072 learned_addr learned my addr 172.21.15.22:0/1174053072 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:05:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f706600f640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7060102690 0x7f70601035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:05:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f706500d640 1 -- 172.21.15.22:0/1174053072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7060100ad0 msgr2=0x7f7060104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f706500d640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7060100ad0 0x7f7060104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f706500d640 1 -- 172.21.15.22:0/1174053072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7060102690 msgr2=0x7f70601035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:58.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f706500d640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7060102690 0x7f70601035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f706500d640 1 -- 172.21.15.22:0/1174053072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7060103eb0 con 0x7f7060101cd0 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f706500d640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060101cd0 0x7f70601030b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f705000e9f0 tx=0x7f705000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f7056ffd640 1 -- 172.21.15.22:0/1174053072 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705000cd80 con 0x7f7060101cd0 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f7056ffd640 1 -- 172.21.15.22:0/1174053072 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7050010910 con 0x7f7060101cd0 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f7067a72640 1 -- 172.21.15.22:0/1174053072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70601a2090 con 0x7f7060101cd0 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.859+0000 7f7056ffd640 1 -- 172.21.15.22:0/1174053072 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050018990 con 0x7f7060101cd0 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.860+0000 7f7067a72640 1 -- 172.21.15.22:0/1174053072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70601a25a0 con 0x7f7060101cd0 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.860+0000 7f7067a72640 1 -- 172.21.15.22:0/1174053072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7060100ed0 con 0x7f7060101cd0 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.863+0000 7f7056ffd640 1 -- 172.21.15.22:0/1174053072 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f7050010ac0 con 0x7f7060101cd0 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.863+0000 7f7056ffd640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f704c0a2b80 0x7f704c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.863+0000 7f706580e640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f704c0a2b80 0x7f704c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.863+0000 7f7056ffd640 1 -- 172.21.15.22:0/1174053072 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7f70500cf150 con 0x7f7060101cd0 2024-09-10T08:05:58.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.863+0000 7f706580e640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f704c0a2b80 0x7f704c0a5040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f705c005ab0 tx=0x7f705c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:05:58.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:58.870+0000 7f7056ffd640 1 -- 172.21.15.22:0/1174053072 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f705009c040 con 0x7f7060101cd0 2024-09-10T08:05:59.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.050+0000 7f7067a72640 1 -- 172.21.15.22:0/1174053072 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f70601a2e90 con 0x7f7060101cd0 2024-09-10T08:05:59.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.051+0000 7f7056ffd640 1 -- 172.21.15.22:0/1174053072 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f70500a0340 con 0x7f7060101cd0 2024-09-10T08:05:59.051 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:05:59.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.053+0000 7f7067a72640 1 -- 172.21.15.22:0/1174053072 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f704c0a2b80 msgr2=0x7f704c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:59.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.053+0000 7f7067a72640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f704c0a2b80 0x7f704c0a5040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f705c005ab0 tx=0x7f705c000bc0 comp rx=0 tx=0).stop 2024-09-10T08:05:59.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.053+0000 7f7067a72640 1 -- 172.21.15.22:0/1174053072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060101cd0 msgr2=0x7f70601030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:05:59.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.053+0000 7f7067a72640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060101cd0 0x7f70601030b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f705000e9f0 tx=0x7f705000eeb0 comp rx=0 tx=0).stop 2024-09-10T08:05:59.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.053+0000 7f7067a72640 1 -- 172.21.15.22:0/1174053072 shutdown_connections 2024-09-10T08:05:59.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.053+0000 7f7067a72640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f704c0a2b80 0x7f704c0a5040 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:59.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.053+0000 7f7067a72640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7060102690 0x7f70601035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:59.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.053+0000 7f7067a72640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7060101cd0 0x7f70601030b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:59.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.053+0000 7f7067a72640 1 --2- 172.21.15.22:0/1174053072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7060100ad0 0x7f7060104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:05:59.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.053+0000 7f7067a72640 1 -- 172.21.15.22:0/1174053072 >> 172.21.15.22:0/1174053072 conn(0x7f70600fc280 msgr2=0x7f7060069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:05:59.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.053+0000 7f7067a72640 1 -- 172.21.15.22:0/1174053072 shutdown_connections 2024-09-10T08:05:59.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:05:59.053+0000 7f7067a72640 1 -- 172.21.15.22:0/1174053072 wait complete. 2024-09-10T08:05:59.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:05:59 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1174053072' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T08:05:59.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:05:59 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1174053072' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T08:05:59.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:05:59 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1174053072' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T08:05:59.944 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:05:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:05:59.588+0000 7f544bbe3640 -1 osd.11 0 log_to_monitors true 2024-09-10T08:05:59.997 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1725955537,"num_in_osds":12,"osd_in_since":1725955539,"num_remapped_pgs":0} 2024-09-10T08:06:00.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:00 smithi022 ceph-mon[30854]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:06:00.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:00 smithi022 ceph-mon[30854]: from='osd.11 [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T08:06:00.133 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:00 smithi022 ceph-mon[30854]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T08:06:00.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:00 smithi153 ceph-mon[35609]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:06:00.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:00 smithi153 ceph-mon[35609]: from='osd.11 [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T08:06:00.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:00 smithi153 ceph-mon[35609]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T08:06:00.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:00 smithi100 ceph-mon[35102]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:06:00.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:00 smithi100 ceph-mon[35102]: from='osd.11 [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T08:06:00.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:00 smithi100 ceph-mon[35102]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-10T08:06:00.999 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T08:06:01.288 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:01.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T08:06:01.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T08:06:01.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:01.409 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='osd.11 [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:06:01.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:06:01.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:01.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:01.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:06:01.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:06:01.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:06:01.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:06:01.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:01.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:01.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:01.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T08:06:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T08:06:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='osd.11 [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:06:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:06:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:06:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:06:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:06:01.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:06:01.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:01.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:01.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:01.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:01.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T08:06:01.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: osdmap e73: 12 total, 11 up, 12 in 2024-09-10T08:06:01.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:01.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='osd.11 [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:06:01.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-10T08:06:01.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:01.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:01.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:06:01.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:06:01.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:06:01.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:06:01.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:01.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:01.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:01.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:01.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.875+0000 7fcc8614c640 1 -- 172.21.15.22:0/1634704109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc80101e40 msgr2=0x7fcc801086d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:01.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.875+0000 7fcc8614c640 1 --2- 172.21.15.22:0/1634704109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc80101e40 0x7fcc801086d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcc78009ca0 tx=0x7fcc7802a8c0 comp rx=0 tx=0).stop 2024-09-10T08:06:01.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.875+0000 7fcc8614c640 1 -- 172.21.15.22:0/1634704109 shutdown_connections 2024-09-10T08:06:01.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.875+0000 7fcc8614c640 1 --2- 172.21.15.22:0/1634704109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc80101e40 0x7fcc801086d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:01.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.875+0000 7fcc8614c640 1 --2- 172.21.15.22:0/1634704109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80101480 0x7fcc80101900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:01.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.875+0000 7fcc8614c640 1 --2- 172.21.15.22:0/1634704109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc80100280 0x7fcc80100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:01.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.875+0000 7fcc8614c640 1 -- 172.21.15.22:0/1634704109 >> 172.21.15.22:0/1634704109 conn(0x7fcc800fba30 msgr2=0x7fcc800fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:01.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.875+0000 7fcc8614c640 1 -- 172.21.15.22:0/1634704109 shutdown_connections 2024-09-10T08:06:01.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.875+0000 7fcc8614c640 1 -- 172.21.15.22:0/1634704109 wait complete. 2024-09-10T08:06:01.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.876+0000 7fcc8614c640 1 Processor -- start 2024-09-10T08:06:01.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.876+0000 7fcc8614c640 1 -- start start 2024-09-10T08:06:01.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.876+0000 7fcc8614c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80100280 0x7fcc80104210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:01.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.876+0000 7fcc8614c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc80101480 0x7fcc80102860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.876+0000 7fcc8614c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc80101e40 0x7fcc80102da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.876+0000 7fcc8614c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8010c770 con 0x7fcc80101e40 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.876+0000 7fcc8614c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8010c5f0 con 0x7fcc80100280 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.876+0000 7fcc8614c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8010c8f0 con 0x7fcc80101480 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.876+0000 7fcc7ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc80101e40 0x7fcc80102da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.876+0000 7fcc7ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc80101e40 0x7fcc80102da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48806/0 (socket says 172.21.15.22:48806) 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.876+0000 7fcc7ffff640 1 -- 172.21.15.22:0/3570902752 learned_addr learned my addr 172.21.15.22:0/3570902752 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.876+0000 7fcc7effd640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc80101480 0x7fcc80102860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc7f7fe640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80100280 0x7fcc80104210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc7ffff640 1 -- 172.21.15.22:0/3570902752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc80101480 msgr2=0x7fcc80102860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc7ffff640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc80101480 0x7fcc80102860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc7ffff640 1 -- 172.21.15.22:0/3570902752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80100280 msgr2=0x7fcc80104210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:01.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc7ffff640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80100280 0x7fcc80104210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc7ffff640 1 -- 172.21.15.22:0/3570902752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc80103660 con 0x7fcc80101e40 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc7effd640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc80101480 0x7fcc80102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc7f7fe640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80100280 0x7fcc80104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc7ffff640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc80101e40 0x7fcc80102da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcc78005e30 tx=0x7fcc78031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc7cff9640 1 -- 172.21.15.22:0/3570902752 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78003b70 con 0x7fcc80101e40 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc7cff9640 1 -- 172.21.15.22:0/3570902752 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc78003d10 con 0x7fcc80101e40 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc8614c640 1 -- 172.21.15.22:0/3570902752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc801a1f80 con 0x7fcc80101e40 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc7cff9640 1 -- 172.21.15.22:0/3570902752 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc7802fd30 con 0x7fcc80101e40 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.877+0000 7fcc8614c640 1 -- 172.21.15.22:0/3570902752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc801a2430 con 0x7fcc80101e40 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.878+0000 7fcc8614c640 1 -- 172.21.15.22:0/3570902752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc801a2660 con 0x7fcc80101e40 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.880+0000 7fcc7cff9640 1 -- 172.21.15.22:0/3570902752 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fcc78004050 con 0x7fcc80101e40 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.880+0000 7fcc7cff9640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fcc680a2b80 0x7fcc680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:01.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.880+0000 7fcc7f7fe640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fcc680a2b80 0x7fcc680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:01.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.880+0000 7fcc7cff9640 1 -- 172.21.15.22:0/3570902752 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6847+0+0 (secure 0 0 0) 0x7fcc780efed0 con 0x7fcc80101e40 2024-09-10T08:06:01.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.881+0000 7fcc7f7fe640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fcc680a2b80 0x7fcc680a5040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcc700058c0 tx=0x7fcc70005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:01.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:01.883+0000 7fcc7cff9640 1 -- 172.21.15.22:0/3570902752 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcc780bd3f0 con 0x7fcc80101e40 2024-09-10T08:06:01.943 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:06:01.532+0000 7f544837a640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T08:06:01.944 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:06:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:06:01.542+0000 7f543f986640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:06:02.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.058+0000 7fcc8614c640 1 -- 172.21.15.22:0/3570902752 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fcc801a2950 con 0x7fcc80101e40 2024-09-10T08:06:02.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.059+0000 7fcc7cff9640 1 -- 172.21.15.22:0/3570902752 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fcc780bccf0 con 0x7fcc80101e40 2024-09-10T08:06:02.059 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:02.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.061+0000 7fcc8614c640 1 -- 172.21.15.22:0/3570902752 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fcc680a2b80 msgr2=0x7fcc680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:02.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.061+0000 7fcc8614c640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fcc680a2b80 0x7fcc680a5040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcc700058c0 tx=0x7fcc70005850 comp rx=0 tx=0).stop 2024-09-10T08:06:02.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.061+0000 7fcc8614c640 1 -- 172.21.15.22:0/3570902752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc80101e40 msgr2=0x7fcc80102da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:02.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.061+0000 7fcc8614c640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc80101e40 0x7fcc80102da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcc78005e30 tx=0x7fcc78031ee0 comp rx=0 tx=0).stop 2024-09-10T08:06:02.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.061+0000 7fcc8614c640 1 -- 172.21.15.22:0/3570902752 shutdown_connections 2024-09-10T08:06:02.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.061+0000 7fcc8614c640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fcc680a2b80 0x7fcc680a5040 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:02.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.061+0000 7fcc8614c640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcc80101e40 0x7fcc80102da0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:02.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.061+0000 7fcc8614c640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc80101480 0x7fcc80102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:02.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.061+0000 7fcc8614c640 1 --2- 172.21.15.22:0/3570902752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc80100280 0x7fcc80104210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:02.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.061+0000 7fcc8614c640 1 -- 172.21.15.22:0/3570902752 >> 172.21.15.22:0/3570902752 conn(0x7fcc800fba30 msgr2=0x7fcc800fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:02.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.061+0000 7fcc8614c640 1 -- 172.21.15.22:0/3570902752 shutdown_connections 2024-09-10T08:06:02.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:02.061+0000 7fcc8614c640 1 -- 172.21.15.22:0/3570902752 wait complete. 2024-09-10T08:06:02.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:06:02.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: Detected new or changed devices on smithi153 2024-09-10T08:06:02.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi153 to 4272M 2024-09-10T08:06:02.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-10T08:06:02.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T08:06:02.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:02.370 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:02.371 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:06:02.371 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:02.371 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:02.371 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:02.371 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: from='osd.11 ' entity='osd.11' 2024-09-10T08:06:02.371 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:02 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3570902752' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T08:06:02.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:06:02.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: Detected new or changed devices on smithi153 2024-09-10T08:06:02.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi153 to 4272M 2024-09-10T08:06:02.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-10T08:06:02.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T08:06:02.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:02.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:02.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:06:02.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:02.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:02.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:02.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: from='osd.11 ' entity='osd.11' 2024-09-10T08:06:02.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:02 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3570902752' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T08:06:02.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:06:02.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: Detected new or changed devices on smithi153 2024-09-10T08:06:02.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi153 to 4272M 2024-09-10T08:06:02.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-10T08:06:02.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: osdmap e74: 12 total, 11 up, 12 in 2024-09-10T08:06:02.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:02.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:02.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:06:02.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:02.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:02.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:02.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: from='osd.11 ' entity='osd.11' 2024-09-10T08:06:02.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:02 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3570902752' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T08:06:02.818 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1725955537,"num_in_osds":12,"osd_in_since":1725955539,"num_remapped_pgs":0} 2024-09-10T08:06:03.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:03 smithi153 ceph-mon[35609]: purged_snaps scrub starts 2024-09-10T08:06:03.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:03 smithi153 ceph-mon[35609]: purged_snaps scrub ok 2024-09-10T08:06:03.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:03.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:03 smithi153 ceph-mon[35609]: osd.11 [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783] boot 2024-09-10T08:06:03.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:03 smithi153 ceph-mon[35609]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T08:06:03.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:03 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:03.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:03 smithi022 ceph-mon[30854]: purged_snaps scrub starts 2024-09-10T08:06:03.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:03 smithi022 ceph-mon[30854]: purged_snaps scrub ok 2024-09-10T08:06:03.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:03.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:03 smithi022 ceph-mon[30854]: osd.11 [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783] boot 2024-09-10T08:06:03.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:03 smithi022 ceph-mon[30854]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T08:06:03.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:03 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:03.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:03 smithi100 ceph-mon[35102]: purged_snaps scrub starts 2024-09-10T08:06:03.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:03 smithi100 ceph-mon[35102]: purged_snaps scrub ok 2024-09-10T08:06:03.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:03.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:03 smithi100 ceph-mon[35102]: osd.11 [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783] boot 2024-09-10T08:06:03.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:03 smithi100 ceph-mon[35102]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T08:06:03.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:03 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:06:03.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T08:06:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.565+0000 7fca722c9640 1 -- 172.21.15.22:0/1095289383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca6c107960 msgr2=0x7fca6c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.565+0000 7fca722c9640 1 --2- 172.21.15.22:0/1095289383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca6c107960 0x7fca6c109d50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fca64009ca0 tx=0x7fca6402a8c0 comp rx=0 tx=0).stop 2024-09-10T08:06:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.565+0000 7fca722c9640 1 -- 172.21.15.22:0/1095289383 shutdown_connections 2024-09-10T08:06:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.565+0000 7fca722c9640 1 --2- 172.21.15.22:0/1095289383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca6c107960 0x7fca6c109d50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.565+0000 7fca722c9640 1 --2- 172.21.15.22:0/1095289383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca6c105030 0x7fca6c107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.565+0000 7fca722c9640 1 --2- 172.21.15.22:0/1095289383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca6c102700 0x7fca6c104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.565+0000 7fca722c9640 1 -- 172.21.15.22:0/1095289383 >> 172.21.15.22:0/1095289383 conn(0x7fca6c0fc2a0 msgr2=0x7fca6c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.565+0000 7fca722c9640 1 -- 172.21.15.22:0/1095289383 shutdown_connections 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.565+0000 7fca722c9640 1 -- 172.21.15.22:0/1095289383 wait complete. 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca722c9640 1 Processor -- start 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca722c9640 1 -- start start 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca722c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca6c102700 0x7fca6c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca722c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca6c105030 0x7fca6c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca722c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca6c107960 0x7fca6c19f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca722c9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c10d8a0 con 0x7fca6c102700 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca722c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c10d720 con 0x7fca6c105030 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca722c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c10da20 con 0x7fca6c107960 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca6bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca6c102700 0x7fca6c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca6bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca6c102700 0x7fca6c197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57272/0 (socket says 172.21.15.22:57272) 2024-09-10T08:06:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca6bfff640 1 -- 172.21.15.22:0/3923142540 learned_addr learned my addr 172.21.15.22:0/3923142540 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca6bfff640 1 -- 172.21.15.22:0/3923142540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca6c107960 msgr2=0x7fca6c19f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca6bfff640 1 --2- 172.21.15.22:0/3923142540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca6c107960 0x7fca6c19f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca6bfff640 1 -- 172.21.15.22:0/3923142540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca6c105030 msgr2=0x7fca6c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca6bfff640 1 --2- 172.21.15.22:0/3923142540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca6c105030 0x7fca6c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.566+0000 7fca6bfff640 1 -- 172.21.15.22:0/3923142540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6c19f9d0 con 0x7fca6c102700 2024-09-10T08:06:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.567+0000 7fca6bfff640 1 --2- 172.21.15.22:0/3923142540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca6c102700 0x7fca6c197db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00c920 tx=0x7fca5c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.567+0000 7fca697fa640 1 -- 172.21.15.22:0/3923142540 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c007c70 con 0x7fca6c102700 2024-09-10T08:06:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.567+0000 7fca722c9640 1 -- 172.21.15.22:0/3923142540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca6c19fcc0 con 0x7fca6c102700 2024-09-10T08:06:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.567+0000 7fca697fa640 1 -- 172.21.15.22:0/3923142540 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca5c007e10 con 0x7fca6c102700 2024-09-10T08:06:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.567+0000 7fca697fa640 1 -- 172.21.15.22:0/3923142540 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c018890 con 0x7fca6c102700 2024-09-10T08:06:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.567+0000 7fca722c9640 1 -- 172.21.15.22:0/3923142540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca6c1a01f0 con 0x7fca6c102700 2024-09-10T08:06:04.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.568+0000 7fca722c9640 1 -- 172.21.15.22:0/3923142540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca6c0fdd90 con 0x7fca6c102700 2024-09-10T08:06:04.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.569+0000 7fca697fa640 1 -- 172.21.15.22:0/3923142540 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fca5c018a70 con 0x7fca6c102700 2024-09-10T08:06:04.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.570+0000 7fca697fa640 1 --2- 172.21.15.22:0/3923142540 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fca540a2b80 0x7fca540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:04.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.570+0000 7fca6b7fe640 1 --2- 172.21.15.22:0/3923142540 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fca540a2b80 0x7fca540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:04.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.570+0000 7fca697fa640 1 -- 172.21.15.22:0/3923142540 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fca5c0ceda0 con 0x7fca6c102700 2024-09-10T08:06:04.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.571+0000 7fca6b7fe640 1 --2- 172.21.15.22:0/3923142540 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fca540a2b80 0x7fca540a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca6c06b290 tx=0x7fca60005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:04.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.574+0000 7fca697fa640 1 -- 172.21.15.22:0/3923142540 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca5c014030 con 0x7fca6c102700 2024-09-10T08:06:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.749+0000 7fca722c9640 1 -- 172.21.15.22:0/3923142540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fca6c02da20 con 0x7fca6c102700 2024-09-10T08:06:04.749 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:04 smithi022 ceph-mon[30854]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:06:04.749 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:04 smithi022 ceph-mon[30854]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T08:06:04.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.750+0000 7fca697fa640 1 -- 172.21.15.22:0/3923142540 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7fca5c00de20 con 0x7fca6c102700 2024-09-10T08:06:04.750 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:04.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.752+0000 7fca722c9640 1 -- 172.21.15.22:0/3923142540 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fca540a2b80 msgr2=0x7fca540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:04.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.752+0000 7fca722c9640 1 --2- 172.21.15.22:0/3923142540 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fca540a2b80 0x7fca540a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca6c06b290 tx=0x7fca60005c70 comp rx=0 tx=0).stop 2024-09-10T08:06:04.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.752+0000 7fca722c9640 1 -- 172.21.15.22:0/3923142540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca6c102700 msgr2=0x7fca6c197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:04.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.752+0000 7fca722c9640 1 --2- 172.21.15.22:0/3923142540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca6c102700 0x7fca6c197db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00c920 tx=0x7fca5c00cde0 comp rx=0 tx=0).stop 2024-09-10T08:06:04.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.752+0000 7fca722c9640 1 -- 172.21.15.22:0/3923142540 shutdown_connections 2024-09-10T08:06:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.752+0000 7fca722c9640 1 --2- 172.21.15.22:0/3923142540 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fca540a2b80 0x7fca540a5040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.752+0000 7fca722c9640 1 --2- 172.21.15.22:0/3923142540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca6c107960 0x7fca6c19f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.752+0000 7fca722c9640 1 --2- 172.21.15.22:0/3923142540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca6c105030 0x7fca6c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.752+0000 7fca722c9640 1 --2- 172.21.15.22:0/3923142540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fca6c102700 0x7fca6c197db0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.752+0000 7fca722c9640 1 -- 172.21.15.22:0/3923142540 >> 172.21.15.22:0/3923142540 conn(0x7fca6c0fc2a0 msgr2=0x7fca6c102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.752+0000 7fca722c9640 1 -- 172.21.15.22:0/3923142540 shutdown_connections 2024-09-10T08:06:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:04.752+0000 7fca722c9640 1 -- 172.21.15.22:0/3923142540 wait complete. 2024-09-10T08:06:04.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:04 smithi100 ceph-mon[35102]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:06:04.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:04 smithi100 ceph-mon[35102]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T08:06:04.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:04 smithi153 ceph-mon[35609]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-10T08:06:04.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:04 smithi153 ceph-mon[35609]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T08:06:05.564 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1725955562,"num_in_osds":12,"osd_in_since":1725955539,"num_remapped_pgs":0} 2024-09-10T08:06:05.565 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T08:06:05.820 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:05.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:05 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3923142540' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T08:06:05.941 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:05 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3923142540' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T08:06:05.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:05 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3923142540' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-10T08:06:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.416+0000 7fd872725640 1 -- 172.21.15.22:0/1957243067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd86c10c170 msgr2=0x7fd86c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.416+0000 7fd872725640 1 --2- 172.21.15.22:0/1957243067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd86c10c170 0x7fd86c10e610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd864009ca0 tx=0x7fd86402a950 comp rx=0 tx=0).stop 2024-09-10T08:06:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.416+0000 7fd872725640 1 -- 172.21.15.22:0/1957243067 shutdown_connections 2024-09-10T08:06:06.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.416+0000 7fd872725640 1 --2- 172.21.15.22:0/1957243067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd86c10c170 0x7fd86c10e610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.416+0000 7fd872725640 1 --2- 172.21.15.22:0/1957243067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd86c103660 0x7fd86c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.416+0000 7fd872725640 1 --2- 172.21.15.22:0/1957243067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd86c102d40 0x7fd86c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.416+0000 7fd872725640 1 -- 172.21.15.22:0/1957243067 >> 172.21.15.22:0/1957243067 conn(0x7fd86c0fc7a0 msgr2=0x7fd86c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.416+0000 7fd872725640 1 -- 172.21.15.22:0/1957243067 shutdown_connections 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.416+0000 7fd872725640 1 -- 172.21.15.22:0/1957243067 wait complete. 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.417+0000 7fd872725640 1 Processor -- start 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.417+0000 7fd872725640 1 -- start start 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.417+0000 7fd872725640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd86c102d40 0x7fd86c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.417+0000 7fd872725640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd86c103660 0x7fd86c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.417+0000 7fd872725640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd86c10c170 0x7fd86c19cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.417+0000 7fd872725640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c111f30 con 0x7fd86c10c170 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.417+0000 7fd872725640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c111db0 con 0x7fd86c102d40 2024-09-10T08:06:06.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.417+0000 7fd872725640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c1120b0 con 0x7fd86c103660 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd870cc2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd86c10c170 0x7fd86c19cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd870cc2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd86c10c170 0x7fd86c19cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57290/0 (socket says 172.21.15.22:57290) 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd870cc2640 1 -- 172.21.15.22:0/2121099754 learned_addr learned my addr 172.21.15.22:0/2121099754 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd86b7fe640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd86c103660 0x7fd86c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd86bfff640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd86c102d40 0x7fd86c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd870cc2640 1 -- 172.21.15.22:0/2121099754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd86c103660 msgr2=0x7fd86c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd870cc2640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd86c103660 0x7fd86c198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd870cc2640 1 -- 172.21.15.22:0/2121099754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd86c102d40 msgr2=0x7fd86c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd870cc2640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd86c102d40 0x7fd86c198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd870cc2640 1 -- 172.21.15.22:0/2121099754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86c19d3f0 con 0x7fd86c10c170 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd86b7fe640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd86c103660 0x7fd86c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd870cc2640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd86c10c170 0x7fd86c19cd10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd86402ae70 tx=0x7fd86402f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:06.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd8697fa640 1 -- 172.21.15.22:0/2121099754 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd864034040 con 0x7fd86c10c170 2024-09-10T08:06:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd8697fa640 1 -- 172.21.15.22:0/2121099754 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd864030920 con 0x7fd86c10c170 2024-09-10T08:06:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd872725640 1 -- 172.21.15.22:0/2121099754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd86c19d680 con 0x7fd86c10c170 2024-09-10T08:06:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd8697fa640 1 -- 172.21.15.22:0/2121099754 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd864045480 con 0x7fd86c10c170 2024-09-10T08:06:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.418+0000 7fd872725640 1 -- 172.21.15.22:0/2121099754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd86c1a4fc0 con 0x7fd86c10c170 2024-09-10T08:06:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.420+0000 7fd872725640 1 -- 172.21.15.22:0/2121099754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd86c103120 con 0x7fd86c10c170 2024-09-10T08:06:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.421+0000 7fd8697fa640 1 -- 172.21.15.22:0/2121099754 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd864037020 con 0x7fd86c10c170 2024-09-10T08:06:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.421+0000 7fd8697fa640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fd8540a2b80 0x7fd8540a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.421+0000 7fd86bfff640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fd8540a2b80 0x7fd8540a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.421+0000 7fd8697fa640 1 -- 172.21.15.22:0/2121099754 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd8640efa50 con 0x7fd86c10c170 2024-09-10T08:06:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.422+0000 7fd86bfff640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fd8540a2b80 0x7fd8540a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00bbe0 tx=0x7fd85c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:06.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.425+0000 7fd8697fa640 1 -- 172.21.15.22:0/2121099754 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd8640bce50 con 0x7fd86c10c170 2024-09-10T08:06:06.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.603+0000 7fd872725640 1 -- 172.21.15.22:0/2121099754 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd86c1071e0 con 0x7fd86c10c170 2024-09-10T08:06:06.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.604+0000 7fd8697fa640 1 -- 172.21.15.22:0/2121099754 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18501 (secure 0 0 0) 0x7fd8640bc750 con 0x7fd86c10c170 2024-09-10T08:06:06.604 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:06.604 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":76,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","created":"2024-09-10T07:59:04.704048+0000","modified":"2024-09-10T08:06:03.537618+0000","last_up_change":"2024-09-10T08:06:02.535944+0000","last_in_change":"2024-09-10T08:05:39.070554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:02:15.371265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d296bd3-28a7-418c-ad73-343a5e806cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6803","nonce":4248555152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6805","nonce":4248555152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6809","nonce":4248555152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6807","nonce":4248555152}]},"public_addr":"172.21.15.22:6803/4248555152","cluster_addr":"172.21.15.22:6805/4248555152","heartbeat_back_addr":"172.21.15.22:6809/4248555152","heartbeat_front_addr":"172.21.15.22:6807/4248555152","state":["exists","up"]},{"osd":1,"uuid":"c1e2b40e-b4ab-475a-8a9e-c67409f46b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6801","nonce":2078646052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6803","nonce":2078646052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6807","nonce":2078646052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6805","nonce":2078646052}]},"public_addr":"172.21.15.100:6801/2078646052","cluster_addr":"172.21.15.100:6803/2078646052","heartbeat_back_addr":"172.21.15.100:6807/2078646052","heartbeat_front_addr":"172.21.15.100:6805/2078646052","state":["exists","up"]},{"osd":2,"uuid":"be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6801","nonce":2492419476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6803","nonce":2492419476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6807","nonce":2492419476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6805","nonce":2492419476}]},"public_addr":"172.21.15.153:6801/2492419476","cluster_addr":"172.21.15.153:6803/2492419476","heartbeat_back_addr":"172.21.15.153:6807/2492419476","heartbeat_front_addr":"172.21.15.153:6805/2492419476","state":["exists","up"]},{"osd":3,"uuid":"e980a3ba-c659-4473-9633-9cbe88296d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6811","nonce":3674495276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6813","nonce":3674495276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6817","nonce":3674495276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6815","nonce":3674495276}]},"public_addr":"172.21.15.22:6811/3674495276","cluster_addr":"172.21.15.22:6813/3674495276","heartbeat_back_addr":"172.21.15.22:6817/3674495276","heartbeat_front_addr":"172.21.15.22:6815/3674495276","state":["exists","up"]},{"osd":4,"uuid":"b37d0590-99b1-4566-96b4-9936890d4308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6809","nonce":3886932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6811","nonce":3886932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6815","nonce":3886932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6813","nonce":3886932513}]},"public_addr":"172.21.15.100:6809/3886932513","cluster_addr":"172.21.15.100:6811/3886932513","heartbeat_back_addr":"172.21.15.100:6815/3886932513","heartbeat_front_addr":"172.21.15.100:6813/3886932513","state":["exists","up"]},{"osd":5,"uuid":"6cb989a0-80a1-4a9a-8b45-51b47772b203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6809","nonce":120732073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6811","nonce":120732073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6815","nonce":120732073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6813","nonce":120732073}]},"public_addr":"172.21.15.153:6809/120732073","cluster_addr":"172.21.15.153:6811/120732073","heartbeat_back_addr":"172.21.15.153:6815/120732073","heartbeat_front_addr":"172.21.15.153:6813/120732073","state":["exists","up"]},{"osd":6,"uuid":"294887f3-3e58-4b02-884d-4e0a70a86d16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6819","nonce":3692536487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6821","nonce":3692536487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6825","nonce":3692536487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6823","nonce":3692536487}]},"public_addr":"172.21.15.22:6819/3692536487","cluster_addr":"172.21.15.22:6821/3692536487","heartbeat_back_addr":"172.21.15.22:6825/3692536487","heartbeat_front_addr":"172.21.15.22:6823/3692536487","state":["exists","up"]},{"osd":7,"uuid":"d0c0ec61-4055-46f3-a4b0-39f04c735452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6817","nonce":1221175921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6819","nonce":1221175921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6823","nonce":1221175921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6821","nonce":1221175921}]},"public_addr":"172.21.15.100:6817/1221175921","cluster_addr":"172.21.15.100:6819/1221175921","heartbeat_back_addr":"172.21.15.100:6823/1221175921","heartbeat_front_addr":"172.21.15.100:6821/1221175921","state":["exists","up"]},{"osd":8,"uuid":"bda45a16-742e-4eda-b4d4-e01d6f3dc92e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6817","nonce":1153053941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6819","nonce":1153053941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6823","nonce":1153053941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6821","nonce":1153053941}]},"public_addr":"172.21.15.153:6817/1153053941","cluster_addr":"172.21.15.153:6819/1153053941","heartbeat_back_addr":"172.21.15.153:6823/1153053941","heartbeat_front_addr":"172.21.15.153:6821/1153053941","state":["exists","up"]},{"osd":9,"uuid":"48bd3544-9028-4535-801b-3d39ecadf48e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6827","nonce":3423218876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6829","nonce":3423218876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6833","nonce":3423218876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6831","nonce":3423218876}]},"public_addr":"172.21.15.22:6827/3423218876","cluster_addr":"172.21.15.22:6829/3423218876","heartbeat_back_addr":"172.21.15.22:6833/3423218876","heartbeat_front_addr":"172.21.15.22:6831/3423218876","state":["exists","up"]},{"osd":10,"uuid":"c8716aa0-eb93-435d-a9d0-dd4c3dce1954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6825","nonce":2024112643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6827","nonce":2024112643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6831","nonce":2024112643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6829","nonce":2024112643}]},"public_addr":"172.21.15.100:6825/2024112643","cluster_addr":"172.21.15.100:6827/2024112643","heartbeat_back_addr":"172.21.15.100:6831/2024112643","heartbeat_front_addr":"172.21.15.100:6829/2024112643","state":["exists","up"]},{"osd":11,"uuid":"3c427cfe-8d7c-431e-9eb4-b03cfac3068d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6825","nonce":2245781783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6827","nonce":2245781783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6831","nonce":2245781783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6829","nonce":2245781783}]},"public_addr":"172.21.15.153:6825/2245781783","cluster_addr":"172.21.15.153:6827/2245781783","heartbeat_back_addr":"172.21.15.153:6831/2245781783","heartbeat_front_addr":"172.21.15.153:6829/2245781783","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:23.001057+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:46.353182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:11.469840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:37.557521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:02.630783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:27.374057+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:53.758498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:19.507846+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:45.080789+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:10.286820+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:35.565950+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:06:00.633384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3072001022":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/1519904928":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6801/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/2108462626":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/3337107310":"2024-09-11T07:59:36.505631+0000","172.21.15.22:6801/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/1708436544":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/278091300":"2024-09-11T07:59:36.505631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:06:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.606+0000 7fd872725640 1 -- 172.21.15.22:0/2121099754 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fd8540a2b80 msgr2=0x7fd8540a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.606+0000 7fd872725640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fd8540a2b80 0x7fd8540a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00bbe0 tx=0x7fd85c00b390 comp rx=0 tx=0).stop 2024-09-10T08:06:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.606+0000 7fd872725640 1 -- 172.21.15.22:0/2121099754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd86c10c170 msgr2=0x7fd86c19cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.606+0000 7fd872725640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd86c10c170 0x7fd86c19cd10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd86402ae70 tx=0x7fd86402f5b0 comp rx=0 tx=0).stop 2024-09-10T08:06:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.606+0000 7fd872725640 1 -- 172.21.15.22:0/2121099754 shutdown_connections 2024-09-10T08:06:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.606+0000 7fd872725640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fd8540a2b80 0x7fd8540a5040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.606+0000 7fd872725640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd86c10c170 0x7fd86c19cd10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.606+0000 7fd872725640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd86c103660 0x7fd86c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.606+0000 7fd872725640 1 --2- 172.21.15.22:0/2121099754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd86c102d40 0x7fd86c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.606+0000 7fd872725640 1 -- 172.21.15.22:0/2121099754 >> 172.21.15.22:0/2121099754 conn(0x7fd86c0fc7a0 msgr2=0x7fd86c0fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.606+0000 7fd872725640 1 -- 172.21.15.22:0/2121099754 shutdown_connections 2024-09-10T08:06:06.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:06.606+0000 7fd872725640 1 -- 172.21.15.22:0/2121099754 wait complete. 2024-09-10T08:06:06.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:06 smithi100 ceph-mon[35102]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:06.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:06 smithi153 ceph-mon[35609]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:06 smithi022 ceph-mon[30854]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:07.387 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:02:15.371265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:06:07.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T08:06:07.642 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:07.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:07 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2121099754' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:06:07.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:07 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2121099754' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:06:07.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:07 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2121099754' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:06:08.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.111+0000 7f562a91a640 1 -- 172.21.15.22:0/4201932174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5624102da0 msgr2=0x7f5624103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:08.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.111+0000 7f562a91a640 1 --2- 172.21.15.22:0/4201932174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5624102da0 0x7f5624103180 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5614009900 tx=0x7f561402a480 comp rx=0 tx=0).stop 2024-09-10T08:06:08.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.111+0000 7f562a91a640 1 -- 172.21.15.22:0/4201932174 shutdown_connections 2024-09-10T08:06:08.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.111+0000 7f562a91a640 1 --2- 172.21.15.22:0/4201932174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f562410c180 0x7f562410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:08.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.111+0000 7f562a91a640 1 --2- 172.21.15.22:0/4201932174 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56241036c0 0x7f562410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:08.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.111+0000 7f562a91a640 1 --2- 172.21.15.22:0/4201932174 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5624102da0 0x7f5624103180 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:08.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.111+0000 7f562a91a640 1 -- 172.21.15.22:0/4201932174 >> 172.21.15.22:0/4201932174 conn(0x7f56240fc7a0 msgr2=0x7f56240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:08.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.111+0000 7f562a91a640 1 -- 172.21.15.22:0/4201932174 shutdown_connections 2024-09-10T08:06:08.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.111+0000 7f562a91a640 1 -- 172.21.15.22:0/4201932174 wait complete. 2024-09-10T08:06:08.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.112+0000 7f562a91a640 1 Processor -- start 2024-09-10T08:06:08.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.112+0000 7f562a91a640 1 -- start start 2024-09-10T08:06:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.112+0000 7f562a91a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5624102da0 0x7f5624198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.112+0000 7f562a91a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56241036c0 0x7f56241989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.112+0000 7f562a91a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f562410c180 0x7f562419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.112+0000 7f562a91a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5624111fb0 con 0x7f56241036c0 2024-09-10T08:06:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.112+0000 7f562a91a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5624111e30 con 0x7f5624102da0 2024-09-10T08:06:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.112+0000 7f562a91a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5624112130 con 0x7f562410c180 2024-09-10T08:06:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.112+0000 7f56237fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56241036c0 0x7f56241989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.112+0000 7f56237fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56241036c0 0x7f56241989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57304/0 (socket says 172.21.15.22:57304) 2024-09-10T08:06:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.112+0000 7f56237fe640 1 -- 172.21.15.22:0/4053824570 learned_addr learned my addr 172.21.15.22:0/4053824570 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f5623fff640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5624102da0 0x7f5624198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f5628eb7640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f562410c180 0x7f562419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:08.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f56237fe640 1 -- 172.21.15.22:0/4053824570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f562410c180 msgr2=0x7f562419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f56237fe640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f562410c180 0x7f562419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f56237fe640 1 -- 172.21.15.22:0/4053824570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5624102da0 msgr2=0x7f5624198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f56237fe640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5624102da0 0x7f5624198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f56237fe640 1 -- 172.21.15.22:0/4053824570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562419d440 con 0x7f56241036c0 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f56237fe640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56241036c0 0x7f56241989d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f561800d770 tx=0x7f561800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f56217fa640 1 -- 172.21.15.22:0/4053824570 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618017070 con 0x7f56241036c0 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f56217fa640 1 -- 172.21.15.22:0/4053824570 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5618005500 con 0x7f56241036c0 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f562a91a640 1 -- 172.21.15.22:0/4053824570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562419d730 con 0x7f56241036c0 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f56217fa640 1 -- 172.21.15.22:0/4053824570 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618004e00 con 0x7f56241036c0 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.113+0000 7f562a91a640 1 -- 172.21.15.22:0/4053824570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56241a5010 con 0x7f56241036c0 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.114+0000 7f562a91a640 1 -- 172.21.15.22:0/4053824570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5624103180 con 0x7f56241036c0 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.115+0000 7f56217fa640 1 -- 172.21.15.22:0/4053824570 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f5618004fa0 con 0x7f56241036c0 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.116+0000 7f56217fa640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f560c0a2c00 0x7f560c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.116+0000 7f5623fff640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f560c0a2c00 0x7f560c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:08.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.116+0000 7f56217fa640 1 -- 172.21.15.22:0/4053824570 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f56180ce560 con 0x7f56241036c0 2024-09-10T08:06:08.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.116+0000 7f5623fff640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f560c0a2c00 0x7f560c0a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5614000c00 tx=0x7f5614005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:08.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.120+0000 7f56217fa640 1 -- 172.21.15.22:0/4053824570 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f561809b270 con 0x7f56241036c0 2024-09-10T08:06:08.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.295+0000 7f562a91a640 1 -- 172.21.15.22:0/4053824570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f562402d7c0 con 0x7f56241036c0 2024-09-10T08:06:08.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.295+0000 7f56217fa640 1 -- 172.21.15.22:0/4053824570 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f561809f570 con 0x7f56241036c0 2024-09-10T08:06:08.295 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-09-10T08:06:08.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.297+0000 7f562a91a640 1 -- 172.21.15.22:0/4053824570 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f560c0a2c00 msgr2=0x7f560c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:08.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.297+0000 7f562a91a640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f560c0a2c00 0x7f560c0a50c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5614000c00 tx=0x7f5614005b50 comp rx=0 tx=0).stop 2024-09-10T08:06:08.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.297+0000 7f562a91a640 1 -- 172.21.15.22:0/4053824570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56241036c0 msgr2=0x7f56241989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:08.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.297+0000 7f562a91a640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56241036c0 0x7f56241989d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f561800d770 tx=0x7f561800dc30 comp rx=0 tx=0).stop 2024-09-10T08:06:08.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.297+0000 7f562a91a640 1 -- 172.21.15.22:0/4053824570 shutdown_connections 2024-09-10T08:06:08.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.297+0000 7f562a91a640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f560c0a2c00 0x7f560c0a50c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:08.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.297+0000 7f562a91a640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f562410c180 0x7f562419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:08.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.297+0000 7f562a91a640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56241036c0 0x7f56241989d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:08.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.297+0000 7f562a91a640 1 --2- 172.21.15.22:0/4053824570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5624102da0 0x7f5624198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:08.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.297+0000 7f562a91a640 1 -- 172.21.15.22:0/4053824570 >> 172.21.15.22:0/4053824570 conn(0x7f56240fc7a0 msgr2=0x7f56240fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:08.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.297+0000 7f562a91a640 1 -- 172.21.15.22:0/4053824570 shutdown_connections 2024-09-10T08:06:08.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:08.297+0000 7f562a91a640 1 -- 172.21.15.22:0/4053824570 wait complete. 2024-09-10T08:06:08.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:08 smithi100 ceph-mon[35102]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:08.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:08 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/4053824570' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T08:06:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:08 smithi153 ceph-mon[35609]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:08 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/4053824570' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T08:06:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:08 smithi022 ceph-mon[30854]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:08 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/4053824570' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T08:06:09.042 INFO:tasks.cephadm:Adding mds.a on smithi022 2024-09-10T08:06:09.042 INFO:tasks.cephadm:Adding mds.d on smithi022 2024-09-10T08:06:09.042 INFO:tasks.cephadm:Adding mds.g on smithi022 2024-09-10T08:06:09.042 INFO:tasks.cephadm:Adding mds.j on smithi022 2024-09-10T08:06:09.042 INFO:tasks.cephadm:Adding mds.b on smithi100 2024-09-10T08:06:09.042 INFO:tasks.cephadm:Adding mds.e on smithi100 2024-09-10T08:06:09.043 INFO:tasks.cephadm:Adding mds.h on smithi100 2024-09-10T08:06:09.043 INFO:tasks.cephadm:Adding mds.k on smithi100 2024-09-10T08:06:09.043 INFO:tasks.cephadm:Adding mds.c on smithi153 2024-09-10T08:06:09.043 INFO:tasks.cephadm:Adding mds.f on smithi153 2024-09-10T08:06:09.043 INFO:tasks.cephadm:Adding mds.i on smithi153 2024-09-10T08:06:09.043 INFO:tasks.cephadm:Adding mds.l on smithi153 2024-09-10T08:06:09.043 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l' 2024-09-10T08:06:09.303 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:06:09.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.781+0000 7faeaef03640 1 -- 172.21.15.153:0/1715615216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faea8100b10 msgr2=0x7faea8100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:09.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.781+0000 7faeaef03640 1 --2- 172.21.15.153:0/1715615216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faea8100b10 0x7faea8100f10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009900 tx=0x7fae9c02a410 comp rx=0 tx=0).stop 2024-09-10T08:06:09.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.781+0000 7faeaef03640 1 -- 172.21.15.153:0/1715615216 shutdown_connections 2024-09-10T08:06:09.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.781+0000 7faeaef03640 1 --2- 172.21.15.153:0/1715615216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faea81026d0 0x7faea8108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:09.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.781+0000 7faeaef03640 1 --2- 172.21.15.153:0/1715615216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faea8101d10 0x7faea8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:09.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.781+0000 7faeaef03640 1 --2- 172.21.15.153:0/1715615216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faea8100b10 0x7faea8100f10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.781+0000 7faeaef03640 1 -- 172.21.15.153:0/1715615216 >> 172.21.15.153:0/1715615216 conn(0x7faea80fc2a0 msgr2=0x7faea80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.781+0000 7faeaef03640 1 -- 172.21.15.153:0/1715615216 shutdown_connections 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.781+0000 7faeaef03640 1 -- 172.21.15.153:0/1715615216 wait complete. 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.782+0000 7faeaef03640 1 Processor -- start 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.782+0000 7faeaef03640 1 -- start start 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.782+0000 7faeaef03640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faea8100b10 0x7faea810b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.782+0000 7faeaef03640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faea8101d10 0x7faea8109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.782+0000 7faeaef03640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faea81026d0 0x7faea810a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.782+0000 7faeaef03640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faea810d920 con 0x7faea81026d0 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.782+0000 7faeaef03640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faea810d7a0 con 0x7faea8100b10 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.782+0000 7faeaef03640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faea810daa0 con 0x7faea8101d10 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.782+0000 7faea7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faea8101d10 0x7faea8109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:09.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.782+0000 7faea7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faea8101d10 0x7faea8109ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36210/0 (socket says 172.21.15.153:36210) 2024-09-10T08:06:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.782+0000 7faea7fff640 1 -- 172.21.15.153:0/2641753568 learned_addr learned my addr 172.21.15.153:0/2641753568 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-10T08:06:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.782+0000 7faeacc9f640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faea8100b10 0x7faea810b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.783+0000 7faea7fff640 1 -- 172.21.15.153:0/2641753568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faea8100b10 msgr2=0x7faea810b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.783+0000 7faead4a0640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faea81026d0 0x7faea810a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.783+0000 7faea7fff640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faea8100b10 0x7faea810b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.783+0000 7faea7fff640 1 -- 172.21.15.153:0/2641753568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faea81026d0 msgr2=0x7faea810a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.783+0000 7faea7fff640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faea81026d0 0x7faea810a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.783+0000 7faea7fff640 1 -- 172.21.15.153:0/2641753568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea810a8e0 con 0x7faea8101d10 2024-09-10T08:06:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.783+0000 7faea7fff640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faea8101d10 0x7faea8109ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae9400b4a0 tx=0x7fae9400b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.783+0000 7faea5ffb640 1 -- 172.21.15.153:0/2641753568 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94014070 con 0x7faea8101d10 2024-09-10T08:06:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.783+0000 7faeaef03640 1 -- 172.21.15.153:0/2641753568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea81a2120 con 0x7faea8101d10 2024-09-10T08:06:09.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.783+0000 7faea5ffb640 1 -- 172.21.15.153:0/2641753568 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae94010af0 con 0x7faea8101d10 2024-09-10T08:06:09.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.783+0000 7faea5ffb640 1 -- 172.21.15.153:0/2641753568 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae94017d10 con 0x7faea8101d10 2024-09-10T08:06:09.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.783+0000 7faeaef03640 1 -- 172.21.15.153:0/2641753568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea81a2700 con 0x7faea8101d10 2024-09-10T08:06:09.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.784+0000 7faeaef03640 1 -- 172.21.15.153:0/2641753568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea8100f10 con 0x7faea8101d10 2024-09-10T08:06:09.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.785+0000 7faea5ffb640 1 -- 172.21.15.153:0/2641753568 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fae94017070 con 0x7faea8101d10 2024-09-10T08:06:09.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.786+0000 7faea5ffb640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fae980a2b80 0x7fae980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:09.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.786+0000 7faea5ffb640 1 -- 172.21.15.153:0/2641753568 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fae940cdf00 con 0x7faea8101d10 2024-09-10T08:06:09.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.786+0000 7faeacc9f640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fae980a2b80 0x7fae980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:09.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.787+0000 7faeacc9f640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fae980a2b80 0x7fae980a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae9c005ab0 tx=0x7fae9c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:09.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.790+0000 7faea5ffb640 1 -- 172.21.15.153:0/2641753568 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae9409b300 con 0x7faea8101d10 2024-09-10T08:06:09.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.967+0000 7faeaef03640 1 -- 172.21.15.153:0/2641753568 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}) -- 0x7faea8062830 con 0x7fae980a2b80 2024-09-10T08:06:09.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.976+0000 7faea5ffb640 1 -- 172.21.15.153:0/2641753568 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7faea8062830 con 0x7fae980a2b80 2024-09-10T08:06:09.975 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mds.all update... 2024-09-10T08:06:09.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.978+0000 7faeaef03640 1 -- 172.21.15.153:0/2641753568 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fae980a2b80 msgr2=0x7fae980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:09.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.978+0000 7faeaef03640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fae980a2b80 0x7fae980a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae9c005ab0 tx=0x7fae9c000bc0 comp rx=0 tx=0).stop 2024-09-10T08:06:09.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.978+0000 7faeaef03640 1 -- 172.21.15.153:0/2641753568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faea8101d10 msgr2=0x7faea8109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:09.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.978+0000 7faeaef03640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faea8101d10 0x7faea8109ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae9400b4a0 tx=0x7fae9400b960 comp rx=0 tx=0).stop 2024-09-10T08:06:09.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.978+0000 7faeaef03640 1 -- 172.21.15.153:0/2641753568 shutdown_connections 2024-09-10T08:06:09.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.978+0000 7faeaef03640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fae980a2b80 0x7fae980a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:09.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.978+0000 7faeaef03640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faea81026d0 0x7faea810a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:09.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.978+0000 7faeaef03640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faea8101d10 0x7faea8109ae0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:09.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.978+0000 7faeaef03640 1 --2- 172.21.15.153:0/2641753568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faea8100b10 0x7faea810b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:09.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.978+0000 7faeaef03640 1 -- 172.21.15.153:0/2641753568 >> 172.21.15.153:0/2641753568 conn(0x7faea80fc2a0 msgr2=0x7faea81050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:09.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.978+0000 7faeaef03640 1 -- 172.21.15.153:0/2641753568 shutdown_connections 2024-09-10T08:06:09.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-10T08:06:09.978+0000 7faeaef03640 1 -- 172.21.15.153:0/2641753568 wait complete. 2024-09-10T08:06:10.670 DEBUG:teuthology.orchestra.run.smithi022:mds.a> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T08:06:10.673 DEBUG:teuthology.orchestra.run.smithi022:mds.d> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T08:06:10.716 DEBUG:teuthology.orchestra.run.smithi022:mds.g> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T08:06:10.759 DEBUG:teuthology.orchestra.run.smithi022:mds.j> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T08:06:10.802 DEBUG:teuthology.orchestra.run.smithi100:mds.b> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T08:06:10.805 DEBUG:teuthology.orchestra.run.smithi100:mds.e> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T08:06:10.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:10 smithi022 ceph-mon[30854]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:10.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:10 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:10.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:10 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:06:10.821 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:10 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:10.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:10 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:10.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:10 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:10.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:10 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:10.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:10 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:10.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:10 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:10.825 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:10 smithi100 ceph-mon[35102]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:10.825 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:10 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:10.825 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:10 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:06:10.825 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:10 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:10.826 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:10 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:10.826 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:10 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:10.826 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:10 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:10.826 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:10 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:10.826 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:10 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:10.827 DEBUG:teuthology.orchestra.run.smithi100:mds.h> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T08:06:10.835 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:10 smithi153 ceph-mon[35609]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:10.835 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:10 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:10.835 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:10 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:06:10.835 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:10 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:10.836 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:10 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:10.836 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:10 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:10.836 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:10 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:10.836 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:10 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:10.836 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:10 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:10.870 DEBUG:teuthology.orchestra.run.smithi100:mds.k> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T08:06:10.913 DEBUG:teuthology.orchestra.run.smithi153:mds.c> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T08:06:10.916 DEBUG:teuthology.orchestra.run.smithi153:mds.f> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T08:06:10.960 DEBUG:teuthology.orchestra.run.smithi153:mds.i> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T08:06:11.003 DEBUG:teuthology.orchestra.run.smithi153:mds.l> sudo journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T08:06:11.046 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T08:06:11.046 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:06:11.301 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:11.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:11 smithi022 ceph-mon[30854]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:06:11.728 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:11 smithi022 ceph-mon[30854]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-09-10T08:06:11.728 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:11 smithi022 ceph-mon[30854]: Deploying daemon mds.l on smithi153 2024-09-10T08:06:11.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.811+0000 7f81ab194640 1 -- 172.21.15.22:0/483608978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4102790 msgr2=0x7f81a41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:11.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.811+0000 7f81ab194640 1 --2- 172.21.15.22:0/483608978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4102790 0x7f81a41067e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f818c009900 tx=0x7f818c02a410 comp rx=0 tx=0).stop 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.811+0000 7f81ab194640 1 -- 172.21.15.22:0/483608978 shutdown_connections 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.811+0000 7f81ab194640 1 --2- 172.21.15.22:0/483608978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a4106f10 0x7f81a410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.811+0000 7f81ab194640 1 --2- 172.21.15.22:0/483608978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4102790 0x7f81a41067e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.811+0000 7f81ab194640 1 --2- 172.21.15.22:0/483608978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a4101de0 0x7f81a41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.811+0000 7f81ab194640 1 -- 172.21.15.22:0/483608978 >> 172.21.15.22:0/483608978 conn(0x7f81a40fd8c0 msgr2=0x7f81a40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.811+0000 7f81ab194640 1 -- 172.21.15.22:0/483608978 shutdown_connections 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.811+0000 7f81ab194640 1 -- 172.21.15.22:0/483608978 wait complete. 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81ab194640 1 Processor -- start 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81ab194640 1 -- start start 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81ab194640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101de0 0x7f81a4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81ab194640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a4102790 0x7f81a41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81ab194640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a4106f10 0x7f81a419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:11.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81ab194640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f81a4111f70 con 0x7f81a4101de0 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81ab194640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f81a4111df0 con 0x7f81a4106f10 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81ab194640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f81a41120f0 con 0x7f81a4102790 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81a8f30640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101de0 0x7f81a4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81a8f30640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101de0 0x7f81a4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57316/0 (socket says 172.21.15.22:57316) 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81a8f30640 1 -- 172.21.15.22:0/2371828703 learned_addr learned my addr 172.21.15.22:0/2371828703 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81a3fff640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a4102790 0x7f81a41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81a9731640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a4106f10 0x7f81a419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81a8f30640 1 -- 172.21.15.22:0/2371828703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a4102790 msgr2=0x7f81a41989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81a8f30640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a4102790 0x7f81a41989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81a8f30640 1 -- 172.21.15.22:0/2371828703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a4106f10 msgr2=0x7f81a419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81a8f30640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a4106f10 0x7f81a419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.812+0000 7f81a8f30640 1 -- 172.21.15.22:0/2371828703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a419d440 con 0x7f81a4101de0 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.813+0000 7f81a8f30640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101de0 0x7f81a4198490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f819400d770 tx=0x7f819400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:11.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.813+0000 7f81a1ffb640 1 -- 172.21.15.22:0/2371828703 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8194017070 con 0x7f81a4101de0 2024-09-10T08:06:11.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.813+0000 7f81a1ffb640 1 -- 172.21.15.22:0/2371828703 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8194005500 con 0x7f81a4101de0 2024-09-10T08:06:11.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.813+0000 7f81ab194640 1 -- 172.21.15.22:0/2371828703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a419d730 con 0x7f81a4101de0 2024-09-10T08:06:11.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.813+0000 7f81a1ffb640 1 -- 172.21.15.22:0/2371828703 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8194004e00 con 0x7f81a4101de0 2024-09-10T08:06:11.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.813+0000 7f81ab194640 1 -- 172.21.15.22:0/2371828703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a41a5010 con 0x7f81a4101de0 2024-09-10T08:06:11.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.814+0000 7f81ab194640 1 -- 172.21.15.22:0/2371828703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a41021c0 con 0x7f81a4101de0 2024-09-10T08:06:11.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.816+0000 7f81a1ffb640 1 -- 172.21.15.22:0/2371828703 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8194004fa0 con 0x7f81a4101de0 2024-09-10T08:06:11.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.817+0000 7f81a1ffb640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f81900a2c00 0x7f81900a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:11.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.817+0000 7f81a3fff640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f81900a2c00 0x7f81900a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:11.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.817+0000 7f81a1ffb640 1 -- 172.21.15.22:0/2371828703 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f81940cea80 con 0x7f81a4101de0 2024-09-10T08:06:11.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.817+0000 7f81a3fff640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f81900a2c00 0x7f81900a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f818c009230 tx=0x7f818c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:11.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:11.820+0000 7f81a1ffb640 1 -- 172.21.15.22:0/2371828703 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f819409be60 con 0x7f81a4101de0 2024-09-10T08:06:11.867 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:11 smithi153 ceph-mon[35609]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:06:11.867 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:11 smithi153 ceph-mon[35609]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-09-10T08:06:11.867 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:11 smithi153 ceph-mon[35609]: Deploying daemon mds.l on smithi153 2024-09-10T08:06:11.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:11 smithi100 ceph-mon[35102]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:06:11.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:11 smithi100 ceph-mon[35102]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-09-10T08:06:11.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:11 smithi100 ceph-mon[35102]: Deploying daemon mds.l on smithi153 2024-09-10T08:06:12.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.029+0000 7f81ab194640 1 -- 172.21.15.22:0/2371828703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81a41997f0 con 0x7f81a4101de0 2024-09-10T08:06:12.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.030+0000 7f81a1ffb640 1 -- 172.21.15.22:0/2371828703 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f81a41997f0 con 0x7f81a4101de0 2024-09-10T08:06:12.029 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:12.029 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":1,"btime":"2024-09-10T07:59:04:703892+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T08:06:12.030 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 1 2024-09-10T08:06:12.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.032+0000 7f81ab194640 1 -- 172.21.15.22:0/2371828703 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f81900a2c00 msgr2=0x7f81900a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:12.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.032+0000 7f81ab194640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f81900a2c00 0x7f81900a50c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f818c009230 tx=0x7f818c0058d0 comp rx=0 tx=0).stop 2024-09-10T08:06:12.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.032+0000 7f81ab194640 1 -- 172.21.15.22:0/2371828703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101de0 msgr2=0x7f81a4198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.032+0000 7f81ab194640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101de0 0x7f81a4198490 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f819400d770 tx=0x7f819400dc30 comp rx=0 tx=0).stop 2024-09-10T08:06:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.032+0000 7f81ab194640 1 -- 172.21.15.22:0/2371828703 shutdown_connections 2024-09-10T08:06:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.032+0000 7f81ab194640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f81900a2c00 0x7f81900a50c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.032+0000 7f81ab194640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81a4106f10 0x7f81a419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.032+0000 7f81ab194640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a4102790 0x7f81a41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.032+0000 7f81ab194640 1 --2- 172.21.15.22:0/2371828703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f81a4101de0 0x7f81a4198490 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.032+0000 7f81ab194640 1 -- 172.21.15.22:0/2371828703 >> 172.21.15.22:0/2371828703 conn(0x7f81a40fd8c0 msgr2=0x7f81a40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.032+0000 7f81ab194640 1 -- 172.21.15.22:0/2371828703 shutdown_connections 2024-09-10T08:06:12.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:12.032+0000 7f81ab194640 1 -- 172.21.15.22:0/2371828703 wait complete. 2024-09-10T08:06:12.444 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:06:12 smithi153 systemd[1]: Starting Ceph mds.l for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:06:12.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:12 smithi022 ceph-mon[30854]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:12.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:12 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2371828703' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:12.821 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:12 smithi153 ceph-mon[35609]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:12.821 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:12 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2371828703' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:12.821 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:06:12 smithi153 podman[64939]: 2024-09-10 08:06:12.482294591 +0000 UTC m=+0.016228180 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:06:12.821 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:06:12 smithi153 podman[64939]: 2024-09-10 08:06:12.586951539 +0000 UTC m=+0.120885120 container create 3feb709348bc0754b4360383e3e478062fd8d9dc3e5e990a4f395ebefa42a8be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T08:06:12.821 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:06:12 smithi153 podman[64939]: 2024-09-10 08:06:12.822858644 +0000 UTC m=+0.356792218 container init 3feb709348bc0754b4360383e3e478062fd8d9dc3e5e990a4f395ebefa42a8be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:06:12.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:12 smithi100 ceph-mon[35102]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:12.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:12 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2371828703' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:13.198 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:06:12 smithi153 podman[64939]: 2024-09-10 08:06:12.825843494 +0000 UTC m=+0.359777070 container start 3feb709348bc0754b4360383e3e478062fd8d9dc3e5e990a4f395ebefa42a8be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-l, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T08:06:13.198 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:06:12 smithi153 ceph-mds[64958]: -- 172.21.15.153:0/4138387024 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5562c04a9860 con 0x5562c0487000 2024-09-10T08:06:13.198 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:06:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-l[64954]: starting mds.l at 2024-09-10T08:06:13.198 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:06:12 smithi153 bash[64939]: 3feb709348bc0754b4360383e3e478062fd8d9dc3e5e990a4f395ebefa42a8be 2024-09-10T08:06:13.198 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:06:12 smithi153 systemd[1]: Started Ceph mds.l for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:06:14.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:13 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.153:6832/3705787109,v1:172.21.15.153:6833/3705787109] up:boot 2024-09-10T08:06:14.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:13 smithi100 ceph-mon[35102]: fsmap 1 up:standby 2024-09-10T08:06:14.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T08:06:14.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:14.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:14.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:14.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:14.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:14.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:13 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:14.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:13 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.153:6832/3705787109,v1:172.21.15.153:6833/3705787109] up:boot 2024-09-10T08:06:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:13 smithi153 ceph-mon[35609]: fsmap 1 up:standby 2024-09-10T08:06:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T08:06:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:13 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:14.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:13 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.153:6832/3705787109,v1:172.21.15.153:6833/3705787109] up:boot 2024-09-10T08:06:14.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:13 smithi022 ceph-mon[30854]: fsmap 1 up:standby 2024-09-10T08:06:14.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T08:06:14.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:14.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:14.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:14.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:14.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:14.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:13 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:14.818 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:06:15.024 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:14 smithi100 ceph-mon[35102]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:15.025 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:14 smithi100 ceph-mon[35102]: Deploying daemon mds.k on smithi100 2024-09-10T08:06:15.086 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:15.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:14 smithi153 ceph-mon[35609]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:15.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:14 smithi153 ceph-mon[35609]: Deploying daemon mds.k on smithi100 2024-09-10T08:06:15.207 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:14 smithi022 ceph-mon[30854]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:15.207 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:14 smithi022 ceph-mon[30854]: Deploying daemon mds.k on smithi100 2024-09-10T08:06:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.530+0000 7fdfca187640 1 -- 172.21.15.22:0/2024737096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfc4100e20 msgr2=0x7fdfc4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.530+0000 7fdfca187640 1 --2- 172.21.15.22:0/2024737096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfc4100e20 0x7fdfc4101200 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4009900 tx=0x7fdfb402a480 comp rx=0 tx=0).stop 2024-09-10T08:06:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.530+0000 7fdfca187640 1 -- 172.21.15.22:0/2024737096 shutdown_connections 2024-09-10T08:06:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.530+0000 7fdfca187640 1 --2- 172.21.15.22:0/2024737096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc4102ef0 0x7fdfc410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.530+0000 7fdfca187640 1 --2- 172.21.15.22:0/2024737096 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4102570 0x7fdfc41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.530+0000 7fdfca187640 1 --2- 172.21.15.22:0/2024737096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfc4100e20 0x7fdfc4101200 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:15.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.530+0000 7fdfca187640 1 -- 172.21.15.22:0/2024737096 >> 172.21.15.22:0/2024737096 conn(0x7fdfc40fc7d0 msgr2=0x7fdfc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.530+0000 7fdfca187640 1 -- 172.21.15.22:0/2024737096 shutdown_connections 2024-09-10T08:06:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.530+0000 7fdfca187640 1 -- 172.21.15.22:0/2024737096 wait complete. 2024-09-10T08:06:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfca187640 1 Processor -- start 2024-09-10T08:06:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfca187640 1 -- start start 2024-09-10T08:06:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfca187640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfc4100e20 0x7fdfc419a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfca187640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc4102570 0x7fdfc419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfca187640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4102ef0 0x7fdfc419f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfca187640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4110ff0 con 0x7fdfc4100e20 2024-09-10T08:06:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfca187640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4110e70 con 0x7fdfc4102ef0 2024-09-10T08:06:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfca187640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4111170 con 0x7fdfc4102570 2024-09-10T08:06:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfc37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfc4100e20 0x7fdfc419a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:15.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfc37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfc4100e20 0x7fdfc419a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55904/0 (socket says 172.21.15.22:55904) 2024-09-10T08:06:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfc37fe640 1 -- 172.21.15.22:0/2587377238 learned_addr learned my addr 172.21.15.22:0/2587377238 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfc2ffd640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc4102570 0x7fdfc419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.531+0000 7fdfc3fff640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4102ef0 0x7fdfc419f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.532+0000 7fdfc37fe640 1 -- 172.21.15.22:0/2587377238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc4102570 msgr2=0x7fdfc419ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.532+0000 7fdfc37fe640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc4102570 0x7fdfc419ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.532+0000 7fdfc37fe640 1 -- 172.21.15.22:0/2587377238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4102ef0 msgr2=0x7fdfc419f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.532+0000 7fdfc37fe640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4102ef0 0x7fdfc419f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.532+0000 7fdfc37fe640 1 -- 172.21.15.22:0/2587377238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc419f700 con 0x7fdfc4100e20 2024-09-10T08:06:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.532+0000 7fdfc3fff640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4102ef0 0x7fdfc419f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:06:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.532+0000 7fdfc37fe640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfc4100e20 0x7fdfc419a750 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfb402aa70 tx=0x7fdfb4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:15.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.532+0000 7fdfc0ff9640 1 -- 172.21.15.22:0/2587377238 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb403f070 con 0x7fdfc4100e20 2024-09-10T08:06:15.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.532+0000 7fdfca187640 1 -- 172.21.15.22:0/2587377238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc419f990 con 0x7fdfc4100e20 2024-09-10T08:06:15.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.532+0000 7fdfc0ff9640 1 -- 172.21.15.22:0/2587377238 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfb4031c30 con 0x7fdfc4100e20 2024-09-10T08:06:15.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.532+0000 7fdfc0ff9640 1 -- 172.21.15.22:0/2587377238 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4035030 con 0x7fdfc4100e20 2024-09-10T08:06:15.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.532+0000 7fdfca187640 1 -- 172.21.15.22:0/2587377238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc41a72d0 con 0x7fdfc4100e20 2024-09-10T08:06:15.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.533+0000 7fdfca187640 1 -- 172.21.15.22:0/2587377238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc4101200 con 0x7fdfc4100e20 2024-09-10T08:06:15.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.535+0000 7fdfc0ff9640 1 -- 172.21.15.22:0/2587377238 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fdfb4042070 con 0x7fdfc4100e20 2024-09-10T08:06:15.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.535+0000 7fdfc0ff9640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdfac0a2b80 0x7fdfac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:15.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.535+0000 7fdfc2ffd640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdfac0a2b80 0x7fdfac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:15.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.535+0000 7fdfc0ff9640 1 -- 172.21.15.22:0/2587377238 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fdfb40ef960 con 0x7fdfc4100e20 2024-09-10T08:06:15.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.536+0000 7fdfc2ffd640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdfac0a2b80 0x7fdfac0a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfc410ddf0 tx=0x7fdfb8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:15.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.543+0000 7fdfc0ff9640 1 -- 172.21.15.22:0/2587377238 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdfb4031de0 con 0x7fdfc4100e20 2024-09-10T08:06:15.618 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 10 08:06:15 smithi100 systemd[1]: Started Ceph mds.k for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:06:15.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.764+0000 7fdfca187640 1 -- 172.21.15.22:0/2587377238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfc419bab0 con 0x7fdfc4100e20 2024-09-10T08:06:15.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.764+0000 7fdfc0ff9640 1 -- 172.21.15.22:0/2587377238 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fdfb40bcd60 con 0x7fdfc4100e20 2024-09-10T08:06:15.764 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:15.764 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":2,"btime":"2024-09-10T08:06:12:854134+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T08:06:15.764 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 2 2024-09-10T08:06:15.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.767+0000 7fdfca187640 1 -- 172.21.15.22:0/2587377238 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdfac0a2b80 msgr2=0x7fdfac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:15.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.767+0000 7fdfca187640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdfac0a2b80 0x7fdfac0a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdfc410ddf0 tx=0x7fdfb8005f90 comp rx=0 tx=0).stop 2024-09-10T08:06:15.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.767+0000 7fdfca187640 1 -- 172.21.15.22:0/2587377238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfc4100e20 msgr2=0x7fdfc419a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:15.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.767+0000 7fdfca187640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfc4100e20 0x7fdfc419a750 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfb402aa70 tx=0x7fdfb4003c10 comp rx=0 tx=0).stop 2024-09-10T08:06:15.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.767+0000 7fdfca187640 1 -- 172.21.15.22:0/2587377238 shutdown_connections 2024-09-10T08:06:15.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.767+0000 7fdfca187640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdfac0a2b80 0x7fdfac0a5040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:15.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.767+0000 7fdfca187640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfc4102ef0 0x7fdfc419f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:15.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.767+0000 7fdfca187640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc4102570 0x7fdfc419ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:15.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.767+0000 7fdfca187640 1 --2- 172.21.15.22:0/2587377238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdfc4100e20 0x7fdfc419a750 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:15.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.767+0000 7fdfca187640 1 -- 172.21.15.22:0/2587377238 >> 172.21.15.22:0/2587377238 conn(0x7fdfc40fc7d0 msgr2=0x7fdfc406a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:15.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.767+0000 7fdfca187640 1 -- 172.21.15.22:0/2587377238 shutdown_connections 2024-09-10T08:06:15.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:15.767+0000 7fdfca187640 1 -- 172.21.15.22:0/2587377238 wait complete. 2024-09-10T08:06:16.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:16 smithi022 ceph-mon[30854]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:16.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:16.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:16.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:16.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:16.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:16.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:16.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:16 smithi022 ceph-mon[30854]: Deploying daemon mds.j on smithi022 2024-09-10T08:06:16.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:16 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2587377238' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:16.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:16 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.100:6832/1178134620,v1:172.21.15.100:6833/1178134620] up:boot 2024-09-10T08:06:16.494 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:16 smithi022 ceph-mon[30854]: fsmap 2 up:standby 2024-09-10T08:06:16.494 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:16 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T08:06:16.686 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:16 smithi100 ceph-mon[35102]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:16.686 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:16.686 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:16.686 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:16.686 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:16.686 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:16.687 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:16.687 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:16 smithi100 ceph-mon[35102]: Deploying daemon mds.j on smithi022 2024-09-10T08:06:16.687 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:16 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2587377238' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:16.687 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:16 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.100:6832/1178134620,v1:172.21.15.100:6833/1178134620] up:boot 2024-09-10T08:06:16.687 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:16 smithi100 ceph-mon[35102]: fsmap 2 up:standby 2024-09-10T08:06:16.687 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:16 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T08:06:16.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:16 smithi153 ceph-mon[35609]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:16.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:16.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:16.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:16.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:16.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:16.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:16.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:16 smithi153 ceph-mon[35609]: Deploying daemon mds.j on smithi022 2024-09-10T08:06:16.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:16 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2587377238' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:16.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:16 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.100:6832/1178134620,v1:172.21.15.100:6833/1178134620] up:boot 2024-09-10T08:06:16.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:16 smithi153 ceph-mon[35609]: fsmap 2 up:standby 2024-09-10T08:06:16.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:16 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T08:06:18.253 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:06:18 smithi022 systemd[1]: Starting Ceph mds.j for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:06:18.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:06:18.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:18 smithi022 ceph-mon[30854]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:18.547 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:06:18 smithi022 podman[68110]: 2024-09-10 08:06:18.174468547 +0000 UTC m=+0.016722934 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:06:18.547 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:06:18 smithi022 podman[68110]: 2024-09-10 08:06:18.295741236 +0000 UTC m=+0.137995617 container create 561a585db1b79c882bf96956c91375621a5e0ff2cd387f4d73dd62337a0d3968 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:06:18.547 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:06:18 smithi022 podman[68110]: 2024-09-10 08:06:18.548642408 +0000 UTC m=+0.390896786 container init 561a585db1b79c882bf96956c91375621a5e0ff2cd387f4d73dd62337a0d3968 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-j, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:06:18.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:18 smithi153 ceph-mon[35609]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:18.806 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:18.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:18 smithi100 ceph-mon[35102]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:18.936 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:06:18 smithi022 podman[68110]: 2024-09-10 08:06:18.551679339 +0000 UTC m=+0.393933723 container start 561a585db1b79c882bf96956c91375621a5e0ff2cd387f4d73dd62337a0d3968 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-j, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:06:18.936 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:06:18 smithi022 ceph-mds[68145]: -- 172.21.15.22:0/4230467700 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c446a99860 con 0x55c446a77000 2024-09-10T08:06:18.936 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:06:18 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-j[68125]: starting mds.j at 2024-09-10T08:06:18.936 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:06:18 smithi022 bash[68110]: 561a585db1b79c882bf96956c91375621a5e0ff2cd387f4d73dd62337a0d3968 2024-09-10T08:06:18.936 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:06:18 smithi022 systemd[1]: Started Ceph mds.j for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:06:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.276+0000 7f1378c29640 1 -- 172.21.15.22:0/3432749740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1374106f10 msgr2=0x7f137410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.276+0000 7f1378c29640 1 --2- 172.21.15.22:0/3432749740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1374106f10 0x7f137410ea90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f136c009ca0 tx=0x7f136c02a8c0 comp rx=0 tx=0).stop 2024-09-10T08:06:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.276+0000 7f1378c29640 1 -- 172.21.15.22:0/3432749740 shutdown_connections 2024-09-10T08:06:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.276+0000 7f1378c29640 1 --2- 172.21.15.22:0/3432749740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1374106f10 0x7f137410ea90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.277+0000 7f1378c29640 1 --2- 172.21.15.22:0/3432749740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1374102790 0x7f13741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.277+0000 7f1378c29640 1 --2- 172.21.15.22:0/3432749740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1374101de0 0x7f13741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.277+0000 7f1378c29640 1 -- 172.21.15.22:0/3432749740 >> 172.21.15.22:0/3432749740 conn(0x7f13740fd8c0 msgr2=0x7f13740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.277+0000 7f1378c29640 1 -- 172.21.15.22:0/3432749740 shutdown_connections 2024-09-10T08:06:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.277+0000 7f1378c29640 1 -- 172.21.15.22:0/3432749740 wait complete. 2024-09-10T08:06:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.277+0000 7f1378c29640 1 Processor -- start 2024-09-10T08:06:19.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.277+0000 7f1378c29640 1 -- start start 2024-09-10T08:06:19.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f1378c29640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1374101de0 0x7f13741983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:19.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f1378c29640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1374102790 0x7f1374198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:19.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f1378c29640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1374106f10 0x7f137419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:19.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f1378c29640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1374111f70 con 0x7f1374101de0 2024-09-10T08:06:19.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f1378c29640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1374111df0 con 0x7f1374106f10 2024-09-10T08:06:19.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f1378c29640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13741120f0 con 0x7f1374102790 2024-09-10T08:06:19.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f137259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1374101de0 0x7f13741983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:19.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f137259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1374101de0 0x7f13741983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55948/0 (socket says 172.21.15.22:55948) 2024-09-10T08:06:19.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f137259c640 1 -- 172.21.15.22:0/612452148 learned_addr learned my addr 172.21.15.22:0/612452148 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:19.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f1372d9d640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1374106f10 0x7f137419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:19.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f1371d9b640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1374102790 0x7f1374198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:19.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f137259c640 1 -- 172.21.15.22:0/612452148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1374102790 msgr2=0x7f1374198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f137259c640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1374102790 0x7f1374198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f137259c640 1 -- 172.21.15.22:0/612452148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1374106f10 msgr2=0x7f137419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f137259c640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1374106f10 0x7f137419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f137259c640 1 -- 172.21.15.22:0/612452148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137419d3a0 con 0x7f1374101de0 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f137259c640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1374101de0 0x7f13741983f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f136400c890 tx=0x7f136400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f13637fe640 1 -- 172.21.15.22:0/612452148 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1364004220 con 0x7f1374101de0 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f1378c29640 1 -- 172.21.15.22:0/612452148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137419d690 con 0x7f1374101de0 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f13637fe640 1 -- 172.21.15.22:0/612452148 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13640043c0 con 0x7f1374101de0 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.278+0000 7f13637fe640 1 -- 172.21.15.22:0/612452148 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1364004a00 con 0x7f1374101de0 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.279+0000 7f1378c29640 1 -- 172.21.15.22:0/612452148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13741a4f70 con 0x7f1374101de0 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.279+0000 7f1378c29640 1 -- 172.21.15.22:0/612452148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13741021c0 con 0x7f1374101de0 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.281+0000 7f13637fe640 1 -- 172.21.15.22:0/612452148 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f13640079b0 con 0x7f1374101de0 2024-09-10T08:06:19.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.281+0000 7f13637fe640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f135c0a2b80 0x7f135c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:19.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.281+0000 7f1371d9b640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f135c0a2b80 0x7f135c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:19.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.281+0000 7f13637fe640 1 -- 172.21.15.22:0/612452148 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f13640cebc0 con 0x7f1374101de0 2024-09-10T08:06:19.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.282+0000 7f1371d9b640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f135c0a2b80 0x7f135c0a5040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13740fdce0 tx=0x7f136800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:19.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.284+0000 7f13637fe640 1 -- 172.21.15.22:0/612452148 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1364014030 con 0x7f1374101de0 2024-09-10T08:06:19.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.505+0000 7f1378c29640 1 -- 172.21.15.22:0/612452148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1374199750 con 0x7f1374101de0 2024-09-10T08:06:19.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.506+0000 7f13637fe640 1 -- 172.21.15.22:0/612452148 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f136409b970 con 0x7f1374101de0 2024-09-10T08:06:19.506 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:19.506 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":4,"btime":"2024-09-10T08:06:19:429876+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T08:06:19.506 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 4 2024-09-10T08:06:19.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.508+0000 7f1378c29640 1 -- 172.21.15.22:0/612452148 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f135c0a2b80 msgr2=0x7f135c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:19.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.508+0000 7f1378c29640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f135c0a2b80 0x7f135c0a5040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13740fdce0 tx=0x7f136800b390 comp rx=0 tx=0).stop 2024-09-10T08:06:19.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.508+0000 7f1378c29640 1 -- 172.21.15.22:0/612452148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1374101de0 msgr2=0x7f13741983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:19.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.508+0000 7f1378c29640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1374101de0 0x7f13741983f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f136400c890 tx=0x7f136400cd50 comp rx=0 tx=0).stop 2024-09-10T08:06:19.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.508+0000 7f1378c29640 1 -- 172.21.15.22:0/612452148 shutdown_connections 2024-09-10T08:06:19.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.508+0000 7f1378c29640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f135c0a2b80 0x7f135c0a5040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:19.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.508+0000 7f1378c29640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1374106f10 0x7f137419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:19.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.508+0000 7f1378c29640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1374102790 0x7f1374198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:19.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.508+0000 7f1378c29640 1 --2- 172.21.15.22:0/612452148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1374101de0 0x7f13741983f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:19.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.508+0000 7f1378c29640 1 -- 172.21.15.22:0/612452148 >> 172.21.15.22:0/612452148 conn(0x7f13740fd8c0 msgr2=0x7f13740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:19.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.508+0000 7f1378c29640 1 -- 172.21.15.22:0/612452148 shutdown_connections 2024-09-10T08:06:19.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:19.508+0000 7f1378c29640 1 -- 172.21.15.22:0/612452148 wait complete. 2024-09-10T08:06:19.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:19.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:19.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:19.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:19.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:19.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:19.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:19 smithi022 ceph-mon[30854]: Deploying daemon mds.d on smithi022 2024-09-10T08:06:19.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:19 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.22:6834/343815013,v1:172.21.15.22:6835/343815013] up:boot 2024-09-10T08:06:19.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:19 smithi022 ceph-mon[30854]: fsmap 3 up:standby 2024-09-10T08:06:19.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:19 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T08:06:19.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:19 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/612452148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:19.947 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:19.947 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:19.947 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:19.948 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:19.948 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:19.948 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:19.948 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:19 smithi153 ceph-mon[35609]: Deploying daemon mds.d on smithi022 2024-09-10T08:06:19.948 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:19 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.22:6834/343815013,v1:172.21.15.22:6835/343815013] up:boot 2024-09-10T08:06:19.948 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:19 smithi153 ceph-mon[35609]: fsmap 3 up:standby 2024-09-10T08:06:19.948 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:19 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T08:06:19.948 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:19 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/612452148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:20.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:20.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:20.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:20.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:20.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:20.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:20.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:19 smithi100 ceph-mon[35102]: Deploying daemon mds.d on smithi022 2024-09-10T08:06:20.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:19 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.22:6834/343815013,v1:172.21.15.22:6835/343815013] up:boot 2024-09-10T08:06:20.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:19 smithi100 ceph-mon[35102]: fsmap 3 up:standby 2024-09-10T08:06:20.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:19 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T08:06:20.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:19 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/612452148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:21.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:20 smithi022 ceph-mon[30854]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:21.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:20 smithi100 ceph-mon[35102]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:21.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:20 smithi153 ceph-mon[35609]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:21.917 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:06:21 smithi022 systemd[1]: Starting Ceph mds.d for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:06:22.174 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:06:21 smithi022 podman[68522]: 2024-09-10 08:06:21.820580006 +0000 UTC m=+0.016637965 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:06:22.174 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:06:21 smithi022 podman[68522]: 2024-09-10 08:06:21.930378284 +0000 UTC m=+0.126436244 container create a8eafe1139db1d98db03c999839808a597318dddc5915b49e8b7349f5db17e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T08:06:22.174 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:06:22 smithi022 podman[68522]: 2024-09-10 08:06:22.175323874 +0000 UTC m=+0.371381833 container init a8eafe1139db1d98db03c999839808a597318dddc5915b49e8b7349f5db17e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T08:06:22.379 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:06:22.503 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:06:22 smithi022 podman[68522]: 2024-09-10 08:06:22.178308953 +0000 UTC m=+0.374366915 container start a8eafe1139db1d98db03c999839808a597318dddc5915b49e8b7349f5db17e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T08:06:22.503 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:06:22 smithi022 ceph-mds[68541]: -- 172.21.15.22:0/3456432394 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c732a83860 con 0x55c732a61000 2024-09-10T08:06:22.503 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:06:22 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-d[68537]: starting mds.d at 2024-09-10T08:06:22.504 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:06:22 smithi022 bash[68522]: a8eafe1139db1d98db03c999839808a597318dddc5915b49e8b7349f5db17e7e 2024-09-10T08:06:22.504 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:06:22 smithi022 systemd[1]: Started Ceph mds.d for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:06:22.638 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:23.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:22 smithi022 ceph-mon[30854]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:23.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:23.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:23.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:23.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:23.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:23.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:22 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:23.021 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:22 smithi100 ceph-mon[35102]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:23.021 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:22 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:23.021 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:22 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:23.022 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:22 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:23.022 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:22 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:23.022 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:22 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:23.022 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:22 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.129+0000 7f378c849640 1 -- 172.21.15.22:0/976245099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3788108300 msgr2=0x7f378810ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.129+0000 7f378c849640 1 --2- 172.21.15.22:0/976245099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3788108300 0x7f378810ec70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3780009cd0 tx=0x7f378002a8f0 comp rx=0 tx=0).stop 2024-09-10T08:06:23.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.129+0000 7f378c849640 1 -- 172.21.15.22:0/976245099 shutdown_connections 2024-09-10T08:06:23.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.129+0000 7f378c849640 1 --2- 172.21.15.22:0/976245099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3788108300 0x7f378810ec70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:23.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.129+0000 7f378c849640 1 --2- 172.21.15.22:0/976245099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3788103780 0x7f3788107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:23.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.129+0000 7f378c849640 1 --2- 172.21.15.22:0/976245099 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3788102dd0 0x7f37881031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:23.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.129+0000 7f378c849640 1 -- 172.21.15.22:0/976245099 >> 172.21.15.22:0/976245099 conn(0x7f37880fc7d0 msgr2=0x7f37880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:23.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.129+0000 7f378c849640 1 -- 172.21.15.22:0/976245099 shutdown_connections 2024-09-10T08:06:23.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.129+0000 7f378c849640 1 -- 172.21.15.22:0/976245099 wait complete. 2024-09-10T08:06:23.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f378c849640 1 Processor -- start 2024-09-10T08:06:23.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f378c849640 1 -- start start 2024-09-10T08:06:23.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f378c849640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3788102dd0 0x7f3788198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:23.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f378c849640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3788103780 0x7f3788198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:23.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f378c849640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3788108300 0x7f378819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f378c849640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f37881120f0 con 0x7f3788103780 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f378c849640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3788111f70 con 0x7f3788102dd0 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f378c849640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3788112270 con 0x7f3788108300 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f3785d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3788103780 0x7f3788198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f378659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3788102dd0 0x7f3788198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f3785d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3788103780 0x7f3788198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55978/0 (socket says 172.21.15.22:55978) 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f378659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3788102dd0 0x7f3788198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.22:50572/0 (socket says 172.21.15.22:50572) 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f3785d9b640 1 -- 172.21.15.22:0/3754548581 learned_addr learned my addr 172.21.15.22:0/3754548581 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f3786d9d640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3788108300 0x7f378819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f3785d9b640 1 -- 172.21.15.22:0/3754548581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3788108300 msgr2=0x7f378819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f3785d9b640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3788108300 0x7f378819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f3785d9b640 1 -- 172.21.15.22:0/3754548581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3788102dd0 msgr2=0x7f3788198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:23.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f3785d9b640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3788102dd0 0x7f3788198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f3785d9b640 1 -- 172.21.15.22:0/3754548581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378819d4c0 con 0x7f3788103780 2024-09-10T08:06:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f3786d9d640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3788108300 0x7f378819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:06:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.130+0000 7f378659c640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3788102dd0 0x7f3788198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:06:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.131+0000 7f3785d9b640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3788103780 0x7f3788198a50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3770006fd0 tx=0x7f377000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.131+0000 7f377f7fe640 1 -- 172.21.15.22:0/3754548581 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3770015020 con 0x7f3788103780 2024-09-10T08:06:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.131+0000 7f377f7fe640 1 -- 172.21.15.22:0/3754548581 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3770011d10 con 0x7f3788103780 2024-09-10T08:06:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.131+0000 7f377f7fe640 1 -- 172.21.15.22:0/3754548581 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377000f2e0 con 0x7f3788103780 2024-09-10T08:06:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.131+0000 7f378c849640 1 -- 172.21.15.22:0/3754548581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378819d7b0 con 0x7f3788103780 2024-09-10T08:06:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.131+0000 7f378c849640 1 -- 172.21.15.22:0/3754548581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3788100960 con 0x7f3788103780 2024-09-10T08:06:23.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.132+0000 7f378c849640 1 -- 172.21.15.22:0/3754548581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f378806a7b0 con 0x7f3788103780 2024-09-10T08:06:23.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.133+0000 7f377f7fe640 1 -- 172.21.15.22:0/3754548581 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3770018020 con 0x7f3788103780 2024-09-10T08:06:23.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.134+0000 7f377f7fe640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f37740a2c00 0x7f37740a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:23.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.134+0000 7f378659c640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f37740a2c00 0x7f37740a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:23.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.134+0000 7f377f7fe640 1 -- 172.21.15.22:0/3754548581 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f37700ce430 con 0x7f3788103780 2024-09-10T08:06:23.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.135+0000 7f378659c640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f37740a2c00 0x7f37740a50c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f377800afb0 tx=0x7f377800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.139+0000 7f377f7fe640 1 -- 172.21.15.22:0/3754548581 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f377001f020 con 0x7f3788103780 2024-09-10T08:06:23.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:22 smithi153 ceph-mon[35609]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:23.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:22 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:23.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:22 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:23.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:22 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:23.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:22 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:23.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:22 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:23.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:22 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.349+0000 7f378c849640 1 -- 172.21.15.22:0/3754548581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3788100c20 con 0x7f3788103780 2024-09-10T08:06:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.350+0000 7f377f7fe640 1 -- 172.21.15.22:0/3754548581 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7f377009b830 con 0x7f3788103780 2024-09-10T08:06:23.349 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:23.349 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"btime":"2024-09-10T08:06:22:709199+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T08:06:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 5 2024-09-10T08:06:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.352+0000 7f378c849640 1 -- 172.21.15.22:0/3754548581 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f37740a2c00 msgr2=0x7f37740a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.352+0000 7f378c849640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f37740a2c00 0x7f37740a50c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f377800afb0 tx=0x7f377800a2d0 comp rx=0 tx=0).stop 2024-09-10T08:06:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.352+0000 7f378c849640 1 -- 172.21.15.22:0/3754548581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3788103780 msgr2=0x7f3788198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.352+0000 7f378c849640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3788103780 0x7f3788198a50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3770006fd0 tx=0x7f377000b820 comp rx=0 tx=0).stop 2024-09-10T08:06:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.352+0000 7f378c849640 1 -- 172.21.15.22:0/3754548581 shutdown_connections 2024-09-10T08:06:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.352+0000 7f378c849640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f37740a2c00 0x7f37740a50c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.352+0000 7f378c849640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3788108300 0x7f378819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.352+0000 7f378c849640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3788103780 0x7f3788198a50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.352+0000 7f378c849640 1 --2- 172.21.15.22:0/3754548581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3788102dd0 0x7f3788198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.352+0000 7f378c849640 1 -- 172.21.15.22:0/3754548581 >> 172.21.15.22:0/3754548581 conn(0x7f37880fc7d0 msgr2=0x7f3788105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.352+0000 7f378c849640 1 -- 172.21.15.22:0/3754548581 shutdown_connections 2024-09-10T08:06:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:23.352+0000 7f378c849640 1 -- 172.21.15.22:0/3754548581 wait complete. 2024-09-10T08:06:23.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:23 smithi100 ceph-mon[35102]: Deploying daemon mds.e on smithi100 2024-09-10T08:06:23.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:23 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.22:6836/959719178,v1:172.21.15.22:6837/959719178] up:boot 2024-09-10T08:06:23.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:23 smithi100 ceph-mon[35102]: fsmap 4 up:standby 2024-09-10T08:06:23.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:23 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T08:06:23.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:23 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3754548581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:24.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:23 smithi022 ceph-mon[30854]: Deploying daemon mds.e on smithi100 2024-09-10T08:06:24.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:23 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.22:6836/959719178,v1:172.21.15.22:6837/959719178] up:boot 2024-09-10T08:06:24.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:23 smithi022 ceph-mon[30854]: fsmap 4 up:standby 2024-09-10T08:06:24.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:23 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T08:06:24.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:23 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3754548581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:24.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:23 smithi153 ceph-mon[35609]: Deploying daemon mds.e on smithi100 2024-09-10T08:06:24.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:23 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.22:6836/959719178,v1:172.21.15.22:6837/959719178] up:boot 2024-09-10T08:06:24.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:23 smithi153 ceph-mon[35609]: fsmap 4 up:standby 2024-09-10T08:06:24.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:23 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T08:06:24.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:23 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3754548581' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:24.541 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:06:24 smithi100 systemd[1]: Starting Ceph mds.e for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:06:24.809 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:24 smithi100 ceph-mon[35102]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:24.809 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:06:24 smithi100 podman[64071]: 2024-09-10 08:06:24.444306258 +0000 UTC m=+0.015711426 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:06:24.809 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:06:24 smithi100 podman[64071]: 2024-09-10 08:06:24.556074971 +0000 UTC m=+0.127480131 container create 5f62ec5148936f7fa0fa1feca31e52da01835e6ac196e3714566a944ddb14eeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T08:06:24.809 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:06:24 smithi100 podman[64071]: 2024-09-10 08:06:24.78398011 +0000 UTC m=+0.355385271 container init 5f62ec5148936f7fa0fa1feca31e52da01835e6ac196e3714566a944ddb14eeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T08:06:24.810 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:06:24 smithi100 podman[64071]: 2024-09-10 08:06:24.786858902 +0000 UTC m=+0.358264064 container start 5f62ec5148936f7fa0fa1feca31e52da01835e6ac196e3714566a944ddb14eeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:06:25.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:24 smithi022 ceph-mon[30854]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:25.118 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:06:24 smithi100 ceph-mds[64090]: -- 172.21.15.100:0/1253174063 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c170d3860 con 0x558c170b1000 2024-09-10T08:06:25.118 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:06:24 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-e[64086]: starting mds.e at 2024-09-10T08:06:25.119 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:06:24 smithi100 bash[64071]: 5f62ec5148936f7fa0fa1feca31e52da01835e6ac196e3714566a944ddb14eeb 2024-09-10T08:06:25.119 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:06:24 smithi100 systemd[1]: Started Ceph mds.e for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:06:25.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:24 smithi153 ceph-mon[35609]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:25.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:25 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:25.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:25 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:25.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:25 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:25.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:25 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:25.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:25 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:25.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:25 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:25.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:25 smithi153 ceph-mon[35609]: Deploying daemon mds.f on smithi153 2024-09-10T08:06:25.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:25 smithi153 ceph-mon[35609]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:25.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:25 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] up:boot 2024-09-10T08:06:25.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:25 smithi153 ceph-mon[35609]: fsmap 5 up:standby 2024-09-10T08:06:25.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:25 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T08:06:26.061 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:06:26.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:25 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:26.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:25 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:26.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:25 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:26.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:25 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:26.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:25 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:26.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:25 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:26.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:25 smithi022 ceph-mon[30854]: Deploying daemon mds.f on smithi153 2024-09-10T08:06:26.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:25 smithi022 ceph-mon[30854]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:26.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:25 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] up:boot 2024-09-10T08:06:26.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:25 smithi022 ceph-mon[30854]: fsmap 5 up:standby 2024-09-10T08:06:26.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:25 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T08:06:26.331 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:26.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:25 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:26.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:25 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:26.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:25 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:26.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:25 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:26.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:25 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:26.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:25 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:26.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:25 smithi100 ceph-mon[35102]: Deploying daemon mds.f on smithi153 2024-09-10T08:06:26.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:25 smithi100 ceph-mon[35102]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:26.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:25 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] up:boot 2024-09-10T08:06:26.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:25 smithi100 ceph-mon[35102]: fsmap 5 up:standby 2024-09-10T08:06:26.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:25 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T08:06:26.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.829+0000 7fe357061640 1 -- 172.21.15.22:0/1485274859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe350102790 msgr2=0x7fe3501067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:26.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.829+0000 7fe357061640 1 --2- 172.21.15.22:0/1485274859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe350102790 0x7fe3501067e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009900 tx=0x7fe33c02a410 comp rx=0 tx=0).stop 2024-09-10T08:06:26.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.829+0000 7fe357061640 1 -- 172.21.15.22:0/1485274859 shutdown_connections 2024-09-10T08:06:26.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.829+0000 7fe357061640 1 --2- 172.21.15.22:0/1485274859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe350106f10 0x7fe35010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:26.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.829+0000 7fe357061640 1 --2- 172.21.15.22:0/1485274859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe350102790 0x7fe3501067e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:26.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.829+0000 7fe357061640 1 --2- 172.21.15.22:0/1485274859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe350101de0 0x7fe3501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:26.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.829+0000 7fe357061640 1 -- 172.21.15.22:0/1485274859 >> 172.21.15.22:0/1485274859 conn(0x7fe3500fd8c0 msgr2=0x7fe3500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:26.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.829+0000 7fe357061640 1 -- 172.21.15.22:0/1485274859 shutdown_connections 2024-09-10T08:06:26.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.829+0000 7fe357061640 1 -- 172.21.15.22:0/1485274859 wait complete. 2024-09-10T08:06:26.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.830+0000 7fe357061640 1 Processor -- start 2024-09-10T08:06:26.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.830+0000 7fe357061640 1 -- start start 2024-09-10T08:06:26.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.830+0000 7fe357061640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe350101de0 0x7fe3500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:26.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.830+0000 7fe357061640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe350102790 0x7fe350074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.830+0000 7fe357061640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe350106f10 0x7fe350074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.830+0000 7fe357061640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe350111f70 con 0x7fe350101de0 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.830+0000 7fe357061640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe350111df0 con 0x7fe350102790 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.830+0000 7fe357061640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe3501120f0 con 0x7fe350106f10 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.830+0000 7fe354dfd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe350101de0 0x7fe3500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.830+0000 7fe354dfd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe350101de0 0x7fe3500744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54894/0 (socket says 172.21.15.22:54894) 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.830+0000 7fe354dfd640 1 -- 172.21.15.22:0/3083079152 learned_addr learned my addr 172.21.15.22:0/3083079152 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe3555fe640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe350106f10 0x7fe350074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe34ffff640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe350102790 0x7fe350074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe354dfd640 1 -- 172.21.15.22:0/3083079152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe350106f10 msgr2=0x7fe350074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe354dfd640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe350106f10 0x7fe350074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe354dfd640 1 -- 172.21.15.22:0/3083079152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe350102790 msgr2=0x7fe350074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:26.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe354dfd640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe350102790 0x7fe350074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe354dfd640 1 -- 172.21.15.22:0/3083079152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3501a68f0 con 0x7fe350101de0 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe354dfd640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe350101de0 0x7fe3500744f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe34400d770 tx=0x7fe34400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe34dffb640 1 -- 172.21.15.22:0/3083079152 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344017070 con 0x7fe350101de0 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe34dffb640 1 -- 172.21.15.22:0/3083079152 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe344005500 con 0x7fe350101de0 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe357061640 1 -- 172.21.15.22:0/3083079152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3501a6be0 con 0x7fe350101de0 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe34dffb640 1 -- 172.21.15.22:0/3083079152 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344004e00 con 0x7fe350101de0 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.831+0000 7fe357061640 1 -- 172.21.15.22:0/3083079152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3501a7120 con 0x7fe350101de0 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.832+0000 7fe357061640 1 -- 172.21.15.22:0/3083079152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3501021c0 con 0x7fe350101de0 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.833+0000 7fe34dffb640 1 -- 172.21.15.22:0/3083079152 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fe344004fa0 con 0x7fe350101de0 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.834+0000 7fe34dffb640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe3400a2c00 0x7fe3400a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.834+0000 7fe34ffff640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe3400a2c00 0x7fe3400a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.834+0000 7fe34dffb640 1 -- 172.21.15.22:0/3083079152 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fe3440ce700 con 0x7fe350101de0 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.834+0000 7fe34ffff640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe3400a2c00 0x7fe3400a50c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe350075f80 tx=0x7fe33c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:26.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:26.838+0000 7fe34dffb640 1 -- 172.21.15.22:0/3083079152 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe34409ba60 con 0x7fe350101de0 2024-09-10T08:06:26.944 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:06:26 smithi153 systemd[1]: Starting Ceph mds.f for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:06:27.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.052+0000 7fe357061640 1 -- 172.21.15.22:0/3083079152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe35002d7c0 con 0x7fe350101de0 2024-09-10T08:06:27.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.053+0000 7fe34dffb640 1 -- 172.21.15.22:0/3083079152 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7fe34409b360 con 0x7fe350101de0 2024-09-10T08:06:27.052 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:27.052 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":6,"btime":"2024-09-10T08:06:25:722320+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T08:06:27.053 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 6 2024-09-10T08:06:27.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.055+0000 7fe357061640 1 -- 172.21.15.22:0/3083079152 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe3400a2c00 msgr2=0x7fe3400a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:27.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.055+0000 7fe357061640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe3400a2c00 0x7fe3400a50c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe350075f80 tx=0x7fe33c005a20 comp rx=0 tx=0).stop 2024-09-10T08:06:27.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.055+0000 7fe357061640 1 -- 172.21.15.22:0/3083079152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe350101de0 msgr2=0x7fe3500744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:27.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.055+0000 7fe357061640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe350101de0 0x7fe3500744f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe34400d770 tx=0x7fe34400dc30 comp rx=0 tx=0).stop 2024-09-10T08:06:27.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.055+0000 7fe357061640 1 -- 172.21.15.22:0/3083079152 shutdown_connections 2024-09-10T08:06:27.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.055+0000 7fe357061640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe3400a2c00 0x7fe3400a50c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:27.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.055+0000 7fe357061640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe350106f10 0x7fe350074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:27.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.055+0000 7fe357061640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe350102790 0x7fe350074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:27.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.055+0000 7fe357061640 1 --2- 172.21.15.22:0/3083079152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe350101de0 0x7fe3500744f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:27.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.055+0000 7fe357061640 1 -- 172.21.15.22:0/3083079152 >> 172.21.15.22:0/3083079152 conn(0x7fe3500fd8c0 msgr2=0x7fe3500fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:27.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.055+0000 7fe357061640 1 -- 172.21.15.22:0/3083079152 shutdown_connections 2024-09-10T08:06:27.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:27.055+0000 7fe357061640 1 -- 172.21.15.22:0/3083079152 wait complete. 2024-09-10T08:06:27.319 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:06:27 smithi153 podman[65242]: 2024-09-10 08:06:26.971688279 +0000 UTC m=+0.015763346 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:06:27.320 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:06:27 smithi153 podman[65242]: 2024-09-10 08:06:27.085009776 +0000 UTC m=+0.129084840 container create 21c336992fde23ca395750c1460230d766d71630e3a316440e6008308f25e45f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T08:06:27.320 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:06:27 smithi153 podman[65242]: 2024-09-10 08:06:27.32107661 +0000 UTC m=+0.365151667 container init 21c336992fde23ca395750c1460230d766d71630e3a316440e6008308f25e45f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T08:06:27.693 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:06:27 smithi153 podman[65242]: 2024-09-10 08:06:27.323979776 +0000 UTC m=+0.368054843 container start 21c336992fde23ca395750c1460230d766d71630e3a316440e6008308f25e45f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:06:27.694 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:06:27 smithi153 ceph-mds[65262]: -- 172.21.15.153:0/1682141331 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56404c5c7860 con 0x56404c5a4800 2024-09-10T08:06:27.694 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:06:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-f[65258]: starting mds.f at 2024-09-10T08:06:27.694 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:06:27 smithi153 bash[65242]: 21c336992fde23ca395750c1460230d766d71630e3a316440e6008308f25e45f 2024-09-10T08:06:27.694 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:06:27 smithi153 systemd[1]: Started Ceph mds.f for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:06:28.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:27 smithi153 ceph-mon[35609]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:28.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:27 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3083079152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:28.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:27 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:28.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:27 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:28.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:27 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:28.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:27 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:28.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:27 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:28.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:27 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:28.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:27 smithi153 ceph-mon[35609]: Deploying daemon mds.c on smithi153 2024-09-10T08:06:28.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:27 smithi022 ceph-mon[30854]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:28.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:27 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3083079152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:28.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:27 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:28.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:27 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:28.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:27 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:28.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:27 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:28.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:27 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:28.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:27 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:28.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:27 smithi022 ceph-mon[30854]: Deploying daemon mds.c on smithi153 2024-09-10T08:06:28.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:27 smithi100 ceph-mon[35102]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:28.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:27 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3083079152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:28.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:27 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:28.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:27 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:28.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:27 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:28.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:27 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:28.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:27 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:28.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:27 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:28.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:27 smithi100 ceph-mon[35102]: Deploying daemon mds.c on smithi153 2024-09-10T08:06:29.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:29 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.153:6834/3505190925,v1:172.21.15.153:6835/3505190925] up:boot 2024-09-10T08:06:29.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:29 smithi153 ceph-mon[35609]: fsmap 6 up:standby 2024-09-10T08:06:29.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:29 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T08:06:29.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:29 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.153:6834/3505190925,v1:172.21.15.153:6835/3505190925] up:boot 2024-09-10T08:06:29.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:29 smithi022 ceph-mon[30854]: fsmap 6 up:standby 2024-09-10T08:06:29.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:29 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T08:06:29.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:29 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.153:6834/3505190925,v1:172.21.15.153:6835/3505190925] up:boot 2024-09-10T08:06:29.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:29 smithi100 ceph-mon[35102]: fsmap 6 up:standby 2024-09-10T08:06:29.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:29 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T08:06:29.694 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:06:29 smithi153 systemd[1]: Starting Ceph mds.c for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:06:29.738 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:06:30.002 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:30.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:30 smithi153 ceph-mon[35609]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:30.144 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:06:29 smithi153 podman[65548]: 2024-09-10 08:06:29.727222541 +0000 UTC m=+0.015917915 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:06:30.144 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:06:29 smithi153 podman[65548]: 2024-09-10 08:06:29.841836789 +0000 UTC m=+0.130532195 container create a0f9b70fa01a7f9ed980fe1b9ed40a459528ed75646ae8efd6144e515c083bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T08:06:30.144 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:06:30 smithi153 podman[65548]: 2024-09-10 08:06:30.044437789 +0000 UTC m=+0.333133148 container init a0f9b70fa01a7f9ed980fe1b9ed40a459528ed75646ae8efd6144e515c083bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-c, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T08:06:30.144 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:06:30 smithi153 podman[65548]: 2024-09-10 08:06:30.047392309 +0000 UTC m=+0.336087672 container start a0f9b70fa01a7f9ed980fe1b9ed40a459528ed75646ae8efd6144e515c083bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T08:06:30.144 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:06:30 smithi153 ceph-mds[65568]: -- 172.21.15.153:0/47334108 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56346e99b860 con 0x56346e979400 2024-09-10T08:06:30.144 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:06:30 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-c[65564]: starting mds.c at 2024-09-10T08:06:30.144 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:06:30 smithi153 bash[65548]: a0f9b70fa01a7f9ed980fe1b9ed40a459528ed75646ae8efd6144e515c083bb0 2024-09-10T08:06:30.251 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:30 smithi022 ceph-mon[30854]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:30.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:30 smithi100 ceph-mon[35102]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:30.444 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:06:30 smithi153 systemd[1]: Started Ceph mds.c for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:06:30.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.489+0000 7f3db4170640 1 -- 172.21.15.22:0/64538014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac102570 msgr2=0x7f3dac1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:30.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.489+0000 7f3db4170640 1 --2- 172.21.15.22:0/64538014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac102570 0x7f3dac1029b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009ca0 tx=0x7f3da002a950 comp rx=0 tx=0).stop 2024-09-10T08:06:30.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.489+0000 7f3db4170640 1 -- 172.21.15.22:0/64538014 shutdown_connections 2024-09-10T08:06:30.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.489+0000 7f3db4170640 1 --2- 172.21.15.22:0/64538014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac102ef0 0x7f3dac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:30.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.489+0000 7f3db4170640 1 --2- 172.21.15.22:0/64538014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac102570 0x7f3dac1029b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:30.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.489+0000 7f3db4170640 1 --2- 172.21.15.22:0/64538014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac100e20 0x7f3dac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:30.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.489+0000 7f3db4170640 1 -- 172.21.15.22:0/64538014 >> 172.21.15.22:0/64538014 conn(0x7f3dac0fc7d0 msgr2=0x7f3dac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:30.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.489+0000 7f3db4170640 1 -- 172.21.15.22:0/64538014 shutdown_connections 2024-09-10T08:06:30.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.489+0000 7f3db4170640 1 -- 172.21.15.22:0/64538014 wait complete. 2024-09-10T08:06:30.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db4170640 1 Processor -- start 2024-09-10T08:06:30.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db4170640 1 -- start start 2024-09-10T08:06:30.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db4170640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac100e20 0x7f3dac197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:30.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db4170640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac102570 0x7f3dac1976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db4170640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac102ef0 0x7f3dac197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db4170640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac110f50 con 0x7f3dac102ef0 2024-09-10T08:06:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db4170640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac110dd0 con 0x7f3dac100e20 2024-09-10T08:06:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db4170640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1110d0 con 0x7f3dac102570 2024-09-10T08:06:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db270d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac102ef0 0x7f3dac197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db270d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac102ef0 0x7f3dac197c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54910/0 (socket says 172.21.15.22:54910) 2024-09-10T08:06:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db1f0c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac100e20 0x7f3dac197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db270d640 1 -- 172.21.15.22:0/657654724 learned_addr learned my addr 172.21.15.22:0/657654724 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db170b640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac102570 0x7f3dac1976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db1f0c640 1 -- 172.21.15.22:0/657654724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac102570 msgr2=0x7f3dac1976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db1f0c640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac102570 0x7f3dac1976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db1f0c640 1 -- 172.21.15.22:0/657654724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac102ef0 msgr2=0x7f3dac197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db1f0c640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac102ef0 0x7f3dac197c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db1f0c640 1 -- 172.21.15.22:0/657654724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac1a6a00 con 0x7f3dac100e20 2024-09-10T08:06:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.490+0000 7f3db270d640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac102ef0 0x7f3dac197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:06:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.491+0000 7f3db1f0c640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac100e20 0x7f3dac197190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3da800e750 tx=0x7f3da800ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.491+0000 7f3d9effd640 1 -- 172.21.15.22:0/657654724 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da800ccc0 con 0x7f3dac100e20 2024-09-10T08:06:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.491+0000 7f3d9effd640 1 -- 172.21.15.22:0/657654724 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3da800ee60 con 0x7f3dac100e20 2024-09-10T08:06:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.491+0000 7f3db4170640 1 -- 172.21.15.22:0/657654724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac1a6cf0 con 0x7f3dac100e20 2024-09-10T08:06:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.491+0000 7f3d9effd640 1 -- 172.21.15.22:0/657654724 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8004a00 con 0x7f3dac100e20 2024-09-10T08:06:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.491+0000 7f3db4170640 1 -- 172.21.15.22:0/657654724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac1a7180 con 0x7f3dac100e20 2024-09-10T08:06:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.492+0000 7f3db4170640 1 -- 172.21.15.22:0/657654724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dac101200 con 0x7f3dac100e20 2024-09-10T08:06:30.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.493+0000 7f3d9effd640 1 -- 172.21.15.22:0/657654724 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3da8004ba0 con 0x7f3dac100e20 2024-09-10T08:06:30.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.494+0000 7f3d9effd640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3d980a2b80 0x7f3d980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:30.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.494+0000 7f3db170b640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3d980a2b80 0x7f3d980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:30.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.494+0000 7f3d9effd640 1 -- 172.21.15.22:0/657654724 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f3da80ceb50 con 0x7f3dac100e20 2024-09-10T08:06:30.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.494+0000 7f3db170b640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3d980a2b80 0x7f3d980a5040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3dac1992f0 tx=0x7f3da0004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:30.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.498+0000 7f3d9effd640 1 -- 172.21.15.22:0/657654724 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3da809beb0 con 0x7f3dac100e20 2024-09-10T08:06:30.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.711+0000 7f3db4170640 1 -- 172.21.15.22:0/657654724 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dac02d7c0 con 0x7f3dac100e20 2024-09-10T08:06:30.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.712+0000 7f3d9effd640 1 -- 172.21.15.22:0/657654724 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5563 (secure 0 0 0) 0x7f3da809b7b0 con 0x7f3dac100e20 2024-09-10T08:06:30.712 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:30.712 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":7,"btime":"2024-09-10T08:06:27:988256+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T08:06:30.712 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 7 2024-09-10T08:06:30.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.714+0000 7f3db4170640 1 -- 172.21.15.22:0/657654724 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3d980a2b80 msgr2=0x7f3d980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:30.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.714+0000 7f3db4170640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3d980a2b80 0x7f3d980a5040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3dac1992f0 tx=0x7f3da0004a60 comp rx=0 tx=0).stop 2024-09-10T08:06:30.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.714+0000 7f3db4170640 1 -- 172.21.15.22:0/657654724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac100e20 msgr2=0x7f3dac197190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:30.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.714+0000 7f3db4170640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac100e20 0x7f3dac197190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3da800e750 tx=0x7f3da800ec10 comp rx=0 tx=0).stop 2024-09-10T08:06:30.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.714+0000 7f3db4170640 1 -- 172.21.15.22:0/657654724 shutdown_connections 2024-09-10T08:06:30.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.714+0000 7f3db4170640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3d980a2b80 0x7f3d980a5040 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:30.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.714+0000 7f3db4170640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dac102ef0 0x7f3dac197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:30.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.714+0000 7f3db4170640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dac102570 0x7f3dac1976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:30.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.714+0000 7f3db4170640 1 --2- 172.21.15.22:0/657654724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3dac100e20 0x7f3dac197190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:30.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.714+0000 7f3db4170640 1 -- 172.21.15.22:0/657654724 >> 172.21.15.22:0/657654724 conn(0x7f3dac0fc7d0 msgr2=0x7f3dac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:30.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.714+0000 7f3db4170640 1 -- 172.21.15.22:0/657654724 shutdown_connections 2024-09-10T08:06:30.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:30.714+0000 7f3db4170640 1 -- 172.21.15.22:0/657654724 wait complete. 2024-09-10T08:06:31.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:31 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:31.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:31 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:31.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:31 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:31.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:31 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:31.422 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:31 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:31.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:31 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:31.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:31 smithi022 ceph-mon[30854]: Deploying daemon mds.h on smithi100 2024-09-10T08:06:31.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:31 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/657654724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:31.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:31 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.153:6836/2417436521,v1:172.21.15.153:6837/2417436521] up:boot 2024-09-10T08:06:31.423 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:31 smithi022 ceph-mon[30854]: fsmap 7 up:standby 2024-09-10T08:06:31.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:31 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T08:06:31.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:31 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:31.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:31 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:31.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:31 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:31.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:31 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:31.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:31 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:31.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:31 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:31.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:31 smithi100 ceph-mon[35102]: Deploying daemon mds.h on smithi100 2024-09-10T08:06:31.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:31 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/657654724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:31.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:31 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.153:6836/2417436521,v1:172.21.15.153:6837/2417436521] up:boot 2024-09-10T08:06:31.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:31 smithi100 ceph-mon[35102]: fsmap 7 up:standby 2024-09-10T08:06:31.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:31 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T08:06:31.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:31 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:31.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:31 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:31.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:31 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:31.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:31 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:31.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:31 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:31.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:31 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:31.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:31 smithi153 ceph-mon[35609]: Deploying daemon mds.h on smithi100 2024-09-10T08:06:31.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:31 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/657654724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:31.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:31 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.153:6836/2417436521,v1:172.21.15.153:6837/2417436521] up:boot 2024-09-10T08:06:31.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:31 smithi153 ceph-mon[35609]: fsmap 7 up:standby 2024-09-10T08:06:31.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:31 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T08:06:32.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:32 smithi100 ceph-mon[35102]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:32.369 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:06:32 smithi100 systemd[1]: Starting Ceph mds.h for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:06:32.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:32 smithi022 ceph-mon[30854]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:32.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:32 smithi153 ceph-mon[35609]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:32.731 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:06:32 smithi100 podman[64370]: 2024-09-10 08:06:32.373950667 +0000 UTC m=+0.016419715 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:06:32.731 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:06:32 smithi100 podman[64370]: 2024-09-10 08:06:32.496420437 +0000 UTC m=+0.138889472 container create eb02af8bedc7d1feb5f91a0738f32f8884fd19f78febc075a15defb247efd22f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T08:06:32.731 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:06:32 smithi100 podman[64370]: 2024-09-10 08:06:32.732788722 +0000 UTC m=+0.375257757 container init eb02af8bedc7d1feb5f91a0738f32f8884fd19f78febc075a15defb247efd22f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-h, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T08:06:33.118 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:06:32 smithi100 podman[64370]: 2024-09-10 08:06:32.735815663 +0000 UTC m=+0.378284701 container start eb02af8bedc7d1feb5f91a0738f32f8884fd19f78febc075a15defb247efd22f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:06:33.118 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:06:32 smithi100 ceph-mds[64389]: -- 172.21.15.100:0/2708398152 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562e7ac67860 con 0x562e7ac45400 2024-09-10T08:06:33.118 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:06:32 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-h[64385]: starting mds.h at 2024-09-10T08:06:33.118 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:06:32 smithi100 bash[64370]: eb02af8bedc7d1feb5f91a0738f32f8884fd19f78febc075a15defb247efd22f 2024-09-10T08:06:33.118 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:06:32 smithi100 systemd[1]: Started Ceph mds.h for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:06:33.426 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:06:33.698 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:34.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:33 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:34.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:33 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:34.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:33 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:34.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:33 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:34.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:33 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:34.089 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:33 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:34.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:33 smithi022 ceph-mon[30854]: Deploying daemon mds.i on smithi153 2024-09-10T08:06:34.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:33 smithi022 ceph-mon[30854]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:34.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:33 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] up:boot 2024-09-10T08:06:34.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:33 smithi022 ceph-mon[30854]: fsmap 8 up:standby 2024-09-10T08:06:34.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:33 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T08:06:34.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.173+0000 7f42fb084640 1 -- 172.21.15.22:0/1068620648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f4102570 msgr2=0x7f42f41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:34.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.173+0000 7f42fb084640 1 --2- 172.21.15.22:0/1068620648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f4102570 0x7f42f41029b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009ca0 tx=0x7f42e402a950 comp rx=0 tx=0).stop 2024-09-10T08:06:34.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.173+0000 7f42fb084640 1 -- 172.21.15.22:0/1068620648 shutdown_connections 2024-09-10T08:06:34.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.173+0000 7f42fb084640 1 --2- 172.21.15.22:0/1068620648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42f4102ef0 0x7f42f410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.173+0000 7f42fb084640 1 --2- 172.21.15.22:0/1068620648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f4102570 0x7f42f41029b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.173+0000 7f42fb084640 1 --2- 172.21.15.22:0/1068620648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42f4100e20 0x7f42f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.173+0000 7f42fb084640 1 -- 172.21.15.22:0/1068620648 >> 172.21.15.22:0/1068620648 conn(0x7f42f40fc7d0 msgr2=0x7f42f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.173+0000 7f42fb084640 1 -- 172.21.15.22:0/1068620648 shutdown_connections 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.173+0000 7f42fb084640 1 -- 172.21.15.22:0/1068620648 wait complete. 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.173+0000 7f42fb084640 1 Processor -- start 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.173+0000 7f42fb084640 1 -- start start 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42fb084640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f4100e20 0x7f42f40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42fb084640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42f4102570 0x7f42f40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42fb084640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42f4102ef0 0x7f42f40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42fb084640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f42f4110f80 con 0x7f42f4100e20 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42fb084640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f42f4110e00 con 0x7f42f4102570 2024-09-10T08:06:34.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42fb084640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f42f4111100 con 0x7f42f4102ef0 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f8e20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f4100e20 0x7f42f40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f8e20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f4100e20 0x7f42f40fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58014/0 (socket says 172.21.15.22:58014) 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f8e20640 1 -- 172.21.15.22:0/1031333261 learned_addr learned my addr 172.21.15.22:0/1031333261 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f3fff640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42f4102570 0x7f42f40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f9621640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42f4102ef0 0x7f42f40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f8e20640 1 -- 172.21.15.22:0/1031333261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42f4102ef0 msgr2=0x7f42f40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f8e20640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42f4102ef0 0x7f42f40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f8e20640 1 -- 172.21.15.22:0/1031333261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42f4102570 msgr2=0x7f42f40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f8e20640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42f4102570 0x7f42f40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f8e20640 1 -- 172.21.15.22:0/1031333261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f41a6980 con 0x7f42f4100e20 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f8e20640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f4100e20 0x7f42f40fcc80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00d770 tx=0x7f42ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f1ffb640 1 -- 172.21.15.22:0/1031333261 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec017070 con 0x7f42f4100e20 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f1ffb640 1 -- 172.21.15.22:0/1031333261 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42ec005500 con 0x7f42f4100e20 2024-09-10T08:06:34.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42fb084640 1 -- 172.21.15.22:0/1031333261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f41a6c70 con 0x7f42f4100e20 2024-09-10T08:06:34.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.174+0000 7f42f1ffb640 1 -- 172.21.15.22:0/1031333261 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec004e00 con 0x7f42f4100e20 2024-09-10T08:06:34.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.175+0000 7f42fb084640 1 -- 172.21.15.22:0/1031333261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f41a7160 con 0x7f42f4100e20 2024-09-10T08:06:34.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.176+0000 7f42fb084640 1 -- 172.21.15.22:0/1031333261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f4101200 con 0x7f42f4100e20 2024-09-10T08:06:34.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.177+0000 7f42f1ffb640 1 -- 172.21.15.22:0/1031333261 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f42ec004fa0 con 0x7f42f4100e20 2024-09-10T08:06:34.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.177+0000 7f42f1ffb640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f42e00a2b80 0x7f42e00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:34.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.177+0000 7f42f3fff640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f42e00a2b80 0x7f42e00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:34.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.178+0000 7f42f1ffb640 1 -- 172.21.15.22:0/1031333261 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f42ec0ce570 con 0x7f42f4100e20 2024-09-10T08:06:34.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.178+0000 7f42f3fff640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f42e00a2b80 0x7f42e00a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f42f40fe710 tx=0x7f42e4004a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:34.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.182+0000 7f42f1ffb640 1 -- 172.21.15.22:0/1031333261 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42ec09b320 con 0x7f42f4100e20 2024-09-10T08:06:34.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:33 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:34.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:33 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:34.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:33 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:34.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:33 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:34.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:33 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:34.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:33 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:34.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:33 smithi153 ceph-mon[35609]: Deploying daemon mds.i on smithi153 2024-09-10T08:06:34.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:33 smithi153 ceph-mon[35609]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:34.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:33 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] up:boot 2024-09-10T08:06:34.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:33 smithi153 ceph-mon[35609]: fsmap 8 up:standby 2024-09-10T08:06:34.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:33 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T08:06:34.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:33 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:34.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:33 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:34.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:33 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:34.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:33 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:34.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:33 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:34.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:33 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:34.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:33 smithi100 ceph-mon[35102]: Deploying daemon mds.i on smithi153 2024-09-10T08:06:34.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:33 smithi100 ceph-mon[35102]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:34.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:33 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] up:boot 2024-09-10T08:06:34.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:33 smithi100 ceph-mon[35102]: fsmap 8 up:standby 2024-09-10T08:06:34.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:33 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T08:06:34.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.391+0000 7f42fb084640 1 -- 172.21.15.22:0/1031333261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42f41a7360 con 0x7f42f4100e20 2024-09-10T08:06:34.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.392+0000 7f42f1ffb640 1 -- 172.21.15.22:0/1031333261 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7219 (secure 0 0 0) 0x7f42ec09f620 con 0x7f42f4100e20 2024-09-10T08:06:34.392 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:34.392 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"btime":"2024-09-10T08:06:33:206285+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/2417436521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2417436521},{"type":"v1","addr":"172.21.15.153:6837","nonce":2417436521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1987693702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1987693702},{"type":"v1","addr":"172.21.15.100:6837","nonce":1987693702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T08:06:34.392 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2024-09-10T08:06:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.395+0000 7f42fb084640 1 -- 172.21.15.22:0/1031333261 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f42e00a2b80 msgr2=0x7f42e00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.395+0000 7f42fb084640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f42e00a2b80 0x7f42e00a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f42f40fe710 tx=0x7f42e4004a60 comp rx=0 tx=0).stop 2024-09-10T08:06:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.395+0000 7f42fb084640 1 -- 172.21.15.22:0/1031333261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f4100e20 msgr2=0x7f42f40fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.395+0000 7f42fb084640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f4100e20 0x7f42f40fcc80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00d770 tx=0x7f42ec00dc30 comp rx=0 tx=0).stop 2024-09-10T08:06:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.395+0000 7f42fb084640 1 -- 172.21.15.22:0/1031333261 shutdown_connections 2024-09-10T08:06:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.395+0000 7f42fb084640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f42e00a2b80 0x7f42e00a5040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.395+0000 7f42fb084640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42f4102ef0 0x7f42f40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.395+0000 7f42fb084640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42f4102570 0x7f42f40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.395+0000 7f42fb084640 1 --2- 172.21.15.22:0/1031333261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f4100e20 0x7f42f40fcc80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.395+0000 7f42fb084640 1 -- 172.21.15.22:0/1031333261 >> 172.21.15.22:0/1031333261 conn(0x7f42f40fc7d0 msgr2=0x7f42f4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.395+0000 7f42fb084640 1 -- 172.21.15.22:0/1031333261 shutdown_connections 2024-09-10T08:06:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:34.395+0000 7f42fb084640 1 -- 172.21.15.22:0/1031333261 wait complete. 2024-09-10T08:06:35.125 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:34 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1031333261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:35.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:34 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1031333261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:35.149 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:06:34 smithi153 systemd[1]: Starting Ceph mds.i for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:06:35.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:34 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1031333261' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:35.443 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:06:35 smithi153 podman[65850]: 2024-09-10 08:06:35.052252835 +0000 UTC m=+0.016235007 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:06:35.444 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:06:35 smithi153 podman[65850]: 2024-09-10 08:06:35.188913744 +0000 UTC m=+0.152895916 container create e96d35fbf7a92a319ce51638100463bb5b41860772655eb35e43f909391cecf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-i, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-10T08:06:35.776 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:06:35 smithi153 podman[65850]: 2024-09-10 08:06:35.458781423 +0000 UTC m=+0.422763594 container init e96d35fbf7a92a319ce51638100463bb5b41860772655eb35e43f909391cecf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:06:35.777 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:06:35 smithi153 podman[65850]: 2024-09-10 08:06:35.462489281 +0000 UTC m=+0.426471457 container start e96d35fbf7a92a319ce51638100463bb5b41860772655eb35e43f909391cecf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-i, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T08:06:35.777 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:06:35 smithi153 ceph-mds[65870]: -- 172.21.15.153:0/421658657 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f6ec73860 con 0x555f6ec50800 2024-09-10T08:06:35.777 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:06:35 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-i[65865]: starting mds.i at 2024-09-10T08:06:35.777 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:06:35 smithi153 bash[65850]: e96d35fbf7a92a319ce51638100463bb5b41860772655eb35e43f909391cecf2 2024-09-10T08:06:35.777 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:06:35 smithi153 systemd[1]: Started Ceph mds.i for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:06:36.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:36 smithi153 ceph-mon[35609]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:36.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:36.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:36.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:36.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:36.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:36.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:36.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:36 smithi153 ceph-mon[35609]: Deploying daemon mds.g on smithi022 2024-09-10T08:06:36.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:36 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] up:boot 2024-09-10T08:06:36.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:36 smithi153 ceph-mon[35609]: fsmap 9 up:standby 2024-09-10T08:06:36.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:36 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T08:06:37.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:36 smithi022 ceph-mon[30854]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:36 smithi022 ceph-mon[30854]: Deploying daemon mds.g on smithi022 2024-09-10T08:06:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:36 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] up:boot 2024-09-10T08:06:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:36 smithi022 ceph-mon[30854]: fsmap 9 up:standby 2024-09-10T08:06:37.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:36 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T08:06:37.120 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:36 smithi100 ceph-mon[35102]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:37.121 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:37.121 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:37.121 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:37.121 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:37.121 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:37.121 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:37.121 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:36 smithi100 ceph-mon[35102]: Deploying daemon mds.g on smithi022 2024-09-10T08:06:37.121 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:36 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] up:boot 2024-09-10T08:06:37.121 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:36 smithi100 ceph-mon[35102]: fsmap 9 up:standby 2024-09-10T08:06:37.121 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:36 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T08:06:37.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:06:37.410 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:37.725 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:06:37 smithi022 systemd[1]: Starting Ceph mds.g for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:06:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.944+0000 7fa280fbf640 1 -- 172.21.15.22:0/2856695334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c103660 msgr2=0x7fa27c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.944+0000 7fa280fbf640 1 --2- 172.21.15.22:0/2856695334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c103660 0x7fa27c10bb50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa270009900 tx=0x7fa27002a480 comp rx=0 tx=0).stop 2024-09-10T08:06:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.944+0000 7fa280fbf640 1 -- 172.21.15.22:0/2856695334 shutdown_connections 2024-09-10T08:06:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.944+0000 7fa280fbf640 1 --2- 172.21.15.22:0/2856695334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa27c10c170 0x7fa27c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.944+0000 7fa280fbf640 1 --2- 172.21.15.22:0/2856695334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c103660 0x7fa27c10bb50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.944+0000 7fa280fbf640 1 --2- 172.21.15.22:0/2856695334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c102d40 0x7fa27c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.944+0000 7fa280fbf640 1 -- 172.21.15.22:0/2856695334 >> 172.21.15.22:0/2856695334 conn(0x7fa27c0fc7a0 msgr2=0x7fa27c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.944+0000 7fa280fbf640 1 -- 172.21.15.22:0/2856695334 shutdown_connections 2024-09-10T08:06:37.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.944+0000 7fa280fbf640 1 -- 172.21.15.22:0/2856695334 wait complete. 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa280fbf640 1 Processor -- start 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa280fbf640 1 -- start start 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa280fbf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c102d40 0x7fa27c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa280fbf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa27c103660 0x7fa27c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa280fbf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c10c170 0x7fa27c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa280fbf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c111f70 con 0x7fa27c102d40 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa280fbf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c111df0 con 0x7fa27c103660 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa280fbf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa27c1120f0 con 0x7fa27c10c170 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa27a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c102d40 0x7fa27c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa27a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c102d40 0x7fa27c1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58034/0 (socket says 172.21.15.22:58034) 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa27a59c640 1 -- 172.21.15.22:0/2513485522 learned_addr learned my addr 172.21.15.22:0/2513485522 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa27ad9d640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c10c170 0x7fa27c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa279d9b640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa27c103660 0x7fa27c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:37.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa27a59c640 1 -- 172.21.15.22:0/2513485522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c10c170 msgr2=0x7fa27c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa27a59c640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c10c170 0x7fa27c19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa27a59c640 1 -- 172.21.15.22:0/2513485522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa27c103660 msgr2=0x7fa27c1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa27a59c640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa27c103660 0x7fa27c1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.945+0000 7fa27a59c640 1 -- 172.21.15.22:0/2513485522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa27c19d360 con 0x7fa27c102d40 2024-09-10T08:06:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.946+0000 7fa27a59c640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c102d40 0x7fa27c1983b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00c920 tx=0x7fa26c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.946+0000 7fa26b7fe640 1 -- 172.21.15.22:0/2513485522 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c007c70 con 0x7fa27c102d40 2024-09-10T08:06:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.946+0000 7fa26b7fe640 1 -- 172.21.15.22:0/2513485522 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa26c007e10 con 0x7fa27c102d40 2024-09-10T08:06:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.946+0000 7fa280fbf640 1 -- 172.21.15.22:0/2513485522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa27c19d650 con 0x7fa27c102d40 2024-09-10T08:06:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.946+0000 7fa26b7fe640 1 -- 172.21.15.22:0/2513485522 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c018890 con 0x7fa27c102d40 2024-09-10T08:06:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.946+0000 7fa280fbf640 1 -- 172.21.15.22:0/2513485522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa27c1a4f30 con 0x7fa27c102d40 2024-09-10T08:06:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.947+0000 7fa280fbf640 1 -- 172.21.15.22:0/2513485522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa27c103120 con 0x7fa27c102d40 2024-09-10T08:06:37.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.948+0000 7fa26b7fe640 1 -- 172.21.15.22:0/2513485522 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa26c018a50 con 0x7fa27c102d40 2024-09-10T08:06:37.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.949+0000 7fa26b7fe640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa2640a2b80 0x7fa2640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:37.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.949+0000 7fa279d9b640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa2640a2b80 0x7fa2640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:37.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.949+0000 7fa26b7fe640 1 -- 172.21.15.22:0/2513485522 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fa26c0cf060 con 0x7fa27c102d40 2024-09-10T08:06:37.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.949+0000 7fa279d9b640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa2640a2b80 0x7fa2640a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa27c10d4d0 tx=0x7fa270031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:37.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:37.952+0000 7fa26b7fe640 1 -- 172.21.15.22:0/2513485522 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa26c014030 con 0x7fa27c102d40 2024-09-10T08:06:38.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.173+0000 7fa280fbf640 1 -- 172.21.15.22:0/2513485522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa27c106c50 con 0x7fa27c102d40 2024-09-10T08:06:38.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.173+0000 7fa26b7fe640 1 -- 172.21.15.22:0/2513485522 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8049 (secure 0 0 0) 0x7fa26c09c4d0 con 0x7fa27c102d40 2024-09-10T08:06:38.173 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:38.173 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":10,"btime":"2024-09-10T08:06:35:890334+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/2417436521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2417436521},{"type":"v1","addr":"172.21.15.153:6837","nonce":2417436521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1766856743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1766856743},{"type":"v1","addr":"172.21.15.153:6839","nonce":1766856743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1987693702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1987693702},{"type":"v1","addr":"172.21.15.100:6837","nonce":1987693702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T08:06:38.173 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 10 2024-09-10T08:06:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.176+0000 7fa280fbf640 1 -- 172.21.15.22:0/2513485522 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa2640a2b80 msgr2=0x7fa2640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.176+0000 7fa280fbf640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa2640a2b80 0x7fa2640a5040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa27c10d4d0 tx=0x7fa270031490 comp rx=0 tx=0).stop 2024-09-10T08:06:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.176+0000 7fa280fbf640 1 -- 172.21.15.22:0/2513485522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c102d40 msgr2=0x7fa27c1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.176+0000 7fa280fbf640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c102d40 0x7fa27c1983b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00c920 tx=0x7fa26c00cde0 comp rx=0 tx=0).stop 2024-09-10T08:06:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.176+0000 7fa280fbf640 1 -- 172.21.15.22:0/2513485522 shutdown_connections 2024-09-10T08:06:38.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.176+0000 7fa280fbf640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa2640a2b80 0x7fa2640a5040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:38.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.176+0000 7fa280fbf640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa27c10c170 0x7fa27c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:38.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.176+0000 7fa280fbf640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa27c103660 0x7fa27c1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:38.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.176+0000 7fa280fbf640 1 --2- 172.21.15.22:0/2513485522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa27c102d40 0x7fa27c1983b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:38.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.176+0000 7fa280fbf640 1 -- 172.21.15.22:0/2513485522 >> 172.21.15.22:0/2513485522 conn(0x7fa27c0fc7a0 msgr2=0x7fa27c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:38.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.176+0000 7fa280fbf640 1 -- 172.21.15.22:0/2513485522 shutdown_connections 2024-09-10T08:06:38.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:38.176+0000 7fa280fbf640 1 -- 172.21.15.22:0/2513485522 wait complete. 2024-09-10T08:06:38.503 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:06:38 smithi022 podman[69390]: 2024-09-10 08:06:38.013909846 +0000 UTC m=+0.016625440 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:06:38.503 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:06:38 smithi022 podman[69390]: 2024-09-10 08:06:38.13617129 +0000 UTC m=+0.138886879 container create c43e4ef5bdbb0712c0d596672185c0c4bf30c96ea373c43ff81c79ee0f3db721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-g, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T08:06:38.866 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:38 smithi022 ceph-mon[30854]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:38.867 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:38 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2513485522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:38.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:38 smithi153 ceph-mon[35609]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:38.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:38 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2513485522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:39.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:38 smithi100 ceph-mon[35102]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:39.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:38 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2513485522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:39.253 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:06:39 smithi022 podman[69390]: 2024-09-10 08:06:39.002953964 +0000 UTC m=+1.005669562 container init c43e4ef5bdbb0712c0d596672185c0c4bf30c96ea373c43ff81c79ee0f3db721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:06:39.253 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:06:39 smithi022 podman[69390]: 2024-09-10 08:06:39.006187353 +0000 UTC m=+1.008902934 container start c43e4ef5bdbb0712c0d596672185c0c4bf30c96ea373c43ff81c79ee0f3db721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-g, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T08:06:39.253 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:06:39 smithi022 ceph-mds[69428]: -- 172.21.15.22:0/1220056398 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f39193860 con 0x563f39170800 2024-09-10T08:06:39.253 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:06:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-g[69420]: starting mds.g at 2024-09-10T08:06:39.253 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:06:39 smithi022 bash[69390]: c43e4ef5bdbb0712c0d596672185c0c4bf30c96ea373c43ff81c79ee0f3db721 2024-09-10T08:06:39.254 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:06:39 smithi022 systemd[1]: Started Ceph mds.g for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:06:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:40 smithi153 ceph-mon[35609]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:40 smithi153 ceph-mon[35609]: Deploying daemon mds.a on smithi022 2024-09-10T08:06:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:40 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.22:6838/896927555,v1:172.21.15.22:6839/896927555] up:boot 2024-09-10T08:06:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:40 smithi153 ceph-mon[35609]: fsmap 10 up:standby 2024-09-10T08:06:40.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:40 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T08:06:40.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:40 smithi022 ceph-mon[30854]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:40.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:40.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:40.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:40 smithi022 ceph-mon[30854]: Deploying daemon mds.a on smithi022 2024-09-10T08:06:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:40 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.22:6838/896927555,v1:172.21.15.22:6839/896927555] up:boot 2024-09-10T08:06:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:40 smithi022 ceph-mon[30854]: fsmap 10 up:standby 2024-09-10T08:06:40.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:40 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T08:06:40.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:40 smithi100 ceph-mon[35102]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:40.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:40 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:40.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:40 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:40.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:40 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:40.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:40 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:40.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:40 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:40.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:40 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:40.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:40 smithi100 ceph-mon[35102]: Deploying daemon mds.a on smithi022 2024-09-10T08:06:40.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:40 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.22:6838/896927555,v1:172.21.15.22:6839/896927555] up:boot 2024-09-10T08:06:40.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:40 smithi100 ceph-mon[35102]: fsmap 10 up:standby 2024-09-10T08:06:40.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:40 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T08:06:40.896 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:06:41.238 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:06:41 smithi022 systemd[1]: Starting Ceph mds.a for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:06:41.503 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:06:41 smithi022 podman[69728]: 2024-09-10 08:06:41.141960805 +0000 UTC m=+0.016730389 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:06:41.503 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:06:41 smithi022 podman[69728]: 2024-09-10 08:06:41.26401354 +0000 UTC m=+0.138783123 container create 420e377e7aa27dcec0a25c00690bd74ed4653913539d44cea55d5d3072d967bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:06:41.684 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:41.792 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:06:41 smithi022 podman[69728]: 2024-09-10 08:06:41.508751747 +0000 UTC m=+0.383521331 container init 420e377e7aa27dcec0a25c00690bd74ed4653913539d44cea55d5d3072d967bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T08:06:41.792 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:06:41 smithi022 podman[69728]: 2024-09-10 08:06:41.511889598 +0000 UTC m=+0.386659190 container start 420e377e7aa27dcec0a25c00690bd74ed4653913539d44cea55d5d3072d967bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T08:06:41.792 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:06:41 smithi022 ceph-mds[69759]: -- 172.21.15.22:0/3904491661 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc4359f860 con 0x55fc4357c800 2024-09-10T08:06:41.792 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:06:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-a[69755]: starting mds.a at 2024-09-10T08:06:41.792 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:06:41 smithi022 bash[69728]: 420e377e7aa27dcec0a25c00690bd74ed4653913539d44cea55d5d3072d967bb 2024-09-10T08:06:41.793 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:06:41 smithi022 systemd[1]: Started Ceph mds.a for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:06:42.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.154+0000 7f2daeebb640 1 -- 172.21.15.22:0/546585736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8106f10 msgr2=0x7f2da810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:42.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.154+0000 7f2daeebb640 1 --2- 172.21.15.22:0/546585736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8106f10 0x7f2da810ea90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009ca0 tx=0x7f2da002a8c0 comp rx=0 tx=0).stop 2024-09-10T08:06:42.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.155+0000 7f2daeebb640 1 -- 172.21.15.22:0/546585736 shutdown_connections 2024-09-10T08:06:42.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.155+0000 7f2daeebb640 1 --2- 172.21.15.22:0/546585736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8106f10 0x7f2da810ea90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:42.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.155+0000 7f2daeebb640 1 --2- 172.21.15.22:0/546585736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2da8102790 0x7f2da81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:42.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.155+0000 7f2daeebb640 1 --2- 172.21.15.22:0/546585736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2da8101de0 0x7f2da81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:42.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.155+0000 7f2daeebb640 1 -- 172.21.15.22:0/546585736 >> 172.21.15.22:0/546585736 conn(0x7f2da80fd8c0 msgr2=0x7f2da80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:42.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.155+0000 7f2daeebb640 1 -- 172.21.15.22:0/546585736 shutdown_connections 2024-09-10T08:06:42.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.155+0000 7f2daeebb640 1 -- 172.21.15.22:0/546585736 wait complete. 2024-09-10T08:06:42.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.155+0000 7f2daeebb640 1 Processor -- start 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.155+0000 7f2daeebb640 1 -- start start 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2daeebb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8101de0 0x7f2da8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2daeebb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2da8102790 0x7f2da8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2daeebb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2da8106f10 0x7f2da819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2daeebb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2da8111f70 con 0x7f2da8101de0 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2daeebb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2da8111df0 con 0x7f2da8102790 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2daeebb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2da81120f0 con 0x7f2da8106f10 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2dacc57640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8101de0 0x7f2da8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2dacc57640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8101de0 0x7f2da8198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58090/0 (socket says 172.21.15.22:58090) 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2dacc57640 1 -- 172.21.15.22:0/1291574307 learned_addr learned my addr 172.21.15.22:0/1291574307 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2da7fff640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2da8102790 0x7f2da8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2dacc57640 1 -- 172.21.15.22:0/1291574307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2da8106f10 msgr2=0x7f2da819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:42.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2dad458640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2da8106f10 0x7f2da819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2dacc57640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2da8106f10 0x7f2da819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2dacc57640 1 -- 172.21.15.22:0/1291574307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2da8102790 msgr2=0x7f2da8198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2dacc57640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2da8102790 0x7f2da8198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2dacc57640 1 -- 172.21.15.22:0/1291574307 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da819d3c0 con 0x7f2da8101de0 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2da7fff640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2da8102790 0x7f2da8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2dacc57640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8101de0 0x7f2da8198410 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00d950 tx=0x7f2d9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.156+0000 7f2da5ffb640 1 -- 172.21.15.22:0/1291574307 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c017070 con 0x7f2da8101de0 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.157+0000 7f2da5ffb640 1 -- 172.21.15.22:0/1291574307 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d9c009c30 con 0x7f2da8101de0 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.157+0000 7f2daeebb640 1 -- 172.21.15.22:0/1291574307 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da819d6b0 con 0x7f2da8101de0 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.157+0000 7f2da5ffb640 1 -- 172.21.15.22:0/1291574307 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c00f6b0 con 0x7f2da8101de0 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.157+0000 7f2daeebb640 1 -- 172.21.15.22:0/1291574307 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da81a4f90 con 0x7f2da8101de0 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.158+0000 7f2daeebb640 1 -- 172.21.15.22:0/1291574307 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2da81021c0 con 0x7f2da8101de0 2024-09-10T08:06:42.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.159+0000 7f2da5ffb640 1 -- 172.21.15.22:0/1291574307 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f2d9c0109d0 con 0x7f2da8101de0 2024-09-10T08:06:42.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.159+0000 7f2da5ffb640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2d980a2b80 0x7f2d980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:42.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.159+0000 7f2da5ffb640 1 -- 172.21.15.22:0/1291574307 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f2d9c0ce8e0 con 0x7f2da8101de0 2024-09-10T08:06:42.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.159+0000 7f2da7fff640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2d980a2b80 0x7f2d980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:42.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.160+0000 7f2da7fff640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2d980a2b80 0x7f2d980a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2d94005d70 tx=0x7f2d94005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:42.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.164+0000 7f2da5ffb640 1 -- 172.21.15.22:0/1291574307 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2d9c009de0 con 0x7f2da8101de0 2024-09-10T08:06:42.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.379+0000 7f2daeebb640 1 -- 172.21.15.22:0/1291574307 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2da8199770 con 0x7f2da8101de0 2024-09-10T08:06:42.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.380+0000 7f2da5ffb640 1 -- 172.21.15.22:0/1291574307 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9686 (secure 0 0 0) 0x7f2d9c09bce0 con 0x7f2da8101de0 2024-09-10T08:06:42.380 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:42.380 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"btime":"2024-09-10T08:06:42:164787+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/896927555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":896927555},{"type":"v1","addr":"172.21.15.22:6839","nonce":896927555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/969125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":969125},{"type":"v1","addr":"172.21.15.22:6841","nonce":969125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/2417436521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2417436521},{"type":"v1","addr":"172.21.15.153:6837","nonce":2417436521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1766856743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1766856743},{"type":"v1","addr":"172.21.15.153:6839","nonce":1766856743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1987693702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1987693702},{"type":"v1","addr":"172.21.15.100:6837","nonce":1987693702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T08:06:42.380 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2024-09-10T08:06:42.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.382+0000 7f2daeebb640 1 -- 172.21.15.22:0/1291574307 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2d980a2b80 msgr2=0x7f2d980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:42.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.382+0000 7f2daeebb640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2d980a2b80 0x7f2d980a5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2d94005d70 tx=0x7f2d94005d00 comp rx=0 tx=0).stop 2024-09-10T08:06:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.382+0000 7f2daeebb640 1 -- 172.21.15.22:0/1291574307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8101de0 msgr2=0x7f2da8198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.382+0000 7f2daeebb640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8101de0 0x7f2da8198410 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00d950 tx=0x7f2d9c00de10 comp rx=0 tx=0).stop 2024-09-10T08:06:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.382+0000 7f2daeebb640 1 -- 172.21.15.22:0/1291574307 shutdown_connections 2024-09-10T08:06:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.382+0000 7f2daeebb640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2d980a2b80 0x7f2d980a5040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.382+0000 7f2daeebb640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2da8106f10 0x7f2da819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.382+0000 7f2daeebb640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2da8102790 0x7f2da8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.382+0000 7f2daeebb640 1 --2- 172.21.15.22:0/1291574307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8101de0 0x7f2da8198410 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.382+0000 7f2daeebb640 1 -- 172.21.15.22:0/1291574307 >> 172.21.15.22:0/1291574307 conn(0x7f2da80fd8c0 msgr2=0x7f2da80feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.382+0000 7f2daeebb640 1 -- 172.21.15.22:0/1291574307 shutdown_connections 2024-09-10T08:06:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:42.382+0000 7f2daeebb640 1 -- 172.21.15.22:0/1291574307 wait complete. 2024-09-10T08:06:42.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:42 smithi100 ceph-mon[35102]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:42.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:42.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:42.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:42.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:42.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:42.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:42.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:42 smithi100 ceph-mon[35102]: Deploying daemon mds.b on smithi100 2024-09-10T08:06:42.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:42 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] up:boot 2024-09-10T08:06:42.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:42 smithi100 ceph-mon[35102]: fsmap 11 up:standby 2024-09-10T08:06:42.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:42 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T08:06:42.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:42 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1291574307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:42.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:42 smithi153 ceph-mon[35609]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:42.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:42.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:42.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:42.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:42.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:42.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:42.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:42 smithi153 ceph-mon[35609]: Deploying daemon mds.b on smithi100 2024-09-10T08:06:42.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:42 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] up:boot 2024-09-10T08:06:42.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:42 smithi153 ceph-mon[35609]: fsmap 11 up:standby 2024-09-10T08:06:42.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:42 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T08:06:42.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:42 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1291574307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:43.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:42 smithi022 ceph-mon[30854]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:43.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:43.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:43.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:43.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-10T08:06:43.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T08:06:43.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:43.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:42 smithi022 ceph-mon[30854]: Deploying daemon mds.b on smithi100 2024-09-10T08:06:43.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:42 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] up:boot 2024-09-10T08:06:43.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:42 smithi022 ceph-mon[30854]: fsmap 11 up:standby 2024-09-10T08:06:43.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:42 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T08:06:43.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:42 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1291574307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:43.851 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:06:43 smithi100 systemd[1]: Starting Ceph mds.b for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:06:44.112 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:06:43 smithi100 podman[64684]: 2024-09-10 08:06:43.755111795 +0000 UTC m=+0.015848185 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:06:44.113 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:06:43 smithi100 podman[64684]: 2024-09-10 08:06:43.885739801 +0000 UTC m=+0.146476228 container create 36c787485dc0f8c73a778943ac242099ac432eef2ba1a4f9f97767c9bcee92eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T08:06:44.113 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:06:44 smithi100 podman[64684]: 2024-09-10 08:06:44.113928476 +0000 UTC m=+0.374664858 container init 36c787485dc0f8c73a778943ac242099ac432eef2ba1a4f9f97767c9bcee92eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2) 2024-09-10T08:06:44.368 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:06:44 smithi100 podman[64684]: 2024-09-10 08:06:44.116866403 +0000 UTC m=+0.377602791 container start 36c787485dc0f8c73a778943ac242099ac432eef2ba1a4f9f97767c9bcee92eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:06:44.368 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:06:44 smithi100 ceph-mds[64703]: -- 172.21.15.100:0/2026999839 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a4d4eef860 con 0x55a4d4ecd000 2024-09-10T08:06:44.368 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:06:44 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b[64699]: starting mds.b at 2024-09-10T08:06:44.368 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:06:44 smithi100 bash[64684]: 36c787485dc0f8c73a778943ac242099ac432eef2ba1a4f9f97767c9bcee92eb 2024-09-10T08:06:44.368 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:06:44 smithi100 systemd[1]: Started Ceph mds.b for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:06:44.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:44 smithi153 ceph-mon[35609]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:44.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:44 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:44.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:44 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:44.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:44 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:44.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:44 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:44.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:44 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:44.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:44 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:06:44.985 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:44 smithi100 ceph-mon[35102]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:44.985 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:44 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:44.985 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:44 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:44.985 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:44 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:44.985 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:44 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:44.985 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:44 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:44.985 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:44 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:06:45.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:44 smithi022 ceph-mon[30854]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:45.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:44 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:45.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:44 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:45.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:44 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:45.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:44 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:45.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:44 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:45.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:44 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:06:45.092 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:06:45.459 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:45.858 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:45 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] up:boot 2024-09-10T08:06:45.858 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:45 smithi022 ceph-mon[30854]: fsmap 12 up:standby 2024-09-10T08:06:45.859 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:45 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T08:06:45.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:45 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] up:boot 2024-09-10T08:06:45.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:45 smithi153 ceph-mon[35609]: fsmap 12 up:standby 2024-09-10T08:06:45.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:45 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T08:06:45.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.944+0000 7f27847f9640 1 -- 172.21.15.22:0/2586993787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f277c101de0 msgr2=0x7f277c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:45.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.944+0000 7f27847f9640 1 --2- 172.21.15.22:0/2586993787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f277c101de0 0x7f277c1021c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2778009900 tx=0x7f277802a410 comp rx=0 tx=0).stop 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.944+0000 7f27847f9640 1 -- 172.21.15.22:0/2586993787 shutdown_connections 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.944+0000 7f27847f9640 1 --2- 172.21.15.22:0/2586993787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f277c106f10 0x7f277c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.944+0000 7f27847f9640 1 --2- 172.21.15.22:0/2586993787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f277c102790 0x7f277c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.944+0000 7f27847f9640 1 --2- 172.21.15.22:0/2586993787 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f277c101de0 0x7f277c1021c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.944+0000 7f27847f9640 1 -- 172.21.15.22:0/2586993787 >> 172.21.15.22:0/2586993787 conn(0x7f277c0fd8c0 msgr2=0x7f277c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.945+0000 7f27847f9640 1 -- 172.21.15.22:0/2586993787 shutdown_connections 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.945+0000 7f27847f9640 1 -- 172.21.15.22:0/2586993787 wait complete. 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.945+0000 7f27847f9640 1 Processor -- start 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.945+0000 7f27847f9640 1 -- start start 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.945+0000 7f27847f9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f277c101de0 0x7f277c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.945+0000 7f27847f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f277c102790 0x7f277c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.945+0000 7f27847f9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f277c106f10 0x7f277c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:45.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.945+0000 7f27847f9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f277c111f70 con 0x7f277c102790 2024-09-10T08:06:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.945+0000 7f27847f9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f277c111df0 con 0x7f277c101de0 2024-09-10T08:06:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.945+0000 7f27847f9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f277c1120f0 con 0x7f277c106f10 2024-09-10T08:06:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.945+0000 7f2781d94640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f277c102790 0x7f277c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f2781d94640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f277c102790 0x7f277c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33962/0 (socket says 172.21.15.22:33962) 2024-09-10T08:06:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f2781d94640 1 -- 172.21.15.22:0/830283624 learned_addr learned my addr 172.21.15.22:0/830283624 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f2782595640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f277c101de0 0x7f277c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f2782d96640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f277c106f10 0x7f277c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f2781d94640 1 -- 172.21.15.22:0/830283624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f277c106f10 msgr2=0x7f277c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f2781d94640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f277c106f10 0x7f277c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f2781d94640 1 -- 172.21.15.22:0/830283624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f277c101de0 msgr2=0x7f277c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f2781d94640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f277c101de0 0x7f277c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:45.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f2781d94640 1 -- 172.21.15.22:0/830283624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277c1a6930 con 0x7f277c102790 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f2782595640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f277c101de0 0x7f277c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f2781d94640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f277c102790 0x7f277c074a30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f276c00e9f0 tx=0x7f276c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f27737fe640 1 -- 172.21.15.22:0/830283624 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c00cd80 con 0x7f277c102790 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f27737fe640 1 -- 172.21.15.22:0/830283624 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f276c010910 con 0x7f277c102790 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f27847f9640 1 -- 172.21.15.22:0/830283624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277c1a6c20 con 0x7f277c102790 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f27737fe640 1 -- 172.21.15.22:0/830283624 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c018990 con 0x7f277c102790 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.946+0000 7f27847f9640 1 -- 172.21.15.22:0/830283624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277c1a7160 con 0x7f277c102790 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.947+0000 7f27847f9640 1 -- 172.21.15.22:0/830283624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f277c1021c0 con 0x7f277c102790 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.949+0000 7f27737fe640 1 -- 172.21.15.22:0/830283624 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f276c010ac0 con 0x7f277c102790 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.950+0000 7f27737fe640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f27680a2b80 0x7f27680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.950+0000 7f2782595640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f27680a2b80 0x7f27680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.950+0000 7f27737fe640 1 -- 172.21.15.22:0/830283624 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f276c0cf3d0 con 0x7f277c102790 2024-09-10T08:06:45.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.950+0000 7f2782595640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f27680a2b80 0x7f27680a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2778005ab0 tx=0x7f2778005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:45.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:45.953+0000 7f27737fe640 1 -- 172.21.15.22:0/830283624 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f276c09c730 con 0x7f277c102790 2024-09-10T08:06:46.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:45 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] up:boot 2024-09-10T08:06:46.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:45 smithi100 ceph-mon[35102]: fsmap 12 up:standby 2024-09-10T08:06:46.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:45 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T08:06:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.172+0000 7f27847f9640 1 -- 172.21.15.22:0/830283624 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f277c075a20 con 0x7f277c102790 2024-09-10T08:06:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.173+0000 7f27737fe640 1 -- 172.21.15.22:0/830283624 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10515 (secure 0 0 0) 0x7f277c075a20 con 0x7f277c102790 2024-09-10T08:06:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:46.173 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":13,"btime":"2024-09-10T08:06:44:650647+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/896927555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":896927555},{"type":"v1","addr":"172.21.15.22:6839","nonce":896927555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/969125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":969125},{"type":"v1","addr":"172.21.15.22:6841","nonce":969125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24409,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24431,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/2417436521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2417436521},{"type":"v1","addr":"172.21.15.153:6837","nonce":2417436521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1766856743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1766856743},{"type":"v1","addr":"172.21.15.153:6839","nonce":1766856743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1987693702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1987693702},{"type":"v1","addr":"172.21.15.100:6837","nonce":1987693702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24512,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/2512683674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":2512683674},{"type":"v1","addr":"172.21.15.100:6839","nonce":2512683674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-10T08:06:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 13 2024-09-10T08:06:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.176+0000 7f27847f9640 1 -- 172.21.15.22:0/830283624 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f27680a2b80 msgr2=0x7f27680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.176+0000 7f27847f9640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f27680a2b80 0x7f27680a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2778005ab0 tx=0x7f2778005a20 comp rx=0 tx=0).stop 2024-09-10T08:06:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.176+0000 7f27847f9640 1 -- 172.21.15.22:0/830283624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f277c102790 msgr2=0x7f277c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.176+0000 7f27847f9640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f277c102790 0x7f277c074a30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f276c00e9f0 tx=0x7f276c00eeb0 comp rx=0 tx=0).stop 2024-09-10T08:06:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.176+0000 7f27847f9640 1 -- 172.21.15.22:0/830283624 shutdown_connections 2024-09-10T08:06:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.176+0000 7f27847f9640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f27680a2b80 0x7f27680a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.176+0000 7f27847f9640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f277c106f10 0x7f277c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.176+0000 7f27847f9640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f277c102790 0x7f277c074a30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.176+0000 7f27847f9640 1 --2- 172.21.15.22:0/830283624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f277c101de0 0x7f277c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.176+0000 7f27847f9640 1 -- 172.21.15.22:0/830283624 >> 172.21.15.22:0/830283624 conn(0x7f277c0fd8c0 msgr2=0x7f277c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.176+0000 7f27847f9640 1 -- 172.21.15.22:0/830283624 shutdown_connections 2024-09-10T08:06:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:46.176+0000 7f27847f9640 1 -- 172.21.15.22:0/830283624 wait complete. 2024-09-10T08:06:46.831 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T08:06:46.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/830283624' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:46 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:06:47.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:47.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/830283624' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:46 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:06:47.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:47.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.176 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/830283624' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:06:47.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:47.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:47.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:47.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:46 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:06:47.626 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.130+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2578104668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a78102570 msgr2=0x7f1a781029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.130+0000 7f1a7ff65640 1 --2- 172.21.15.22:0/2578104668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a78102570 0x7f1a781029b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009900 tx=0x7f1a6802a480 comp rx=0 tx=0).stop 2024-09-10T08:06:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.130+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2578104668 shutdown_connections 2024-09-10T08:06:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.130+0000 7f1a7ff65640 1 --2- 172.21.15.22:0/2578104668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a78102ef0 0x7f1a7810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.130+0000 7f1a7ff65640 1 --2- 172.21.15.22:0/2578104668 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a78102570 0x7f1a781029b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.130+0000 7f1a7ff65640 1 --2- 172.21.15.22:0/2578104668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a78100e20 0x7f1a78101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.130+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2578104668 >> 172.21.15.22:0/2578104668 conn(0x7f1a780fc7d0 msgr2=0x7f1a780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:48.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.131+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2578104668 shutdown_connections 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.131+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2578104668 wait complete. 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.131+0000 7f1a7ff65640 1 Processor -- start 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.131+0000 7f1a7ff65640 1 -- start start 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.131+0000 7f1a7ff65640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a78100e20 0x7f1a781973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.131+0000 7f1a7ff65640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a78102570 0x7f1a78197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.131+0000 7f1a7ff65640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a78102ef0 0x7f1a7819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.131+0000 7f1a7ff65640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78110f80 con 0x7f1a78100e20 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.131+0000 7f1a7ff65640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78110e00 con 0x7f1a78102570 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.131+0000 7f1a7ff65640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78111100 con 0x7f1a78102ef0 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7dd01640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a78100e20 0x7f1a781973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7dd01640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a78100e20 0x7f1a781973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33978/0 (socket says 172.21.15.22:33978) 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7dd01640 1 -- 172.21.15.22:0/2158222418 learned_addr learned my addr 172.21.15.22:0/2158222418 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:48.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7d500640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a78102570 0x7f1a78197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7e502640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a78102ef0 0x7f1a7819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7dd01640 1 -- 172.21.15.22:0/2158222418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a78102ef0 msgr2=0x7f1a7819bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7dd01640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a78102ef0 0x7f1a7819bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7dd01640 1 -- 172.21.15.22:0/2158222418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a78102570 msgr2=0x7f1a78197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7dd01640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a78102570 0x7f1a78197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7dd01640 1 -- 172.21.15.22:0/2158222418 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7819c390 con 0x7f1a78100e20 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7e502640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a78102ef0 0x7f1a7819bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7d500640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a78102570 0x7f1a78197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7dd01640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a78100e20 0x7f1a781973e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400d950 tx=0x7f1a7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a6effd640 1 -- 172.21.15.22:0/2158222418 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a74017030 con 0x7f1a78100e20 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a6effd640 1 -- 172.21.15.22:0/2158222418 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a74004020 con 0x7f1a78100e20 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2158222418 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7819c680 con 0x7f1a78100e20 2024-09-10T08:06:48.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a6effd640 1 -- 172.21.15.22:0/2158222418 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a740047a0 con 0x7f1a78100e20 2024-09-10T08:06:48.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.132+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2158222418 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a781a3f60 con 0x7f1a78100e20 2024-09-10T08:06:48.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.133+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2158222418 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a78101200 con 0x7f1a78100e20 2024-09-10T08:06:48.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.134+0000 7f1a6effd640 1 -- 172.21.15.22:0/2158222418 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f1a740041d0 con 0x7f1a78100e20 2024-09-10T08:06:48.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.135+0000 7f1a6effd640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1a640a2b80 0x7f1a640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:48.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.135+0000 7f1a7d500640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1a640a2b80 0x7f1a640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:48.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.135+0000 7f1a6effd640 1 -- 172.21.15.22:0/2158222418 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f1a740ce6a0 con 0x7f1a78100e20 2024-09-10T08:06:48.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.136+0000 7f1a7d500640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1a640a2b80 0x7f1a640a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1a780fec10 tx=0x7f1a68005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:48.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.139+0000 7f1a6effd640 1 -- 172.21.15.22:0/2158222418 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1a7409baa0 con 0x7f1a78100e20 2024-09-10T08:06:48.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.322+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2158222418 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1a78198740 con 0x7f1a78100e20 2024-09-10T08:06:48.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.323+0000 7f1a6effd640 1 -- 172.21.15.22:0/2158222418 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7f1a7409b3a0 con 0x7f1a78100e20 2024-09-10T08:06:48.322 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:48.323 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2024-09-10T08:06:48.323 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:06:48.323 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2024-09-10T08:06:48.323 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2024-09-10T08:06:48.323 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:06:48.323 INFO:teuthology.orchestra.run.smithi022.stdout:] 2024-09-10T08:06:48.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.325+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2158222418 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1a640a2b80 msgr2=0x7f1a640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:48.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.325+0000 7f1a7ff65640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1a640a2b80 0x7f1a640a5040 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1a780fec10 tx=0x7f1a68005a20 comp rx=0 tx=0).stop 2024-09-10T08:06:48.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.325+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2158222418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a78100e20 msgr2=0x7f1a781973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:48.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.325+0000 7f1a7ff65640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a78100e20 0x7f1a781973e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400d950 tx=0x7f1a7400de10 comp rx=0 tx=0).stop 2024-09-10T08:06:48.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.325+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2158222418 shutdown_connections 2024-09-10T08:06:48.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.325+0000 7f1a7ff65640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1a640a2b80 0x7f1a640a5040 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:48.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.325+0000 7f1a7ff65640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a78102ef0 0x7f1a7819bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:48.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.325+0000 7f1a7ff65640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a78102570 0x7f1a78197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:48.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.325+0000 7f1a7ff65640 1 --2- 172.21.15.22:0/2158222418 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a78100e20 0x7f1a781973e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:48.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.325+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2158222418 >> 172.21.15.22:0/2158222418 conn(0x7f1a780fc7d0 msgr2=0x7f1a781068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:48.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.326+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2158222418 shutdown_connections 2024-09-10T08:06:48.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:48.326+0000 7f1a7ff65640 1 -- 172.21.15.22:0/2158222418 wait complete. 2024-09-10T08:06:48.977 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:48 smithi022 ceph-mon[30854]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:48.977 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:48.978 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:48.978 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:48.978 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:48 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:48.978 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:48 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2158222418' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T08:06:49.006 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:06:49.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:06:49.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:48 smithi100 ceph-mon[35102]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:49.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:49.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:49.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:49.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:48 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:49.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:48 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2158222418' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T08:06:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:48 smithi153 ceph-mon[35609]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:48 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:48 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2158222418' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-10T08:06:49.292 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.736+0000 7f67b6a53640 1 -- 172.21.15.22:0/1552085303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67b0101440 msgr2=0x7f67b010df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.736+0000 7f67b6a53640 1 --2- 172.21.15.22:0/1552085303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67b0101440 0x7f67b010df30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009900 tx=0x7f67a402a410 comp rx=0 tx=0).stop 2024-09-10T08:06:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.736+0000 7f67b6a53640 1 -- 172.21.15.22:0/1552085303 shutdown_connections 2024-09-10T08:06:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.736+0000 7f67b6a53640 1 --2- 172.21.15.22:0/1552085303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67b010e500 0x7f67b0110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.736+0000 7f67b6a53640 1 --2- 172.21.15.22:0/1552085303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67b0101440 0x7f67b010df30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.736+0000 7f67b6a53640 1 --2- 172.21.15.22:0/1552085303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b0100b20 0x7f67b0100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.736+0000 7f67b6a53640 1 -- 172.21.15.22:0/1552085303 >> 172.21.15.22:0/1552085303 conn(0x7f67b00fc7d0 msgr2=0x7f67b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.736+0000 7f67b6a53640 1 -- 172.21.15.22:0/1552085303 shutdown_connections 2024-09-10T08:06:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.736+0000 7f67b6a53640 1 -- 172.21.15.22:0/1552085303 wait complete. 2024-09-10T08:06:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.736+0000 7f67b6a53640 1 Processor -- start 2024-09-10T08:06:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.736+0000 7f67b6a53640 1 -- start start 2024-09-10T08:06:49.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67b6a53640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67b0100b20 0x7f67b01a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:49.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67b6a53640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67b0101440 0x7f67b01a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:49.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67b6a53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b010e500 0x7f67b019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:49.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67b6a53640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f67b0114350 con 0x7f67b0101440 2024-09-10T08:06:49.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67b6a53640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f67b01141d0 con 0x7f67b010e500 2024-09-10T08:06:49.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67b6a53640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f67b01144d0 con 0x7f67b0100b20 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67b0101440 0x7f67b01a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67b0101440 0x7f67b01a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34002/0 (socket says 172.21.15.22:34002) 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67af7fe640 1 -- 172.21.15.22:0/1914347570 learned_addr learned my addr 172.21.15.22:0/1914347570 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67affff640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67b0100b20 0x7f67b01a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67b4ff0640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b010e500 0x7f67b019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67af7fe640 1 -- 172.21.15.22:0/1914347570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67b0100b20 msgr2=0x7f67b01a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67af7fe640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67b0100b20 0x7f67b01a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67af7fe640 1 -- 172.21.15.22:0/1914347570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b010e500 msgr2=0x7f67b019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67af7fe640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b010e500 0x7f67b019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67af7fe640 1 -- 172.21.15.22:0/1914347570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b019b030 con 0x7f67b0101440 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.737+0000 7f67af7fe640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67b0101440 0x7f67b01a0be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f67a4006010 tx=0x7f67a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.738+0000 7f67ad7fa640 1 -- 172.21.15.22:0/1914347570 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a403f030 con 0x7f67b0101440 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.738+0000 7f67ad7fa640 1 -- 172.21.15.22:0/1914347570 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f67a4003ce0 con 0x7f67b0101440 2024-09-10T08:06:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.738+0000 7f67b6a53640 1 -- 172.21.15.22:0/1914347570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b019b2c0 con 0x7f67b0101440 2024-09-10T08:06:49.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.738+0000 7f67ad7fa640 1 -- 172.21.15.22:0/1914347570 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a4035070 con 0x7f67b0101440 2024-09-10T08:06:49.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.738+0000 7f67b6a53640 1 -- 172.21.15.22:0/1914347570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b01a74c0 con 0x7f67b0101440 2024-09-10T08:06:49.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.739+0000 7f67b6a53640 1 -- 172.21.15.22:0/1914347570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b006a850 con 0x7f67b0101440 2024-09-10T08:06:49.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.740+0000 7f67ad7fa640 1 -- 172.21.15.22:0/1914347570 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f67a4042030 con 0x7f67b0101440 2024-09-10T08:06:49.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.740+0000 7f67ad7fa640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f67980a2b80 0x7f67980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:49.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.741+0000 7f67affff640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f67980a2b80 0x7f67980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:49.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.741+0000 7f67ad7fa640 1 -- 172.21.15.22:0/1914347570 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f67a40ef0e0 con 0x7f67b0101440 2024-09-10T08:06:49.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.741+0000 7f67affff640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f67980a2b80 0x7f67980a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009990 tx=0x7f67a0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:49.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.745+0000 7f67ad7fa640 1 -- 172.21.15.22:0/1914347570 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f67a40bc4e0 con 0x7f67b0101440 2024-09-10T08:06:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:49.922+0000 7f67b6a53640 1 -- 172.21.15.22:0/1914347570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f67b019bd10 con 0x7f67b0101440 2024-09-10T08:06:50.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:50 smithi100 ceph-mon[35102]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:50.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:50 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:50.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:50 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:50.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:50 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:50.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:50 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:50.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:50 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:50.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:50 smithi153 ceph-mon[35609]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:50.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:50 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:50.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:50 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:50.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:50 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:50.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:50 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:50.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:50 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:50 smithi022 ceph-mon[30854]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:50 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:50 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:50 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:06:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:50 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:06:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:50 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:06:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.830+0000 7f67ad7fa640 1 -- 172.21.15.22:0/1914347570 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7f67a40bbde0 con 0x7f67b0101440 2024-09-10T08:06:50.830 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2024-09-10T08:06:50.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.833+0000 7f67b6a53640 1 -- 172.21.15.22:0/1914347570 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f67980a2b80 msgr2=0x7f67980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.833+0000 7f67b6a53640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f67980a2b80 0x7f67980a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009990 tx=0x7f67a0009110 comp rx=0 tx=0).stop 2024-09-10T08:06:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.833+0000 7f67b6a53640 1 -- 172.21.15.22:0/1914347570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67b0101440 msgr2=0x7f67b01a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.833+0000 7f67b6a53640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67b0101440 0x7f67b01a0be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f67a4006010 tx=0x7f67a40042f0 comp rx=0 tx=0).stop 2024-09-10T08:06:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.833+0000 7f67b6a53640 1 -- 172.21.15.22:0/1914347570 shutdown_connections 2024-09-10T08:06:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.833+0000 7f67b6a53640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f67980a2b80 0x7f67980a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.833+0000 7f67b6a53640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67b010e500 0x7f67b019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.833+0000 7f67b6a53640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67b0101440 0x7f67b01a0be0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.833+0000 7f67b6a53640 1 --2- 172.21.15.22:0/1914347570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67b0100b20 0x7f67b01a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.833+0000 7f67b6a53640 1 -- 172.21.15.22:0/1914347570 >> 172.21.15.22:0/1914347570 conn(0x7f67b00fc7d0 msgr2=0x7f67b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:50.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.833+0000 7f67b6a53640 1 -- 172.21.15.22:0/1914347570 shutdown_connections 2024-09-10T08:06:50.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:50.833+0000 7f67b6a53640 1 -- 172.21.15.22:0/1914347570 wait complete. 2024-09-10T08:06:51.473 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:51 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1914347570' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T08:06:51.473 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:51 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1914347570' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T08:06:51.473 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:51 smithi022 ceph-mon[30854]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T08:06:51.506 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:06:51.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:51 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1914347570' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T08:06:51.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:51 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1914347570' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T08:06:51.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:51 smithi100 ceph-mon[35102]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T08:06:51.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:51 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1914347570' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-10T08:06:51.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:51 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1914347570' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T08:06:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:51 smithi153 ceph-mon[35609]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T08:06:51.769 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:52.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.280+0000 7f338984f640 1 -- 172.21.15.22:0/955973648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33841082a0 msgr2=0x7f338410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:52.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.280+0000 7f338984f640 1 --2- 172.21.15.22:0/955973648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33841082a0 0x7f338410ec40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f337c009930 tx=0x7f337c02a440 comp rx=0 tx=0).stop 2024-09-10T08:06:52.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.280+0000 7f338984f640 1 -- 172.21.15.22:0/955973648 shutdown_connections 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.280+0000 7f338984f640 1 --2- 172.21.15.22:0/955973648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33841082a0 0x7f338410ec40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.280+0000 7f338984f640 1 --2- 172.21.15.22:0/955973648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33841036e0 0x7f3384107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.280+0000 7f338984f640 1 --2- 172.21.15.22:0/955973648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3384102d30 0x7f3384103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.280+0000 7f338984f640 1 -- 172.21.15.22:0/955973648 >> 172.21.15.22:0/955973648 conn(0x7f33840fc7d0 msgr2=0x7f33840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.280+0000 7f338984f640 1 -- 172.21.15.22:0/955973648 shutdown_connections 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.280+0000 7f338984f640 1 -- 172.21.15.22:0/955973648 wait complete. 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.280+0000 7f338984f640 1 Processor -- start 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.280+0000 7f338984f640 1 -- start start 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f338984f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3384102d30 0x7f3384198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f338984f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33841036e0 0x7f3384198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f338984f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33841082a0 0x7f338419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f338984f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33841120e0 con 0x7f33841082a0 2024-09-10T08:06:52.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f338984f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3384111f60 con 0x7f33841036e0 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f338984f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3384112260 con 0x7f3384102d30 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f33837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33841082a0 0x7f338419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f33837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33841082a0 0x7f338419cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34024/0 (socket says 172.21.15.22:34024) 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f33837fe640 1 -- 172.21.15.22:0/1564499341 learned_addr learned my addr 172.21.15.22:0/1564499341 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f3382ffd640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3384102d30 0x7f3384198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f33827fc640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33841036e0 0x7f3384198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f33837fe640 1 -- 172.21.15.22:0/1564499341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3384102d30 msgr2=0x7f3384198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f33837fe640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3384102d30 0x7f3384198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f33837fe640 1 -- 172.21.15.22:0/1564499341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33841036e0 msgr2=0x7f3384198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f33837fe640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33841036e0 0x7f3384198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f33837fe640 1 -- 172.21.15.22:0/1564499341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338419d610 con 0x7f33841082a0 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f33837fe640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33841082a0 0x7f338419cf30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f337c005ab0 tx=0x7f337c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:52.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f338884d640 1 -- 172.21.15.22:0/1564499341 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c03f030 con 0x7f33841082a0 2024-09-10T08:06:52.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.281+0000 7f338984f640 1 -- 172.21.15.22:0/1564499341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338419d8a0 con 0x7f33841082a0 2024-09-10T08:06:52.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.282+0000 7f338884d640 1 -- 172.21.15.22:0/1564499341 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f337c003ce0 con 0x7f33841082a0 2024-09-10T08:06:52.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.282+0000 7f338884d640 1 -- 172.21.15.22:0/1564499341 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c035070 con 0x7f33841082a0 2024-09-10T08:06:52.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.282+0000 7f338984f640 1 -- 172.21.15.22:0/1564499341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33841a51e0 con 0x7f33841082a0 2024-09-10T08:06:52.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.283+0000 7f338984f640 1 -- 172.21.15.22:0/1564499341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3384103110 con 0x7f33841082a0 2024-09-10T08:06:52.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.284+0000 7f338884d640 1 -- 172.21.15.22:0/1564499341 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f337c042030 con 0x7f33841082a0 2024-09-10T08:06:52.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.284+0000 7f338884d640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f336c0a2b80 0x7f336c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:52.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.285+0000 7f3382ffd640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f336c0a2b80 0x7f336c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:52.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.285+0000 7f338884d640 1 -- 172.21.15.22:0/1564499341 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7f337c0ef650 con 0x7f33841082a0 2024-09-10T08:06:52.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.285+0000 7f3382ffd640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f336c0a2b80 0x7f336c0a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3374005fd0 tx=0x7f3374009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:52.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.288+0000 7f338884d640 1 -- 172.21.15.22:0/1564499341 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f337c0bc840 con 0x7f33841082a0 2024-09-10T08:06:52.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.463+0000 7f338984f640 1 -- 172.21.15.22:0/1564499341 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f338410a2b0 con 0x7f33841082a0 2024-09-10T08:06:52.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:52 smithi022 ceph-mon[30854]: pgmap v272: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:52.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:52 smithi022 ceph-mon[30854]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T08:06:52.463 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:52 smithi022 ceph-mon[30854]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T08:06:52.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:52 smithi100 ceph-mon[35102]: pgmap v272: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:52.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:52 smithi100 ceph-mon[35102]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T08:06:52.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:52 smithi100 ceph-mon[35102]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T08:06:52.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:52 smithi153 ceph-mon[35609]: pgmap v272: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:52.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:52 smithi153 ceph-mon[35609]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T08:06:52.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:52 smithi153 ceph-mon[35609]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T08:06:52.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.897+0000 7f338884d640 1 -- 172.21.15.22:0/1564499341 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7f337c0bc140 con 0x7f33841082a0 2024-09-10T08:06:52.897 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2024-09-10T08:06:52.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.900+0000 7f338984f640 1 -- 172.21.15.22:0/1564499341 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f336c0a2b80 msgr2=0x7f336c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:52.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.900+0000 7f338984f640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f336c0a2b80 0x7f336c0a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3374005fd0 tx=0x7f3374009680 comp rx=0 tx=0).stop 2024-09-10T08:06:52.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.900+0000 7f338984f640 1 -- 172.21.15.22:0/1564499341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33841082a0 msgr2=0x7f338419cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:52.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.900+0000 7f338984f640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33841082a0 0x7f338419cf30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f337c005ab0 tx=0x7f337c0042f0 comp rx=0 tx=0).stop 2024-09-10T08:06:52.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.900+0000 7f338984f640 1 -- 172.21.15.22:0/1564499341 shutdown_connections 2024-09-10T08:06:52.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.900+0000 7f338984f640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f336c0a2b80 0x7f336c0a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:52.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.900+0000 7f338984f640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33841082a0 0x7f338419cf30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:52.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.900+0000 7f338984f640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33841036e0 0x7f3384198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:52.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.900+0000 7f338984f640 1 --2- 172.21.15.22:0/1564499341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3384102d30 0x7f3384198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:52.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.900+0000 7f338984f640 1 -- 172.21.15.22:0/1564499341 >> 172.21.15.22:0/1564499341 conn(0x7f33840fc7d0 msgr2=0x7f3384106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:52.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.900+0000 7f338984f640 1 -- 172.21.15.22:0/1564499341 shutdown_connections 2024-09-10T08:06:52.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:52.900+0000 7f338984f640 1 -- 172.21.15.22:0/1564499341 wait complete. 2024-09-10T08:06:53.596 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:53 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1564499341' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T08:06:53.596 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:53 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1564499341' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T08:06:53.596 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:53 smithi022 ceph-mon[30854]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T08:06:53.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:53 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1564499341' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T08:06:53.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:53 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1564499341' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T08:06:53.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:53 smithi100 ceph-mon[35102]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T08:06:53.626 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:06:53.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:53 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1564499341' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-10T08:06:53.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:53 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1564499341' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T08:06:53.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:53 smithi153 ceph-mon[35609]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T08:06:53.884 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:54.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.386+0000 7f6162ab0640 1 -- 172.21.15.22:0/856595021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615c102570 msgr2=0x7f615c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:54.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.386+0000 7f6162ab0640 1 --2- 172.21.15.22:0/856595021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615c102570 0x7f615c1029b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6150009900 tx=0x7f615002a480 comp rx=0 tx=0).stop 2024-09-10T08:06:54.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.387+0000 7f6162ab0640 1 -- 172.21.15.22:0/856595021 shutdown_connections 2024-09-10T08:06:54.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.387+0000 7f6162ab0640 1 --2- 172.21.15.22:0/856595021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f615c102ef0 0x7f615c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:54.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.387+0000 7f6162ab0640 1 --2- 172.21.15.22:0/856595021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615c102570 0x7f615c1029b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:54.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.387+0000 7f6162ab0640 1 --2- 172.21.15.22:0/856595021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f615c100e20 0x7f615c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:54.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.387+0000 7f6162ab0640 1 -- 172.21.15.22:0/856595021 >> 172.21.15.22:0/856595021 conn(0x7f615c0fc7d0 msgr2=0x7f615c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:54.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.387+0000 7f6162ab0640 1 -- 172.21.15.22:0/856595021 shutdown_connections 2024-09-10T08:06:54.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.387+0000 7f6162ab0640 1 -- 172.21.15.22:0/856595021 wait complete. 2024-09-10T08:06:54.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.387+0000 7f6162ab0640 1 Processor -- start 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.387+0000 7f6162ab0640 1 -- start start 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f6162ab0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f615c100e20 0x7f615c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f6162ab0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615c102570 0x7f615c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f6162ab0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f615c102ef0 0x7f615c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f6162ab0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f615c1120a0 con 0x7f615c102570 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f6162ab0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f615c111f20 con 0x7f615c100e20 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f6162ab0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f615c112220 con 0x7f615c102ef0 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f615bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615c102570 0x7f615c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f615bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615c102570 0x7f615c198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43908/0 (socket says 172.21.15.22:43908) 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f615bfff640 1 -- 172.21.15.22:0/3219693081 learned_addr learned my addr 172.21.15.22:0/3219693081 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f616104d640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f615c102ef0 0x7f615c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f616084c640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f615c100e20 0x7f615c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:54.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f615bfff640 1 -- 172.21.15.22:0/3219693081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f615c102ef0 msgr2=0x7f615c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f615bfff640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f615c102ef0 0x7f615c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f615bfff640 1 -- 172.21.15.22:0/3219693081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f615c100e20 msgr2=0x7f615c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f615bfff640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f615c100e20 0x7f615c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f615bfff640 1 -- 172.21.15.22:0/3219693081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615c19d4a0 con 0x7f615c102570 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f616104d640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f615c102ef0 0x7f615c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.388+0000 7f615bfff640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615c102570 0x7f615c198a30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6150006010 tx=0x7f6150003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.389+0000 7f6159ffb640 1 -- 172.21.15.22:0/3219693081 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f615003f070 con 0x7f615c102570 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.389+0000 7f6159ffb640 1 -- 172.21.15.22:0/3219693081 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6150031c30 con 0x7f615c102570 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.389+0000 7f6162ab0640 1 -- 172.21.15.22:0/3219693081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615c19d730 con 0x7f615c102570 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.389+0000 7f6159ffb640 1 -- 172.21.15.22:0/3219693081 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6150035030 con 0x7f615c102570 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.389+0000 7f6162ab0640 1 -- 172.21.15.22:0/3219693081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f615c1a5070 con 0x7f615c102570 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.390+0000 7f6162ab0640 1 -- 172.21.15.22:0/3219693081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f615c101200 con 0x7f615c102570 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.391+0000 7f6159ffb640 1 -- 172.21.15.22:0/3219693081 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f6150042070 con 0x7f615c102570 2024-09-10T08:06:54.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.392+0000 7f6159ffb640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f61440a2b80 0x7f61440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:54.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.392+0000 7f616084c640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f61440a2b80 0x7f61440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:54.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.392+0000 7f6159ffb640 1 -- 172.21.15.22:0/3219693081 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f61500efca0 con 0x7f615c102570 2024-09-10T08:06:54.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.392+0000 7f616084c640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f61440a2b80 0x7f61440a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f614c005fd0 tx=0x7f614c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:54.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.395+0000 7f6159ffb640 1 -- 172.21.15.22:0/3219693081 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6150031de0 con 0x7f615c102570 2024-09-10T08:06:54.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:54.608+0000 7f6162ab0640 1 -- 172.21.15.22:0/3219693081 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f615c109090 con 0x7f615c102570 2024-09-10T08:06:54.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:54 smithi022 ceph-mon[30854]: pgmap v275: 97 pgs: 3 creating+peering, 84 unknown, 10 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:54.607 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:54 smithi022 ceph-mon[30854]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T08:06:54.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:54 smithi100 ceph-mon[35102]: pgmap v275: 97 pgs: 3 creating+peering, 84 unknown, 10 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:54.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:54 smithi100 ceph-mon[35102]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T08:06:54.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:54 smithi153 ceph-mon[35609]: pgmap v275: 97 pgs: 3 creating+peering, 84 unknown, 10 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:54.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:54 smithi153 ceph-mon[35609]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T08:06:55.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.371+0000 7f6159ffb640 1 -- 172.21.15.22:0/3219693081 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f61500bcdd0 con 0x7f615c102570 2024-09-10T08:06:55.371 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T08:06:55.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.374+0000 7f6162ab0640 1 -- 172.21.15.22:0/3219693081 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f61440a2b80 msgr2=0x7f61440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:55.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.374+0000 7f6162ab0640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f61440a2b80 0x7f61440a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f614c005fd0 tx=0x7f614c005850 comp rx=0 tx=0).stop 2024-09-10T08:06:55.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.374+0000 7f6162ab0640 1 -- 172.21.15.22:0/3219693081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615c102570 msgr2=0x7f615c198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:55.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.374+0000 7f6162ab0640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615c102570 0x7f615c198a30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6150006010 tx=0x7f6150003c10 comp rx=0 tx=0).stop 2024-09-10T08:06:55.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.374+0000 7f6162ab0640 1 -- 172.21.15.22:0/3219693081 shutdown_connections 2024-09-10T08:06:55.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.374+0000 7f6162ab0640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f61440a2b80 0x7f61440a5040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:55.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.374+0000 7f6162ab0640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f615c102ef0 0x7f615c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:55.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.374+0000 7f6162ab0640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f615c102570 0x7f615c198a30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:55.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.374+0000 7f6162ab0640 1 --2- 172.21.15.22:0/3219693081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f615c100e20 0x7f615c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:55.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.374+0000 7f6162ab0640 1 -- 172.21.15.22:0/3219693081 >> 172.21.15.22:0/3219693081 conn(0x7f615c0fc7d0 msgr2=0x7f615c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:55.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.375+0000 7f6162ab0640 1 -- 172.21.15.22:0/3219693081 shutdown_connections 2024-09-10T08:06:55.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:55.375+0000 7f6162ab0640 1 -- 172.21.15.22:0/3219693081 wait complete. 2024-09-10T08:06:55.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:55 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3219693081' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T08:06:55.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:55 smithi153 ceph-mon[35609]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T08:06:55.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:55 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3219693081' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T08:06:55.696 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:55 smithi022 ceph-mon[30854]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T08:06:55.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:55 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3219693081' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-10T08:06:55.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:55 smithi100 ceph-mon[35102]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T08:06:56.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T08:06:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:56.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:56 smithi153 ceph-mon[35609]: pgmap v277: 97 pgs: 24 creating+peering, 36 unknown, 37 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:56.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:56 smithi153 ceph-mon[35609]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T08:06:56.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:56 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3219693081' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T08:06:56.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:56 smithi153 ceph-mon[35609]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T08:06:56.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:56 smithi153 ceph-mon[35609]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T08:06:56.700 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:56 smithi022 ceph-mon[30854]: pgmap v277: 97 pgs: 24 creating+peering, 36 unknown, 37 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:56.700 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:56 smithi022 ceph-mon[30854]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T08:06:56.700 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:56 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3219693081' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T08:06:56.700 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:56 smithi022 ceph-mon[30854]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T08:06:56.700 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:56 smithi022 ceph-mon[30854]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T08:06:56.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.783+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/2704835427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c88106f10 msgr2=0x7f8c8810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:56.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.783+0000 7f8c8e2d6640 1 --2- 172.21.15.22:0/2704835427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c88106f10 0x7f8c8810ea90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009ca0 tx=0x7f8c8002a8c0 comp rx=0 tx=0).stop 2024-09-10T08:06:56.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.783+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/2704835427 shutdown_connections 2024-09-10T08:06:56.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.783+0000 7f8c8e2d6640 1 --2- 172.21.15.22:0/2704835427 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c88106f10 0x7f8c8810ea90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:56.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.783+0000 7f8c8e2d6640 1 --2- 172.21.15.22:0/2704835427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c88102790 0x7f8c881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:56.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.783+0000 7f8c8e2d6640 1 --2- 172.21.15.22:0/2704835427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c88101de0 0x7f8c881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.783+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/2704835427 >> 172.21.15.22:0/2704835427 conn(0x7f8c880fd8c0 msgr2=0x7f8c880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.783+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/2704835427 shutdown_connections 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.783+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/2704835427 wait complete. 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.784+0000 7f8c8e2d6640 1 Processor -- start 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.784+0000 7f8c8e2d6640 1 -- start start 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.784+0000 7f8c8e2d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c88101de0 0x7f8c881985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.784+0000 7f8c8e2d6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c88102790 0x7f8c88198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.784+0000 7f8c8e2d6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c88106f10 0x7f8c8819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.784+0000 7f8c8e2d6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8c88112010 con 0x7f8c88106f10 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.784+0000 7f8c8e2d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8c88111e90 con 0x7f8c88101de0 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.784+0000 7f8c8e2d6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c88112190 con 0x7f8c88102790 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.784+0000 7f8c8c873640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c88106f10 0x7f8c8819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.784+0000 7f8c8c873640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c88106f10 0x7f8c8819cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43928/0 (socket says 172.21.15.22:43928) 2024-09-10T08:06:56.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.784+0000 7f8c8c873640 1 -- 172.21.15.22:0/1071709014 learned_addr learned my addr 172.21.15.22:0/1071709014 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c877fe640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c88102790 0x7f8c88198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c87fff640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c88101de0 0x7f8c881985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c8c873640 1 -- 172.21.15.22:0/1071709014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c88102790 msgr2=0x7f8c88198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c8c873640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c88102790 0x7f8c88198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c8c873640 1 -- 172.21.15.22:0/1071709014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c88101de0 msgr2=0x7f8c881985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c8c873640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c88101de0 0x7f8c881985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c8c873640 1 -- 172.21.15.22:0/1071709014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8819d5a0 con 0x7f8c88106f10 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c8c873640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c88106f10 0x7f8c8819cec0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8c80031a60 tx=0x7f8c80031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c857fa640 1 -- 172.21.15.22:0/1071709014 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c80003c30 con 0x7f8c88106f10 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/1071709014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8819d830 con 0x7f8c88106f10 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c857fa640 1 -- 172.21.15.22:0/1071709014 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c80003dd0 con 0x7f8c88106f10 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c857fa640 1 -- 172.21.15.22:0/1071709014 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c800047e0 con 0x7f8c88106f10 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.785+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/1071709014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c881a5170 con 0x7f8c88106f10 2024-09-10T08:06:56.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.786+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/1071709014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c88102240 con 0x7f8c88106f10 2024-09-10T08:06:56.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.787+0000 7f8c857fa640 1 -- 172.21.15.22:0/1071709014 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f8c8002f790 con 0x7f8c88106f10 2024-09-10T08:06:56.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.788+0000 7f8c857fa640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8c700a2b80 0x7f8c700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:56.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.788+0000 7f8c87fff640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8c700a2b80 0x7f8c700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:56.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.788+0000 7f8c857fa640 1 -- 172.21.15.22:0/1071709014 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f8c800f0470 con 0x7f8c88106f10 2024-09-10T08:06:56.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.788+0000 7f8c87fff640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8c700a2b80 0x7f8c700a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009890 tx=0x7f8c78008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:56.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.792+0000 7f8c857fa640 1 -- 172.21.15.22:0/1071709014 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c800bd480 con 0x7f8c88106f10 2024-09-10T08:06:56.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:56 smithi100 ceph-mon[35102]: pgmap v277: 97 pgs: 24 creating+peering, 36 unknown, 37 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:06:56.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:56 smithi100 ceph-mon[35102]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T08:06:56.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:56 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3219693081' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T08:06:56.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:56 smithi100 ceph-mon[35102]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T08:06:56.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:56 smithi100 ceph-mon[35102]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T08:06:56.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.969+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/1071709014 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c8810a150 con 0x7f8c88106f10 2024-09-10T08:06:56.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.971+0000 7f8c857fa640 1 -- 172.21.15.22:0/1071709014 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22312 (secure 0 0 0) 0x7f8c800bcd80 con 0x7f8c88106f10 2024-09-10T08:06:56.970 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:56.970 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":81,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","created":"2024-09-10T07:59:04.704048+0000","modified":"2024-09-10T08:06:54.609619+0000","last_up_change":"2024-09-10T08:06:02.535944+0000","last_in_change":"2024-09-10T08:05:39.070554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:02:15.371265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:06:50.358155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:06:52.896201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d296bd3-28a7-418c-ad73-343a5e806cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6803","nonce":4248555152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6805","nonce":4248555152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6809","nonce":4248555152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6807","nonce":4248555152}]},"public_addr":"172.21.15.22:6803/4248555152","cluster_addr":"172.21.15.22:6805/4248555152","heartbeat_back_addr":"172.21.15.22:6809/4248555152","heartbeat_front_addr":"172.21.15.22:6807/4248555152","state":["exists","up"]},{"osd":1,"uuid":"c1e2b40e-b4ab-475a-8a9e-c67409f46b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6801","nonce":2078646052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6803","nonce":2078646052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6807","nonce":2078646052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6805","nonce":2078646052}]},"public_addr":"172.21.15.100:6801/2078646052","cluster_addr":"172.21.15.100:6803/2078646052","heartbeat_back_addr":"172.21.15.100:6807/2078646052","heartbeat_front_addr":"172.21.15.100:6805/2078646052","state":["exists","up"]},{"osd":2,"uuid":"be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6801","nonce":2492419476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6803","nonce":2492419476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6807","nonce":2492419476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6805","nonce":2492419476}]},"public_addr":"172.21.15.153:6801/2492419476","cluster_addr":"172.21.15.153:6803/2492419476","heartbeat_back_addr":"172.21.15.153:6807/2492419476","heartbeat_front_addr":"172.21.15.153:6805/2492419476","state":["exists","up"]},{"osd":3,"uuid":"e980a3ba-c659-4473-9633-9cbe88296d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6811","nonce":3674495276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6813","nonce":3674495276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6817","nonce":3674495276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6815","nonce":3674495276}]},"public_addr":"172.21.15.22:6811/3674495276","cluster_addr":"172.21.15.22:6813/3674495276","heartbeat_back_addr":"172.21.15.22:6817/3674495276","heartbeat_front_addr":"172.21.15.22:6815/3674495276","state":["exists","up"]},{"osd":4,"uuid":"b37d0590-99b1-4566-96b4-9936890d4308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6809","nonce":3886932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6811","nonce":3886932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6815","nonce":3886932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6813","nonce":3886932513}]},"public_addr":"172.21.15.100:6809/3886932513","cluster_addr":"172.21.15.100:6811/3886932513","heartbeat_back_addr":"172.21.15.100:6815/3886932513","heartbeat_front_addr":"172.21.15.100:6813/3886932513","state":["exists","up"]},{"osd":5,"uuid":"6cb989a0-80a1-4a9a-8b45-51b47772b203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6809","nonce":120732073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6811","nonce":120732073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6815","nonce":120732073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6813","nonce":120732073}]},"public_addr":"172.21.15.153:6809/120732073","cluster_addr":"172.21.15.153:6811/120732073","heartbeat_back_addr":"172.21.15.153:6815/120732073","heartbeat_front_addr":"172.21.15.153:6813/120732073","state":["exists","up"]},{"osd":6,"uuid":"294887f3-3e58-4b02-884d-4e0a70a86d16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6819","nonce":3692536487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6821","nonce":3692536487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6825","nonce":3692536487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6823","nonce":3692536487}]},"public_addr":"172.21.15.22:6819/3692536487","cluster_addr":"172.21.15.22:6821/3692536487","heartbeat_back_addr":"172.21.15.22:6825/3692536487","heartbeat_front_addr":"172.21.15.22:6823/3692536487","state":["exists","up"]},{"osd":7,"uuid":"d0c0ec61-4055-46f3-a4b0-39f04c735452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6817","nonce":1221175921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6819","nonce":1221175921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6823","nonce":1221175921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6821","nonce":1221175921}]},"public_addr":"172.21.15.100:6817/1221175921","cluster_addr":"172.21.15.100:6819/1221175921","heartbeat_back_addr":"172.21.15.100:6823/1221175921","heartbeat_front_addr":"172.21.15.100:6821/1221175921","state":["exists","up"]},{"osd":8,"uuid":"bda45a16-742e-4eda-b4d4-e01d6f3dc92e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6817","nonce":1153053941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6819","nonce":1153053941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6823","nonce":1153053941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6821","nonce":1153053941}]},"public_addr":"172.21.15.153:6817/1153053941","cluster_addr":"172.21.15.153:6819/1153053941","heartbeat_back_addr":"172.21.15.153:6823/1153053941","heartbeat_front_addr":"172.21.15.153:6821/1153053941","state":["exists","up"]},{"osd":9,"uuid":"48bd3544-9028-4535-801b-3d39ecadf48e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6827","nonce":3423218876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6829","nonce":3423218876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6833","nonce":3423218876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6831","nonce":3423218876}]},"public_addr":"172.21.15.22:6827/3423218876","cluster_addr":"172.21.15.22:6829/3423218876","heartbeat_back_addr":"172.21.15.22:6833/3423218876","heartbeat_front_addr":"172.21.15.22:6831/3423218876","state":["exists","up"]},{"osd":10,"uuid":"c8716aa0-eb93-435d-a9d0-dd4c3dce1954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6825","nonce":2024112643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6827","nonce":2024112643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6831","nonce":2024112643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6829","nonce":2024112643}]},"public_addr":"172.21.15.100:6825/2024112643","cluster_addr":"172.21.15.100:6827/2024112643","heartbeat_back_addr":"172.21.15.100:6831/2024112643","heartbeat_front_addr":"172.21.15.100:6829/2024112643","state":["exists","up"]},{"osd":11,"uuid":"3c427cfe-8d7c-431e-9eb4-b03cfac3068d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6825","nonce":2245781783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6827","nonce":2245781783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6831","nonce":2245781783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6829","nonce":2245781783}]},"public_addr":"172.21.15.153:6825/2245781783","cluster_addr":"172.21.15.153:6827/2245781783","heartbeat_back_addr":"172.21.15.153:6831/2245781783","heartbeat_front_addr":"172.21.15.153:6829/2245781783","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:23.001057+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:46.353182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:11.469840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:37.557521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:02.630783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:27.374057+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:53.758498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:19.507846+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:45.080789+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:10.286820+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:35.565950+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:06:00.633384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3072001022":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/1519904928":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6801/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/2108462626":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/3337107310":"2024-09-11T07:59:36.505631+0000","172.21.15.22:6801/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/1708436544":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/278091300":"2024-09-11T07:59:36.505631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:06:56.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.973+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/1071709014 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8c700a2b80 msgr2=0x7f8c700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:56.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.973+0000 7f8c8e2d6640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8c700a2b80 0x7f8c700a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009890 tx=0x7f8c78008040 comp rx=0 tx=0).stop 2024-09-10T08:06:56.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.973+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/1071709014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c88106f10 msgr2=0x7f8c8819cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:56.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.973+0000 7f8c8e2d6640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c88106f10 0x7f8c8819cec0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8c80031a60 tx=0x7f8c80031a90 comp rx=0 tx=0).stop 2024-09-10T08:06:56.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.973+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/1071709014 shutdown_connections 2024-09-10T08:06:56.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.973+0000 7f8c8e2d6640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8c700a2b80 0x7f8c700a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:56.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.973+0000 7f8c8e2d6640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8c88106f10 0x7f8c8819cec0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:56.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.973+0000 7f8c8e2d6640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c88102790 0x7f8c88198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:56.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.973+0000 7f8c8e2d6640 1 --2- 172.21.15.22:0/1071709014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c88101de0 0x7f8c881985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:56.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.973+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/1071709014 >> 172.21.15.22:0/1071709014 conn(0x7f8c880fd8c0 msgr2=0x7f8c880fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:56.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.973+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/1071709014 shutdown_connections 2024-09-10T08:06:56.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:56.973+0000 7f8c8e2d6640 1 -- 172.21.15.22:0/1071709014 wait complete. 2024-09-10T08:06:57.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:57 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] up:active 2024-09-10T08:06:57.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:57 smithi022 ceph-mon[30854]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T08:06:57.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:57 smithi022 ceph-mon[30854]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T08:06:57.597 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:57 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1071709014' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:06:57.628 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T08:06:57.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:57 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] up:active 2024-09-10T08:06:57.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:57 smithi153 ceph-mon[35609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T08:06:57.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:57 smithi153 ceph-mon[35609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T08:06:57.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:57 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1071709014' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:06:57.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:57 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] up:active 2024-09-10T08:06:57.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:57 smithi100 ceph-mon[35102]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T08:06:57.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:57 smithi100 ceph-mon[35102]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T08:06:57.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:57 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1071709014' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:06:57.885 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:58.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.345+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1928254658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3b810c2f0 msgr2=0x7fd3b810e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:58.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.345+0000 7fd3be1d1640 1 --2- 172.21.15.22:0/1928254658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3b810c2f0 0x7fd3b810e790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009ca0 tx=0x7fd3b002a8c0 comp rx=0 tx=0).stop 2024-09-10T08:06:58.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.345+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1928254658 shutdown_connections 2024-09-10T08:06:58.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.345+0000 7fd3be1d1640 1 --2- 172.21.15.22:0/1928254658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3b810c2f0 0x7fd3b810e790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:58.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.345+0000 7fd3be1d1640 1 --2- 172.21.15.22:0/1928254658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b81037a0 0x7fd3b810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:58.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.345+0000 7fd3be1d1640 1 --2- 172.21.15.22:0/1928254658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3b8102df0 0x7fd3b81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:58.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.345+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1928254658 >> 172.21.15.22:0/1928254658 conn(0x7fd3b80fc7d0 msgr2=0x7fd3b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:58.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.345+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1928254658 shutdown_connections 2024-09-10T08:06:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.345+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1928254658 wait complete. 2024-09-10T08:06:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3be1d1640 1 Processor -- start 2024-09-10T08:06:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3be1d1640 1 -- start start 2024-09-10T08:06:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3be1d1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3b8102df0 0x7fd3b8100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3be1d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b81037a0 0x7fd3b8100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3be1d1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3b810c2f0 0x7fd3b81014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3be1d1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b8112160 con 0x7fd3b810c2f0 2024-09-10T08:06:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3be1d1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b8111fe0 con 0x7fd3b81037a0 2024-09-10T08:06:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3be1d1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd3b81122e0 con 0x7fd3b8102df0 2024-09-10T08:06:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3b7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3b810c2f0 0x7fd3b81014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3b7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3b810c2f0 0x7fd3b81014d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43946/0 (socket says 172.21.15.22:43946) 2024-09-10T08:06:58.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3b7fff640 1 -- 172.21.15.22:0/1285336983 learned_addr learned my addr 172.21.15.22:0/1285336983 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3b77fe640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3b8102df0 0x7fd3b8100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3aeffd640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b81037a0 0x7fd3b8100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3b7fff640 1 -- 172.21.15.22:0/1285336983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3b8102df0 msgr2=0x7fd3b8100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3b7fff640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3b8102df0 0x7fd3b8100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3b7fff640 1 -- 172.21.15.22:0/1285336983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b81037a0 msgr2=0x7fd3b8100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.346+0000 7fd3b7fff640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b81037a0 0x7fd3b8100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.347+0000 7fd3b7fff640 1 -- 172.21.15.22:0/1285336983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3b81a6a50 con 0x7fd3b810c2f0 2024-09-10T08:06:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.347+0000 7fd3b7fff640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3b810c2f0 0x7fd3b81014d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0003f10 tx=0x7fd3b0003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.347+0000 7fd3b57fa640 1 -- 172.21.15.22:0/1285336983 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0031710 con 0x7fd3b810c2f0 2024-09-10T08:06:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.347+0000 7fd3b57fa640 1 -- 172.21.15.22:0/1285336983 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3b00318b0 con 0x7fd3b810c2f0 2024-09-10T08:06:58.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.347+0000 7fd3b57fa640 1 -- 172.21.15.22:0/1285336983 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b002fb50 con 0x7fd3b810c2f0 2024-09-10T08:06:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.347+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1285336983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3b81a6ce0 con 0x7fd3b810c2f0 2024-09-10T08:06:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.347+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1285336983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3b81a71d0 con 0x7fd3b810c2f0 2024-09-10T08:06:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.348+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1285336983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3b81031d0 con 0x7fd3b810c2f0 2024-09-10T08:06:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.350+0000 7fd3b57fa640 1 -- 172.21.15.22:0/1285336983 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fd3b002fcf0 con 0x7fd3b810c2f0 2024-09-10T08:06:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.351+0000 7fd3b57fa640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fd3a40a2b80 0x7fd3a40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.351+0000 7fd3b77fe640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fd3a40a2b80 0x7fd3a40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.351+0000 7fd3b57fa640 1 -- 172.21.15.22:0/1285336983 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fd3b00f0680 con 0x7fd3b810c2f0 2024-09-10T08:06:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.352+0000 7fd3b77fe640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fd3a40a2b80 0x7fd3a40a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8005fd0 tx=0x7fd3a800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:58.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.353+0000 7fd3b57fa640 1 -- 172.21.15.22:0/1285336983 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd3b00bd720 con 0x7fd3b810c2f0 2024-09-10T08:06:58.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:58 smithi022 ceph-mon[30854]: pgmap v279: 97 pgs: 21 creating+peering, 6 unknown, 70 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1 op/s 2024-09-10T08:06:58.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:58 smithi022 ceph-mon[30854]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T08:06:58.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:58 smithi022 ceph-mon[30854]: Cluster is now healthy 2024-09-10T08:06:58.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.537+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1285336983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3b81a7400 con 0x7fd3b810c2f0 2024-09-10T08:06:58.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.538+0000 7fd3b57fa640 1 -- 172.21.15.22:0/1285336983 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22312 (secure 0 0 0) 0x7fd3b00bd020 con 0x7fd3b810c2f0 2024-09-10T08:06:58.538 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:06:58.538 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":81,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","created":"2024-09-10T07:59:04.704048+0000","modified":"2024-09-10T08:06:54.609619+0000","last_up_change":"2024-09-10T08:06:02.535944+0000","last_in_change":"2024-09-10T08:05:39.070554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:02:15.371265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:06:50.358155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:06:52.896201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d296bd3-28a7-418c-ad73-343a5e806cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6803","nonce":4248555152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6805","nonce":4248555152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6809","nonce":4248555152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6807","nonce":4248555152}]},"public_addr":"172.21.15.22:6803/4248555152","cluster_addr":"172.21.15.22:6805/4248555152","heartbeat_back_addr":"172.21.15.22:6809/4248555152","heartbeat_front_addr":"172.21.15.22:6807/4248555152","state":["exists","up"]},{"osd":1,"uuid":"c1e2b40e-b4ab-475a-8a9e-c67409f46b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6801","nonce":2078646052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6803","nonce":2078646052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6807","nonce":2078646052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6805","nonce":2078646052}]},"public_addr":"172.21.15.100:6801/2078646052","cluster_addr":"172.21.15.100:6803/2078646052","heartbeat_back_addr":"172.21.15.100:6807/2078646052","heartbeat_front_addr":"172.21.15.100:6805/2078646052","state":["exists","up"]},{"osd":2,"uuid":"be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6801","nonce":2492419476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6803","nonce":2492419476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6807","nonce":2492419476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6805","nonce":2492419476}]},"public_addr":"172.21.15.153:6801/2492419476","cluster_addr":"172.21.15.153:6803/2492419476","heartbeat_back_addr":"172.21.15.153:6807/2492419476","heartbeat_front_addr":"172.21.15.153:6805/2492419476","state":["exists","up"]},{"osd":3,"uuid":"e980a3ba-c659-4473-9633-9cbe88296d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6811","nonce":3674495276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6813","nonce":3674495276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6817","nonce":3674495276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6815","nonce":3674495276}]},"public_addr":"172.21.15.22:6811/3674495276","cluster_addr":"172.21.15.22:6813/3674495276","heartbeat_back_addr":"172.21.15.22:6817/3674495276","heartbeat_front_addr":"172.21.15.22:6815/3674495276","state":["exists","up"]},{"osd":4,"uuid":"b37d0590-99b1-4566-96b4-9936890d4308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6809","nonce":3886932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6811","nonce":3886932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6815","nonce":3886932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6813","nonce":3886932513}]},"public_addr":"172.21.15.100:6809/3886932513","cluster_addr":"172.21.15.100:6811/3886932513","heartbeat_back_addr":"172.21.15.100:6815/3886932513","heartbeat_front_addr":"172.21.15.100:6813/3886932513","state":["exists","up"]},{"osd":5,"uuid":"6cb989a0-80a1-4a9a-8b45-51b47772b203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6809","nonce":120732073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6811","nonce":120732073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6815","nonce":120732073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6813","nonce":120732073}]},"public_addr":"172.21.15.153:6809/120732073","cluster_addr":"172.21.15.153:6811/120732073","heartbeat_back_addr":"172.21.15.153:6815/120732073","heartbeat_front_addr":"172.21.15.153:6813/120732073","state":["exists","up"]},{"osd":6,"uuid":"294887f3-3e58-4b02-884d-4e0a70a86d16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6819","nonce":3692536487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6821","nonce":3692536487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6825","nonce":3692536487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6823","nonce":3692536487}]},"public_addr":"172.21.15.22:6819/3692536487","cluster_addr":"172.21.15.22:6821/3692536487","heartbeat_back_addr":"172.21.15.22:6825/3692536487","heartbeat_front_addr":"172.21.15.22:6823/3692536487","state":["exists","up"]},{"osd":7,"uuid":"d0c0ec61-4055-46f3-a4b0-39f04c735452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6817","nonce":1221175921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6819","nonce":1221175921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6823","nonce":1221175921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6821","nonce":1221175921}]},"public_addr":"172.21.15.100:6817/1221175921","cluster_addr":"172.21.15.100:6819/1221175921","heartbeat_back_addr":"172.21.15.100:6823/1221175921","heartbeat_front_addr":"172.21.15.100:6821/1221175921","state":["exists","up"]},{"osd":8,"uuid":"bda45a16-742e-4eda-b4d4-e01d6f3dc92e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6817","nonce":1153053941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6819","nonce":1153053941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6823","nonce":1153053941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6821","nonce":1153053941}]},"public_addr":"172.21.15.153:6817/1153053941","cluster_addr":"172.21.15.153:6819/1153053941","heartbeat_back_addr":"172.21.15.153:6823/1153053941","heartbeat_front_addr":"172.21.15.153:6821/1153053941","state":["exists","up"]},{"osd":9,"uuid":"48bd3544-9028-4535-801b-3d39ecadf48e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6827","nonce":3423218876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6829","nonce":3423218876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6833","nonce":3423218876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6831","nonce":3423218876}]},"public_addr":"172.21.15.22:6827/3423218876","cluster_addr":"172.21.15.22:6829/3423218876","heartbeat_back_addr":"172.21.15.22:6833/3423218876","heartbeat_front_addr":"172.21.15.22:6831/3423218876","state":["exists","up"]},{"osd":10,"uuid":"c8716aa0-eb93-435d-a9d0-dd4c3dce1954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6825","nonce":2024112643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6827","nonce":2024112643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6831","nonce":2024112643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6829","nonce":2024112643}]},"public_addr":"172.21.15.100:6825/2024112643","cluster_addr":"172.21.15.100:6827/2024112643","heartbeat_back_addr":"172.21.15.100:6831/2024112643","heartbeat_front_addr":"172.21.15.100:6829/2024112643","state":["exists","up"]},{"osd":11,"uuid":"3c427cfe-8d7c-431e-9eb4-b03cfac3068d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6825","nonce":2245781783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6827","nonce":2245781783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6831","nonce":2245781783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6829","nonce":2245781783}]},"public_addr":"172.21.15.153:6825/2245781783","cluster_addr":"172.21.15.153:6827/2245781783","heartbeat_back_addr":"172.21.15.153:6831/2245781783","heartbeat_front_addr":"172.21.15.153:6829/2245781783","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:23.001057+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:46.353182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:11.469840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:37.557521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:02.630783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:27.374057+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:53.758498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:19.507846+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:45.080789+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:10.286820+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:35.565950+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:06:00.633384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3072001022":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/1519904928":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6801/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/2108462626":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/3337107310":"2024-09-11T07:59:36.505631+0000","172.21.15.22:6801/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/1708436544":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/278091300":"2024-09-11T07:59:36.505631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:06:58.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.540+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1285336983 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fd3a40a2b80 msgr2=0x7fd3a40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:58.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.540+0000 7fd3be1d1640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fd3a40a2b80 0x7fd3a40a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8005fd0 tx=0x7fd3a800b390 comp rx=0 tx=0).stop 2024-09-10T08:06:58.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.540+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1285336983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3b810c2f0 msgr2=0x7fd3b81014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:58.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.540+0000 7fd3be1d1640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3b810c2f0 0x7fd3b81014d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0003f10 tx=0x7fd3b0003f40 comp rx=0 tx=0).stop 2024-09-10T08:06:58.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.540+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1285336983 shutdown_connections 2024-09-10T08:06:58.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.540+0000 7fd3be1d1640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fd3a40a2b80 0x7fd3a40a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:58.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.540+0000 7fd3be1d1640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3b810c2f0 0x7fd3b81014d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:58.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.540+0000 7fd3be1d1640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3b81037a0 0x7fd3b8100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:58.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.540+0000 7fd3be1d1640 1 --2- 172.21.15.22:0/1285336983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3b8102df0 0x7fd3b8100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:58.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.540+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1285336983 >> 172.21.15.22:0/1285336983 conn(0x7fd3b80fc7d0 msgr2=0x7fd3b80fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:58.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.540+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1285336983 shutdown_connections 2024-09-10T08:06:58.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:58.540+0000 7fd3be1d1640 1 -- 172.21.15.22:0/1285336983 wait complete. 2024-09-10T08:06:58.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:58 smithi153 ceph-mon[35609]: pgmap v279: 97 pgs: 21 creating+peering, 6 unknown, 70 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1 op/s 2024-09-10T08:06:58.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:58 smithi153 ceph-mon[35609]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T08:06:58.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:58 smithi153 ceph-mon[35609]: Cluster is now healthy 2024-09-10T08:06:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:58 smithi100 ceph-mon[35102]: pgmap v279: 97 pgs: 21 creating+peering, 6 unknown, 70 active+clean; 577 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 1 op/s 2024-09-10T08:06:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:58 smithi100 ceph-mon[35102]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T08:06:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:58 smithi100 ceph-mon[35102]: Cluster is now healthy 2024-09-10T08:06:59.176 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:06:59.436 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:06:59.591 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:06:59 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1285336983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:06:59.660 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:06:59 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1285336983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:06:59.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:06:59 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1285336983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:06:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.956+0000 7efe2979e640 1 -- 172.21.15.22:0/930784231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe24100ca0 msgr2=0x7efe24106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.956+0000 7efe2979e640 1 --2- 172.21.15.22:0/930784231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe24100ca0 0x7efe24106840 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efe18009cd0 tx=0x7efe1802a8e0 comp rx=0 tx=0).stop 2024-09-10T08:06:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.956+0000 7efe2979e640 1 -- 172.21.15.22:0/930784231 shutdown_connections 2024-09-10T08:06:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.956+0000 7efe2979e640 1 --2- 172.21.15.22:0/930784231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe24106f50 0x7efe2410eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:59.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.956+0000 7efe2979e640 1 --2- 172.21.15.22:0/930784231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe24100ca0 0x7efe24106840 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.956+0000 7efe2979e640 1 --2- 172.21.15.22:0/930784231 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe241002f0 0x7efe241006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.956+0000 7efe2979e640 1 -- 172.21.15.22:0/930784231 >> 172.21.15.22:0/930784231 conn(0x7efe24077210 msgr2=0x7efe240fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:06:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.956+0000 7efe2979e640 1 -- 172.21.15.22:0/930784231 shutdown_connections 2024-09-10T08:06:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.956+0000 7efe2979e640 1 -- 172.21.15.22:0/930784231 wait complete. 2024-09-10T08:06:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.956+0000 7efe2979e640 1 Processor -- start 2024-09-10T08:06:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe2979e640 1 -- start start 2024-09-10T08:06:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe2979e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe241002f0 0x7efe24198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe2979e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe24100ca0 0x7efe24198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe2979e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24106f50 0x7efe2419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe2979e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efe24111fe0 con 0x7efe241002f0 2024-09-10T08:06:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe2979e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efe24111e60 con 0x7efe24106f50 2024-09-10T08:06:59.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe2979e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efe24112160 con 0x7efe24100ca0 2024-09-10T08:06:59.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe22ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe241002f0 0x7efe24198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:59.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe22ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe241002f0 0x7efe24198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43966/0 (socket says 172.21.15.22:43966) 2024-09-10T08:06:59.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe22ffd640 1 -- 172.21.15.22:0/472921764 learned_addr learned my addr 172.21.15.22:0/472921764 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:06:59.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe227fc640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe24100ca0 0x7efe24198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:59.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe237fe640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24106f50 0x7efe2419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:59.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe22ffd640 1 -- 172.21.15.22:0/472921764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe24100ca0 msgr2=0x7efe24198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:59.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe22ffd640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe24100ca0 0x7efe24198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:59.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe22ffd640 1 -- 172.21.15.22:0/472921764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24106f50 msgr2=0x7efe2419ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:06:59.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe22ffd640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24106f50 0x7efe2419ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:06:59.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe22ffd640 1 -- 172.21.15.22:0/472921764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe2419d530 con 0x7efe241002f0 2024-09-10T08:06:59.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe227fc640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe24100ca0 0x7efe24198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:06:59.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.957+0000 7efe22ffd640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe241002f0 0x7efe24198580 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efe1400c890 tx=0x7efe1400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:59.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.958+0000 7efe0bfff640 1 -- 172.21.15.22:0/472921764 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14004220 con 0x7efe241002f0 2024-09-10T08:06:59.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.958+0000 7efe0bfff640 1 -- 172.21.15.22:0/472921764 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe140043c0 con 0x7efe241002f0 2024-09-10T08:06:59.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.958+0000 7efe0bfff640 1 -- 172.21.15.22:0/472921764 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe140049e0 con 0x7efe241002f0 2024-09-10T08:06:59.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.958+0000 7efe2979e640 1 -- 172.21.15.22:0/472921764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe2419d820 con 0x7efe241002f0 2024-09-10T08:06:59.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.958+0000 7efe2979e640 1 -- 172.21.15.22:0/472921764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe241a5100 con 0x7efe241002f0 2024-09-10T08:06:59.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.959+0000 7efe2979e640 1 -- 172.21.15.22:0/472921764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe241006d0 con 0x7efe241002f0 2024-09-10T08:06:59.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.960+0000 7efe0bfff640 1 -- 172.21.15.22:0/472921764 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7efe140079b0 con 0x7efe241002f0 2024-09-10T08:06:59.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.960+0000 7efe0bfff640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7efe0c0a2b80 0x7efe0c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:06:59.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.961+0000 7efe227fc640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7efe0c0a2b80 0x7efe0c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:06:59.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.961+0000 7efe0bfff640 1 -- 172.21.15.22:0/472921764 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7efe140cf000 con 0x7efe241002f0 2024-09-10T08:06:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.961+0000 7efe227fc640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7efe0c0a2b80 0x7efe0c0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efe240ff880 tx=0x7efe18009890 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:06:59.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:06:59.965+0000 7efe0bfff640 1 -- 172.21.15.22:0/472921764 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe14014030 con 0x7efe241002f0 2024-09-10T08:07:00.118 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:06:59 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b[64699]: 2024-09-10T08:06:59.660+0000 7f070f8cf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:07:00.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.178+0000 7efe2979e640 1 -- 172.21.15.22:0/472921764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7efe2402d7c0 con 0x7efe241002f0 2024-09-10T08:07:00.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.397+0000 7efe0bfff640 1 -- 172.21.15.22:0/472921764 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7efe1409c0b0 con 0x7efe241002f0 2024-09-10T08:07:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.399+0000 7efe2979e640 1 -- 172.21.15.22:0/472921764 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7efe0c0a2b80 msgr2=0x7efe0c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.399+0000 7efe2979e640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7efe0c0a2b80 0x7efe0c0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efe240ff880 tx=0x7efe18009890 comp rx=0 tx=0).stop 2024-09-10T08:07:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.399+0000 7efe2979e640 1 -- 172.21.15.22:0/472921764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe241002f0 msgr2=0x7efe24198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.399+0000 7efe2979e640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe241002f0 0x7efe24198580 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efe1400c890 tx=0x7efe1400cd50 comp rx=0 tx=0).stop 2024-09-10T08:07:00.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.399+0000 7efe2979e640 1 -- 172.21.15.22:0/472921764 shutdown_connections 2024-09-10T08:07:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.399+0000 7efe2979e640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7efe0c0a2b80 0x7efe0c0a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.399+0000 7efe2979e640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24106f50 0x7efe2419ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.399+0000 7efe2979e640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe24100ca0 0x7efe24198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.399+0000 7efe2979e640 1 --2- 172.21.15.22:0/472921764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe241002f0 0x7efe24198580 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.399+0000 7efe2979e640 1 -- 172.21.15.22:0/472921764 >> 172.21.15.22:0/472921764 conn(0x7efe24077210 msgr2=0x7efe241052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.399+0000 7efe2979e640 1 -- 172.21.15.22:0/472921764 shutdown_connections 2024-09-10T08:07:00.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:00.399+0000 7efe2979e640 1 -- 172.21.15.22:0/472921764 wait complete. 2024-09-10T08:07:00.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:00 smithi022 ceph-mon[30854]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-10T08:07:00.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:00 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/472921764' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T08:07:00.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:00 smithi153 ceph-mon[35609]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-10T08:07:00.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:00 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/472921764' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T08:07:00.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:00 smithi100 ceph-mon[35102]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-10T08:07:00.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:00 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/472921764' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-10T08:07:01.140 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-10T08:07:01.141 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-10T08:07:01.402 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:01.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:01 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/472921764' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T08:07:01.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:01 smithi022 ceph-mon[30854]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T08:07:01.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-10T08:07:01.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-10T08:07:01.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-10T08:07:01.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-10T08:07:01.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-10T08:07:01.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-10T08:07:01.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-09-10T08:07:01.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-09-10T08:07:01.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:01 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-10T08:07:01.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:01 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/472921764' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T08:07:01.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:01 smithi153 ceph-mon[35609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T08:07:01.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-10T08:07:01.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-10T08:07:01.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-10T08:07:01.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-10T08:07:01.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-10T08:07:01.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-10T08:07:01.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-09-10T08:07:01.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-09-10T08:07:01.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:01 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-10T08:07:01.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:01 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/472921764' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T08:07:01.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:01 smithi100 ceph-mon[35102]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T08:07:01.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-10T08:07:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-09-10T08:07:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-09-10T08:07:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-10T08:07:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-09-10T08:07:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-09-10T08:07:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-09-10T08:07:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2024-09-10T08:07:01.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:01 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-10T08:07:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.855+0000 7fae74788640 1 -- 172.21.15.22:0/1552374862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae6c10c170 msgr2=0x7fae6c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.855+0000 7fae74788640 1 --2- 172.21.15.22:0/1552374862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae6c10c170 0x7fae6c10e610 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fae64009ca0 tx=0x7fae6402a950 comp rx=0 tx=0).stop 2024-09-10T08:07:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.855+0000 7fae74788640 1 -- 172.21.15.22:0/1552374862 shutdown_connections 2024-09-10T08:07:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.855+0000 7fae74788640 1 --2- 172.21.15.22:0/1552374862 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae6c10c170 0x7fae6c10e610 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.855+0000 7fae74788640 1 --2- 172.21.15.22:0/1552374862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c103660 0x7fae6c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.855+0000 7fae74788640 1 --2- 172.21.15.22:0/1552374862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6c102d40 0x7fae6c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.855+0000 7fae74788640 1 -- 172.21.15.22:0/1552374862 >> 172.21.15.22:0/1552374862 conn(0x7fae6c0fc7a0 msgr2=0x7fae6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.855+0000 7fae74788640 1 -- 172.21.15.22:0/1552374862 shutdown_connections 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.855+0000 7fae74788640 1 -- 172.21.15.22:0/1552374862 wait complete. 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.855+0000 7fae74788640 1 Processor -- start 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae74788640 1 -- start start 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae74788640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae6c102d40 0x7fae6c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae74788640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6c103660 0x7fae6c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae74788640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c10c170 0x7fae6c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae74788640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c111fb0 con 0x7fae6c102d40 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae74788640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c111e30 con 0x7fae6c10c170 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae74788640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fae6c112130 con 0x7fae6c103660 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae72524640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae6c102d40 0x7fae6c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae72524640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae6c102d40 0x7fae6c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43998/0 (socket says 172.21.15.22:43998) 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae72524640 1 -- 172.21.15.22:0/933941524 learned_addr learned my addr 172.21.15.22:0/933941524 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae72d25640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c10c170 0x7fae6c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae71d23640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6c103660 0x7fae6c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae72524640 1 -- 172.21.15.22:0/933941524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6c103660 msgr2=0x7fae6c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae72524640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6c103660 0x7fae6c100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae72524640 1 -- 172.21.15.22:0/933941524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c10c170 msgr2=0x7fae6c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae72524640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c10c170 0x7fae6c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae72524640 1 -- 172.21.15.22:0/933941524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6c1a6970 con 0x7fae6c102d40 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae71d23640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6c103660 0x7fae6c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.856+0000 7fae72524640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae6c102d40 0x7fae6c1009a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fae6800b4a0 tx=0x7fae6800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.857+0000 7fae637fe640 1 -- 172.21.15.22:0/933941524 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68014070 con 0x7fae6c102d40 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.857+0000 7fae637fe640 1 -- 172.21.15.22:0/933941524 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fae68010af0 con 0x7fae6c102d40 2024-09-10T08:07:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.857+0000 7fae74788640 1 -- 172.21.15.22:0/933941524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae6c1a6c60 con 0x7fae6c102d40 2024-09-10T08:07:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.857+0000 7fae637fe640 1 -- 172.21.15.22:0/933941524 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae68017d10 con 0x7fae6c102d40 2024-09-10T08:07:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.857+0000 7fae74788640 1 -- 172.21.15.22:0/933941524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6c1a7150 con 0x7fae6c102d40 2024-09-10T08:07:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.858+0000 7fae74788640 1 -- 172.21.15.22:0/933941524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae6c103120 con 0x7fae6c102d40 2024-09-10T08:07:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.859+0000 7fae637fe640 1 -- 172.21.15.22:0/933941524 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fae68017070 con 0x7fae6c102d40 2024-09-10T08:07:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.860+0000 7fae637fe640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fae580a2b80 0x7fae580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.860+0000 7fae71d23640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fae580a2b80 0x7fae580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.860+0000 7fae637fe640 1 -- 172.21.15.22:0/933941524 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8240+0+0 (secure 0 0 0) 0x7fae680ce8a0 con 0x7fae6c102d40 2024-09-10T08:07:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.860+0000 7fae71d23640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fae580a2b80 0x7fae580a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae6c102430 tx=0x7fae5c005dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:01.863+0000 7fae637fe640 1 -- 172.21.15.22:0/933941524 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae6809b7c0 con 0x7fae6c102d40 2024-09-10T08:07:02.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.081+0000 7fae74788640 1 -- 172.21.15.22:0/933941524 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fae6c02d7c0 con 0x7fae6c102d40 2024-09-10T08:07:02.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.408+0000 7fae637fe640 1 -- 172.21.15.22:0/933941524 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fae6809b0c0 con 0x7fae6c102d40 2024-09-10T08:07:02.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.412+0000 7fae74788640 1 -- 172.21.15.22:0/933941524 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fae580a2b80 msgr2=0x7fae580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:02.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.412+0000 7fae74788640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fae580a2b80 0x7fae580a5040 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae6c102430 tx=0x7fae5c005dd0 comp rx=0 tx=0).stop 2024-09-10T08:07:02.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.412+0000 7fae74788640 1 -- 172.21.15.22:0/933941524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae6c102d40 msgr2=0x7fae6c1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.412+0000 7fae74788640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae6c102d40 0x7fae6c1009a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fae6800b4a0 tx=0x7fae6800b960 comp rx=0 tx=0).stop 2024-09-10T08:07:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.412+0000 7fae74788640 1 -- 172.21.15.22:0/933941524 shutdown_connections 2024-09-10T08:07:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.412+0000 7fae74788640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fae580a2b80 0x7fae580a5040 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.412+0000 7fae74788640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c10c170 0x7fae6c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.412+0000 7fae74788640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae6c103660 0x7fae6c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.412+0000 7fae74788640 1 --2- 172.21.15.22:0/933941524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae6c102d40 0x7fae6c1009a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.412+0000 7fae74788640 1 -- 172.21.15.22:0/933941524 >> 172.21.15.22:0/933941524 conn(0x7fae6c0fc7a0 msgr2=0x7fae6c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.412+0000 7fae74788640 1 -- 172.21.15.22:0/933941524 shutdown_connections 2024-09-10T08:07:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:02.412+0000 7fae74788640 1 -- 172.21.15.22:0/933941524 wait complete. 2024-09-10T08:07:02.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:02 smithi153 ceph-mon[35609]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T08:07:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-10T08:07:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T08:07:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-10T08:07:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-10T08:07:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-10T08:07:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-10T08:07:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-10T08:07:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-09-10T08:07:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:02 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-10T08:07:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:02 smithi153 ceph-mon[35609]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T08:07:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:02 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/933941524' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-10T08:07:02.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:02 smithi022 ceph-mon[30854]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T08:07:02.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-10T08:07:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T08:07:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-10T08:07:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-10T08:07:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-10T08:07:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-10T08:07:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-10T08:07:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-09-10T08:07:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:02 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-10T08:07:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:02 smithi022 ceph-mon[30854]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T08:07:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:02 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/933941524' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-10T08:07:02.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:02 smithi100 ceph-mon[35102]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T08:07:02.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-10T08:07:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-09-10T08:07:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-10T08:07:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-10T08:07:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-09-10T08:07:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-10T08:07:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-09-10T08:07:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2024-09-10T08:07:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:02 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-10T08:07:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:02 smithi100 ceph-mon[35102]: osdmap e82: 12 total, 12 up, 12 in 2024-09-10T08:07:02.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:02 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/933941524' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-10T08:07:03.045 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T08:07:03.301 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:03.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:03 smithi153 ceph-mon[35609]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T08:07:03.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:03 smithi153 ceph-mon[35609]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T08:07:03.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:03 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/933941524' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T08:07:03.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:03 smithi153 ceph-mon[35609]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T08:07:03.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:03 smithi153 ceph-mon[35609]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T08:07:03.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:03 smithi153 ceph-mon[35609]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T08:07:03.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:03 smithi153 ceph-mon[35609]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T08:07:03.695 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:03 smithi022 ceph-mon[30854]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T08:07:03.695 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:03 smithi022 ceph-mon[30854]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T08:07:03.695 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:03 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/933941524' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T08:07:03.695 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:03 smithi022 ceph-mon[30854]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T08:07:03.695 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:03 smithi022 ceph-mon[30854]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T08:07:03.695 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:03 smithi022 ceph-mon[30854]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T08:07:03.695 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:03 smithi022 ceph-mon[30854]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T08:07:03.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.780+0000 7fa7933a3640 1 -- 172.21.15.22:0/547966110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa78c102de0 msgr2=0x7fa78c1031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:03.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.780+0000 7fa7933a3640 1 --2- 172.21.15.22:0/547966110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa78c102de0 0x7fa78c1031c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa788009900 tx=0x7fa78802a480 comp rx=0 tx=0).stop 2024-09-10T08:07:03.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.780+0000 7fa7933a3640 1 -- 172.21.15.22:0/547966110 shutdown_connections 2024-09-10T08:07:03.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.780+0000 7fa7933a3640 1 --2- 172.21.15.22:0/547966110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c10c180 0x7fa78c10e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:03.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.780+0000 7fa7933a3640 1 --2- 172.21.15.22:0/547966110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa78c103700 0x7fa78c10bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:03.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.780+0000 7fa7933a3640 1 --2- 172.21.15.22:0/547966110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa78c102de0 0x7fa78c1031c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:03.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.780+0000 7fa7933a3640 1 -- 172.21.15.22:0/547966110 >> 172.21.15.22:0/547966110 conn(0x7fa78c0fc780 msgr2=0x7fa78c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:03.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.780+0000 7fa7933a3640 1 -- 172.21.15.22:0/547966110 shutdown_connections 2024-09-10T08:07:03.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.780+0000 7fa7933a3640 1 -- 172.21.15.22:0/547966110 wait complete. 2024-09-10T08:07:03.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa7933a3640 1 Processor -- start 2024-09-10T08:07:03.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa7933a3640 1 -- start start 2024-09-10T08:07:03.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa7933a3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c102de0 0x7fa78c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:03.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa7933a3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa78c103700 0x7fa78c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:03.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa7933a3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa78c10c180 0x7fa78c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:03.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa7933a3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c111f50 con 0x7fa78c103700 2024-09-10T08:07:03.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa7933a3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c111dd0 con 0x7fa78c10c180 2024-09-10T08:07:03.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa7933a3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c1120d0 con 0x7fa78c102de0 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa79093e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa78c103700 0x7fa78c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa79093e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa78c103700 0x7fa78c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33938/0 (socket says 172.21.15.22:33938) 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa79093e640 1 -- 172.21.15.22:0/1116765617 learned_addr learned my addr 172.21.15.22:0/1116765617 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa79113f640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c102de0 0x7fa78c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa79093e640 1 -- 172.21.15.22:0/1116765617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c102de0 msgr2=0x7fa78c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa79093e640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c102de0 0x7fa78c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa79093e640 1 -- 172.21.15.22:0/1116765617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa78c10c180 msgr2=0x7fa78c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa79093e640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa78c10c180 0x7fa78c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa79093e640 1 -- 172.21.15.22:0/1116765617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c19d420 con 0x7fa78c103700 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.781+0000 7fa79113f640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c102de0 0x7fa78c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.782+0000 7fa79093e640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa78c103700 0x7fa78c1989b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c890 tx=0x7fa77c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.782+0000 7fa7827fc640 1 -- 172.21.15.22:0/1116765617 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c004220 con 0x7fa78c103700 2024-09-10T08:07:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.782+0000 7fa7827fc640 1 -- 172.21.15.22:0/1116765617 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa77c0043c0 con 0x7fa78c103700 2024-09-10T08:07:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.782+0000 7fa7933a3640 1 -- 172.21.15.22:0/1116765617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78c19d710 con 0x7fa78c103700 2024-09-10T08:07:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.782+0000 7fa7827fc640 1 -- 172.21.15.22:0/1116765617 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0049e0 con 0x7fa78c103700 2024-09-10T08:07:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.782+0000 7fa7933a3640 1 -- 172.21.15.22:0/1116765617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78c1a4ff0 con 0x7fa78c103700 2024-09-10T08:07:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.783+0000 7fa7933a3640 1 -- 172.21.15.22:0/1116765617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78c1031c0 con 0x7fa78c103700 2024-09-10T08:07:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.784+0000 7fa7827fc640 1 -- 172.21.15.22:0/1116765617 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7fa77c0079b0 con 0x7fa78c103700 2024-09-10T08:07:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.785+0000 7fa7827fc640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7780a2c00 0x7fa7780a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.785+0000 7fa79113f640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7780a2c00 0x7fa7780a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.785+0000 7fa7827fc640 1 -- 172.21.15.22:0/1116765617 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa77c0cf150 con 0x7fa78c103700 2024-09-10T08:07:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.785+0000 7fa79113f640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7780a2c00 0x7fa7780a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa788005ab0 tx=0x7fa788005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:03.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.789+0000 7fa7827fc640 1 -- 172.21.15.22:0/1116765617 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa77c014030 con 0x7fa78c103700 2024-09-10T08:07:03.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:03 smithi100 ceph-mon[35102]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T08:07:03.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:03 smithi100 ceph-mon[35102]: osdmap e83: 12 total, 12 up, 12 in 2024-09-10T08:07:03.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:03 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/933941524' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-10T08:07:03.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:03 smithi100 ceph-mon[35102]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T08:07:03.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:03 smithi100 ceph-mon[35102]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T08:07:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:03 smithi100 ceph-mon[35102]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T08:07:03.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:03 smithi100 ceph-mon[35102]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T08:07:04.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:03.999+0000 7fa7933a3640 1 -- 172.21.15.22:0/1116765617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fa78c02d7c0 con 0x7fa78c103700 2024-09-10T08:07:04.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.427+0000 7fa7827fc640 1 -- 172.21.15.22:0/1116765617 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fa77c09c070 con 0x7fa78c103700 2024-09-10T08:07:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.430+0000 7fa7933a3640 1 -- 172.21.15.22:0/1116765617 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7780a2c00 msgr2=0x7fa7780a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.430+0000 7fa7933a3640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7780a2c00 0x7fa7780a50c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa788005ab0 tx=0x7fa788005a20 comp rx=0 tx=0).stop 2024-09-10T08:07:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.430+0000 7fa7933a3640 1 -- 172.21.15.22:0/1116765617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa78c103700 msgr2=0x7fa78c1989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.430+0000 7fa7933a3640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa78c103700 0x7fa78c1989b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00c890 tx=0x7fa77c00cd50 comp rx=0 tx=0).stop 2024-09-10T08:07:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.430+0000 7fa7933a3640 1 -- 172.21.15.22:0/1116765617 shutdown_connections 2024-09-10T08:07:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.430+0000 7fa7933a3640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7780a2c00 0x7fa7780a50c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.430+0000 7fa7933a3640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa78c10c180 0x7fa78c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.430+0000 7fa7933a3640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa78c103700 0x7fa78c1989b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:04.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.430+0000 7fa7933a3640 1 --2- 172.21.15.22:0/1116765617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa78c102de0 0x7fa78c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:04.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.430+0000 7fa7933a3640 1 -- 172.21.15.22:0/1116765617 >> 172.21.15.22:0/1116765617 conn(0x7fa78c0fc780 msgr2=0x7fa78c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:04.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.430+0000 7fa7933a3640 1 -- 172.21.15.22:0/1116765617 shutdown_connections 2024-09-10T08:07:04.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:04.430+0000 7fa7933a3640 1 -- 172.21.15.22:0/1116765617 wait complete. 2024-09-10T08:07:04.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:04 smithi153 ceph-mon[35609]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T08:07:04.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:04 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] up:active 2024-09-10T08:07:04.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:04 smithi153 ceph-mon[35609]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T08:07:04.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:04 smithi153 ceph-mon[35609]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T08:07:04.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:04 smithi153 ceph-mon[35609]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-10T08:07:04.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:04 smithi153 ceph-mon[35609]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-10T08:07:04.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:04 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1116765617' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T08:07:04.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:04 smithi022 ceph-mon[30854]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T08:07:04.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:04 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] up:active 2024-09-10T08:07:04.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:04 smithi022 ceph-mon[30854]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T08:07:04.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:04 smithi022 ceph-mon[30854]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T08:07:04.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:04 smithi022 ceph-mon[30854]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-10T08:07:04.750 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:04 smithi022 ceph-mon[30854]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-10T08:07:04.751 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:04 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1116765617' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T08:07:04.868 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:07:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b[64699]: 2024-09-10T08:07:04.661+0000 7f070f8cf640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T08:07:04.868 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:07:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b[64699]: 2024-09-10T08:07:04.661+0000 7f070f8cf640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-10T08:07:04.869 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:07:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b[64699]: 2024-09-10T08:07:04.661+0000 7f070f8cf640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-10T08:07:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:04 smithi100 ceph-mon[35102]: pgmap v284: 97 pgs: 97 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-10T08:07:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:04 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] up:active 2024-09-10T08:07:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:04 smithi100 ceph-mon[35102]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T08:07:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:04 smithi100 ceph-mon[35102]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T08:07:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:04 smithi100 ceph-mon[35102]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-10T08:07:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:04 smithi100 ceph-mon[35102]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-10T08:07:04.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:04 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1116765617' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-10T08:07:05.062 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T08:07:05.323 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1116765617' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T08:07:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] up:active 2024-09-10T08:07:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T08:07:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-10T08:07:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-10T08:07:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-10T08:07:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] up:active 2024-09-10T08:07:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T08:07:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T08:07:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: Cluster is now healthy 2024-09-10T08:07:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 4 up:standby-replay 4 up:standby 2024-09-10T08:07:05.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-10T08:07:05.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:05 smithi153 ceph-mon[35609]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-10T08:07:05.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1116765617' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T08:07:05.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] up:active 2024-09-10T08:07:05.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T08:07:05.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-10T08:07:05.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-10T08:07:05.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-10T08:07:05.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] up:active 2024-09-10T08:07:05.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T08:07:05.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T08:07:05.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: Cluster is now healthy 2024-09-10T08:07:05.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 4 up:standby-replay 4 up:standby 2024-09-10T08:07:05.731 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-10T08:07:05.732 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:05 smithi022 ceph-mon[30854]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-10T08:07:05.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.816+0000 7f52dd7a2640 1 -- 172.21.15.22:0/4107039635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52d8102b90 msgr2=0x7f52d8102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:05.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.816+0000 7f52dd7a2640 1 --2- 172.21.15.22:0/4107039635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52d8102b90 0x7f52d8102f70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009900 tx=0x7f52c802a480 comp rx=0 tx=0).stop 2024-09-10T08:07:05.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.816+0000 7f52dd7a2640 1 -- 172.21.15.22:0/4107039635 shutdown_connections 2024-09-10T08:07:05.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.816+0000 7f52dd7a2640 1 --2- 172.21.15.22:0/4107039635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52d810bfc0 0x7f52d810e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:05.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.816+0000 7f52dd7a2640 1 --2- 172.21.15.22:0/4107039635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d81034b0 0x7f52d810b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:05.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.816+0000 7f52dd7a2640 1 --2- 172.21.15.22:0/4107039635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52d8102b90 0x7f52d8102f70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:05.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.816+0000 7f52dd7a2640 1 -- 172.21.15.22:0/4107039635 >> 172.21.15.22:0/4107039635 conn(0x7f52d80fc610 msgr2=0x7f52d80fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:05.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.816+0000 7f52dd7a2640 1 -- 172.21.15.22:0/4107039635 shutdown_connections 2024-09-10T08:07:05.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.816+0000 7f52dd7a2640 1 -- 172.21.15.22:0/4107039635 wait complete. 2024-09-10T08:07:05.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.816+0000 7f52dd7a2640 1 Processor -- start 2024-09-10T08:07:05.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52dd7a2640 1 -- start start 2024-09-10T08:07:05.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52dd7a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52d8102b90 0x7f52d8198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:05.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52dd7a2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d81034b0 0x7f52d8198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:05.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52dd7a2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52d810bfc0 0x7f52d819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:05.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52dd7a2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f52d8111e20 con 0x7f52d8102b90 2024-09-10T08:07:05.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52dd7a2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f52d8111ca0 con 0x7f52d810bfc0 2024-09-10T08:07:05.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52dd7a2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52d8111fa0 con 0x7f52d81034b0 2024-09-10T08:07:05.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52d7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52d8102b90 0x7f52d8198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:05.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52d7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52d8102b90 0x7f52d8198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33956/0 (socket says 172.21.15.22:33956) 2024-09-10T08:07:05.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52d7fff640 1 -- 172.21.15.22:0/1466585541 learned_addr learned my addr 172.21.15.22:0/1466585541 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:05.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52cffff640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d81034b0 0x7f52d8198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:05.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52dcfa1640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52d810bfc0 0x7f52d819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:05.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52d7fff640 1 -- 172.21.15.22:0/1466585541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d81034b0 msgr2=0x7f52d8198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:05.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52d7fff640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d81034b0 0x7f52d8198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:05.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52d7fff640 1 -- 172.21.15.22:0/1466585541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52d810bfc0 msgr2=0x7f52d819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:05.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52d7fff640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52d810bfc0 0x7f52d819cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:05.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52d7fff640 1 -- 172.21.15.22:0/1466585541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d819d2b0 con 0x7f52d8102b90 2024-09-10T08:07:05.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52dcfa1640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52d810bfc0 0x7f52d819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:07:05.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.817+0000 7f52d7fff640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52d8102b90 0x7f52d8198300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006010 tx=0x7f52c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:05.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.818+0000 7f52d5ffb640 1 -- 172.21.15.22:0/1466585541 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c803f030 con 0x7f52d8102b90 2024-09-10T08:07:05.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.818+0000 7f52d5ffb640 1 -- 172.21.15.22:0/1466585541 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52c8003ce0 con 0x7f52d8102b90 2024-09-10T08:07:05.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.818+0000 7f52dd7a2640 1 -- 172.21.15.22:0/1466585541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d819d540 con 0x7f52d8102b90 2024-09-10T08:07:05.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.818+0000 7f52d5ffb640 1 -- 172.21.15.22:0/1466585541 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c8035070 con 0x7f52d8102b90 2024-09-10T08:07:05.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.818+0000 7f52dd7a2640 1 -- 172.21.15.22:0/1466585541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d81a4e80 con 0x7f52d8102b90 2024-09-10T08:07:05.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.819+0000 7f52dd7a2640 1 -- 172.21.15.22:0/1466585541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d8102f70 con 0x7f52d8102b90 2024-09-10T08:07:05.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.820+0000 7f52d5ffb640 1 -- 172.21.15.22:0/1466585541 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f52c8042030 con 0x7f52d8102b90 2024-09-10T08:07:05.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.820+0000 7f52d5ffb640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f52c40a2c00 0x7f52c40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:05.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.821+0000 7f52cffff640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f52c40a2c00 0x7f52c40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:05.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.821+0000 7f52d5ffb640 1 -- 172.21.15.22:0/1466585541 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f52c80ef540 con 0x7f52d8102b90 2024-09-10T08:07:05.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.821+0000 7f52cffff640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f52c40a2c00 0x7f52c40a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f52d810d400 tx=0x7f52c000b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:05.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:05.825+0000 7f52d5ffb640 1 -- 172.21.15.22:0/1466585541 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52c80bc520 con 0x7f52d8102b90 2024-09-10T08:07:05.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1116765617' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T08:07:05.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] up:active 2024-09-10T08:07:05.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: daemon mds.e assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-10T08:07:05.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-10T08:07:05.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:creating} 8 up:standby 2024-09-10T08:07:05.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: daemon mds.e is now active in filesystem cephfs as rank 3 2024-09-10T08:07:05.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] up:active 2024-09-10T08:07:05.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: daemon mds.a assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-10T08:07:05.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T08:07:05.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: Cluster is now healthy 2024-09-10T08:07:05.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=i=up:active,3=e=up:active} 4 up:standby-replay 4 up:standby 2024-09-10T08:07:05.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-10T08:07:05.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:05 smithi100 ceph-mon[35102]: daemon mds.a is now active in filesystem cephfs as rank 4 2024-09-10T08:07:06.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.041+0000 7f52dd7a2640 1 -- 172.21.15.22:0/1466585541 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f52d8107030 con 0x7f52d8102b90 2024-09-10T08:07:06.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.468+0000 7f52d5ffb640 1 -- 172.21.15.22:0/1466585541 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f52c80bbe20 con 0x7f52d8102b90 2024-09-10T08:07:06.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.470+0000 7f52dd7a2640 1 -- 172.21.15.22:0/1466585541 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f52c40a2c00 msgr2=0x7f52c40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:06.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.470+0000 7f52dd7a2640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f52c40a2c00 0x7f52c40a50c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f52d810d400 tx=0x7f52c000b2e0 comp rx=0 tx=0).stop 2024-09-10T08:07:06.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.470+0000 7f52dd7a2640 1 -- 172.21.15.22:0/1466585541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52d8102b90 msgr2=0x7f52d8198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:06.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.470+0000 7f52dd7a2640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52d8102b90 0x7f52d8198300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006010 tx=0x7f52c80042f0 comp rx=0 tx=0).stop 2024-09-10T08:07:06.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.470+0000 7f52dd7a2640 1 -- 172.21.15.22:0/1466585541 shutdown_connections 2024-09-10T08:07:06.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.470+0000 7f52dd7a2640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f52c40a2c00 0x7f52c40a50c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:06.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.470+0000 7f52dd7a2640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f52d810bfc0 0x7f52d819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.470+0000 7f52dd7a2640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d81034b0 0x7f52d8198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.470+0000 7f52dd7a2640 1 --2- 172.21.15.22:0/1466585541 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f52d8102b90 0x7f52d8198300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.470+0000 7f52dd7a2640 1 -- 172.21.15.22:0/1466585541 >> 172.21.15.22:0/1466585541 conn(0x7f52d80fc610 msgr2=0x7f52d80fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.471+0000 7f52dd7a2640 1 -- 172.21.15.22:0/1466585541 shutdown_connections 2024-09-10T08:07:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:06.471+0000 7f52dd7a2640 1 -- 172.21.15.22:0/1466585541 wait complete. 2024-09-10T08:07:06.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:06 smithi022 ceph-mon[30854]: pgmap v285: 97 pgs: 97 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 3.6 KiB/s wr, 11 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:06.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:06 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] up:active 2024-09-10T08:07:06.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:06 smithi022 ceph-mon[30854]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-10T08:07:06.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:06 smithi022 ceph-mon[30854]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:07:06.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:06 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1466585541' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T08:07:06.821 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:06 smithi153 ceph-mon[35609]: pgmap v285: 97 pgs: 97 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 3.6 KiB/s wr, 11 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:06.821 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:06 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] up:active 2024-09-10T08:07:06.822 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:06 smithi153 ceph-mon[35609]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-10T08:07:06.822 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:06 smithi153 ceph-mon[35609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:07:06.822 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:06 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1466585541' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T08:07:06.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:06 smithi100 ceph-mon[35102]: pgmap v285: 97 pgs: 97 active+clean; 581 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 3.6 KiB/s wr, 11 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:06.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:06 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] up:active 2024-09-10T08:07:06.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:06 smithi100 ceph-mon[35102]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-10T08:07:06.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:06 smithi100 ceph-mon[35102]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:07:06.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:06 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1466585541' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-10T08:07:07.206 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-10T08:07:07.206 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T08:07:07.470 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:07.749 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:07 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1466585541' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T08:07:07.749 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:07 smithi022 ceph-mon[30854]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:07:07.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:07 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1466585541' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T08:07:07.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:07 smithi100 ceph-mon[35102]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:07:07.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:07 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1466585541' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T08:07:07.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:07 smithi153 ceph-mon[35609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:07:07.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.968+0000 7f34818f8640 1 -- 172.21.15.22:0/3208612006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f347c100aa0 msgr2=0x7f347c10ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:07.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.968+0000 7f34818f8640 1 --2- 172.21.15.22:0/3208612006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f347c100aa0 0x7f347c10ea20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3474009900 tx=0x7f347402a410 comp rx=0 tx=0).stop 2024-09-10T08:07:07.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.968+0000 7f34818f8640 1 -- 172.21.15.22:0/3208612006 shutdown_connections 2024-09-10T08:07:07.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.968+0000 7f34818f8640 1 --2- 172.21.15.22:0/3208612006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f347c100aa0 0x7f347c10ea20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:07.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.968+0000 7f34818f8640 1 --2- 172.21.15.22:0/3208612006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f347c100100 0x7f347c100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:07.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.968+0000 7f34818f8640 1 --2- 172.21.15.22:0/3208612006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f347c106b80 0x7f347c106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:07.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.968+0000 7f34818f8640 1 -- 172.21.15.22:0/3208612006 >> 172.21.15.22:0/3208612006 conn(0x7f347c077230 msgr2=0x7f347c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:07.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.969+0000 7f34818f8640 1 -- 172.21.15.22:0/3208612006 shutdown_connections 2024-09-10T08:07:07.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.969+0000 7f34818f8640 1 -- 172.21.15.22:0/3208612006 wait complete. 2024-09-10T08:07:07.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.969+0000 7f34818f8640 1 Processor -- start 2024-09-10T08:07:07.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.969+0000 7f34818f8640 1 -- start start 2024-09-10T08:07:07.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.969+0000 7f34818f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f347c100100 0x7f347c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:07.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.969+0000 7f34818f8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f347c100aa0 0x7f347c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:07.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.969+0000 7f34818f8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f347c106b80 0x7f347c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:07.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f34818f8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f347c112070 con 0x7f347c106b80 2024-09-10T08:07:07.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f34818f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f347c111ef0 con 0x7f347c100100 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f34818f8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f347c1121f0 con 0x7f347c100aa0 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f347b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f347c106b80 0x7f347c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f347b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f347c106b80 0x7f347c19ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33966/0 (socket says 172.21.15.22:33966) 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f347b7fe640 1 -- 172.21.15.22:0/2273862965 learned_addr learned my addr 172.21.15.22:0/2273862965 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f347affd640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f347c100100 0x7f347c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f347a7fc640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f347c100aa0 0x7f347c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f347b7fe640 1 -- 172.21.15.22:0/2273862965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f347c100aa0 msgr2=0x7f347c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f347b7fe640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f347c100aa0 0x7f347c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f347b7fe640 1 -- 172.21.15.22:0/2273862965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f347c100100 msgr2=0x7f347c19a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f347b7fe640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f347c100100 0x7f347c19a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f347b7fe640 1 -- 172.21.15.22:0/2273862965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347c19f620 con 0x7f347c106b80 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f347b7fe640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f347c106b80 0x7f347c19ef40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3474005ab0 tx=0x7f34740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f34808f6640 1 -- 172.21.15.22:0/2273862965 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347403f030 con 0x7f347c106b80 2024-09-10T08:07:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f34818f8640 1 -- 172.21.15.22:0/2273862965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347c19f8b0 con 0x7f347c106b80 2024-09-10T08:07:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f34808f6640 1 -- 172.21.15.22:0/2273862965 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3474003ce0 con 0x7f347c106b80 2024-09-10T08:07:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f34808f6640 1 -- 172.21.15.22:0/2273862965 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3474035070 con 0x7f347c106b80 2024-09-10T08:07:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.970+0000 7f34818f8640 1 -- 172.21.15.22:0/2273862965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347c1a71f0 con 0x7f347c106b80 2024-09-10T08:07:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.971+0000 7f34818f8640 1 -- 172.21.15.22:0/2273862965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f347c100560 con 0x7f347c106b80 2024-09-10T08:07:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.973+0000 7f34808f6640 1 -- 172.21.15.22:0/2273862965 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 137833+0+0 (secure 0 0 0) 0x7f3474042030 con 0x7f347c106b80 2024-09-10T08:07:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.973+0000 7f34808f6640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f34640a2b80 0x7f34640a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.973+0000 7f34808f6640 1 -- 172.21.15.22:0/2273862965 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f34740ef840 con 0x7f347c106b80 2024-09-10T08:07:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.973+0000 7f347affd640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f34640a2b80 0x7f34640a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.974+0000 7f347affd640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f34640a2b80 0x7f34640a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f346c007ec0 tx=0x7f346c0075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:07.976+0000 7f34808f6640 1 -- 172.21.15.22:0/2273862965 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34740bc7a0 con 0x7f347c106b80 2024-09-10T08:07:08.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.178+0000 7f34818f8640 1 -- 172.21.15.22:0/2273862965 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f347c102220 con 0x7f34640a2b80 2024-09-10T08:07:08.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.202+0000 7f34808f6640 1 -- 172.21.15.22:0/2273862965 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f347c102220 con 0x7f34640a2b80 2024-09-10T08:07:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.204+0000 7f34818f8640 1 -- 172.21.15.22:0/2273862965 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f34640a2b80 msgr2=0x7f34640a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.204+0000 7f34818f8640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f34640a2b80 0x7f34640a5040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f346c007ec0 tx=0x7f346c0075b0 comp rx=0 tx=0).stop 2024-09-10T08:07:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.204+0000 7f34818f8640 1 -- 172.21.15.22:0/2273862965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f347c106b80 msgr2=0x7f347c19ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.204+0000 7f34818f8640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f347c106b80 0x7f347c19ef40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3474005ab0 tx=0x7f34740042f0 comp rx=0 tx=0).stop 2024-09-10T08:07:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.204+0000 7f34818f8640 1 -- 172.21.15.22:0/2273862965 shutdown_connections 2024-09-10T08:07:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.204+0000 7f34818f8640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f34640a2b80 0x7f34640a5040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.204+0000 7f34818f8640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f347c106b80 0x7f347c19ef40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.204+0000 7f34818f8640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f347c100aa0 0x7f347c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.204+0000 7f34818f8640 1 --2- 172.21.15.22:0/2273862965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f347c100100 0x7f347c19a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.204+0000 7f34818f8640 1 -- 172.21.15.22:0/2273862965 >> 172.21.15.22:0/2273862965 conn(0x7f347c077230 msgr2=0x7f347c104cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.204+0000 7f34818f8640 1 -- 172.21.15.22:0/2273862965 shutdown_connections 2024-09-10T08:07:08.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:08.204+0000 7f34818f8640 1 -- 172.21.15.22:0/2273862965 wait complete. 2024-09-10T08:07:08.474 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:07:08 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:07:08.183+0000 7f8ee7cc6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:07:08.474 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:07:08 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:07:08.183+0000 7f8ee7cc6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:07:08.475 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:07:08 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:07:08.183+0000 7f8ee7cc6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:07:08.475 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:07:08 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:07:08.183+0000 7f8ee7cc6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:07:08.475 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:07:08 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:07:08.183+0000 7f8ee7cc6640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:07:08.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:08 smithi022 ceph-mon[30854]: pgmap v286: 97 pgs: 97 active+clean; 583 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.5 KiB/s wr, 15 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:08.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:08 smithi100 ceph-mon[35102]: pgmap v286: 97 pgs: 97 active+clean; 583 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.5 KiB/s wr, 15 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:08 smithi153 ceph-mon[35609]: pgmap v286: 97 pgs: 97 active+clean; 583 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.5 KiB/s wr, 15 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:09.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T08:07:09.269 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:09.638 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:09 smithi022 ceph-mon[30854]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:09.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.721+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/4053970587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e18106f10 msgr2=0x7f8e1810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:09.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.721+0000 7f8e1e0d1640 1 --2- 172.21.15.22:0/4053970587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e18106f10 0x7f8e1810ea90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009ca0 tx=0x7f8e1002a8c0 comp rx=0 tx=0).stop 2024-09-10T08:07:09.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.721+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/4053970587 shutdown_connections 2024-09-10T08:07:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.721+0000 7f8e1e0d1640 1 --2- 172.21.15.22:0/4053970587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e18106f10 0x7f8e1810ea90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.721+0000 7f8e1e0d1640 1 --2- 172.21.15.22:0/4053970587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e18102790 0x7f8e181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.721+0000 7f8e1e0d1640 1 --2- 172.21.15.22:0/4053970587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e18101de0 0x7f8e181021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.721+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/4053970587 >> 172.21.15.22:0/4053970587 conn(0x7f8e180fd8c0 msgr2=0x7f8e180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.721+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/4053970587 shutdown_connections 2024-09-10T08:07:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.721+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/4053970587 wait complete. 2024-09-10T08:07:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.722+0000 7f8e1e0d1640 1 Processor -- start 2024-09-10T08:07:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.722+0000 7f8e1e0d1640 1 -- start start 2024-09-10T08:07:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e1e0d1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e18101de0 0x7f8e18198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e1e0d1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e18102790 0x7f8e181989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e1e0d1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e18106f10 0x7f8e1819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e1e0d1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8e18111f90 con 0x7f8e18102790 2024-09-10T08:07:09.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e1e0d1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8e18111e10 con 0x7f8e18101de0 2024-09-10T08:07:09.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e1e0d1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e18112110 con 0x7f8e18106f10 2024-09-10T08:07:09.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e18102790 0x7f8e181989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:09.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e18102790 0x7f8e181989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34008/0 (socket says 172.21.15.22:34008) 2024-09-10T08:07:09.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e16ffd640 1 -- 172.21.15.22:0/1421428490 learned_addr learned my addr 172.21.15.22:0/1421428490 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:09.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e177fe640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e18101de0 0x7f8e18198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:09.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e17fff640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e18106f10 0x7f8e1819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:09.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e16ffd640 1 -- 172.21.15.22:0/1421428490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e18106f10 msgr2=0x7f8e1819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:09.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e16ffd640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e18106f10 0x7f8e1819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:09.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e16ffd640 1 -- 172.21.15.22:0/1421428490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e18101de0 msgr2=0x7f8e18198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e16ffd640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e18101de0 0x7f8e18198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e16ffd640 1 -- 172.21.15.22:0/1421428490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1819d410 con 0x7f8e18102790 2024-09-10T08:07:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.723+0000 7f8e16ffd640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e18102790 0x7f8e181989a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c890 tx=0x7f8e0c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.724+0000 7f8e14ff9640 1 -- 172.21.15.22:0/1421428490 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c004220 con 0x7f8e18102790 2024-09-10T08:07:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.724+0000 7f8e14ff9640 1 -- 172.21.15.22:0/1421428490 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e0c0043c0 con 0x7f8e18102790 2024-09-10T08:07:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.724+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/1421428490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1819d700 con 0x7f8e18102790 2024-09-10T08:07:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.724+0000 7f8e14ff9640 1 -- 172.21.15.22:0/1421428490 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c004a00 con 0x7f8e18102790 2024-09-10T08:07:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.724+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/1421428490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e181a4fe0 con 0x7f8e18102790 2024-09-10T08:07:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.725+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/1421428490 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e181021c0 con 0x7f8e18102790 2024-09-10T08:07:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.726+0000 7f8e14ff9640 1 -- 172.21.15.22:0/1421428490 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8e0c0079b0 con 0x7f8e18102790 2024-09-10T08:07:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.726+0000 7f8e14ff9640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8e000a2c10 0x7f8e000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.726+0000 7f8e177fe640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8e000a2c10 0x7f8e000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.727+0000 7f8e14ff9640 1 -- 172.21.15.22:0/1421428490 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8e0c0ceea0 con 0x7f8e18102790 2024-09-10T08:07:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.727+0000 7f8e177fe640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8e000a2c10 0x7f8e000a50d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009990 tx=0x7f8e08009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.731+0000 7f8e14ff9640 1 -- 172.21.15.22:0/1421428490 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e0c014030 con 0x7f8e18102790 2024-09-10T08:07:09.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:09 smithi100 ceph-mon[35102]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:09.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.934+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/1421428490 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8e18062630 con 0x7f8e000a2c10 2024-09-10T08:07:09.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:09 smithi153 ceph-mon[35609]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:09.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.961+0000 7f8e14ff9640 1 -- 172.21.15.22:0/1421428490 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8e18062630 con 0x7f8e000a2c10 2024-09-10T08:07:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.963+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/1421428490 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8e000a2c10 msgr2=0x7f8e000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.963+0000 7f8e1e0d1640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8e000a2c10 0x7f8e000a50d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009990 tx=0x7f8e08009110 comp rx=0 tx=0).stop 2024-09-10T08:07:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.963+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/1421428490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e18102790 msgr2=0x7f8e181989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.963+0000 7f8e1e0d1640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e18102790 0x7f8e181989a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c890 tx=0x7f8e0c00cc90 comp rx=0 tx=0).stop 2024-09-10T08:07:09.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.963+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/1421428490 shutdown_connections 2024-09-10T08:07:09.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.963+0000 7f8e1e0d1640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8e000a2c10 0x7f8e000a50d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:09.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.963+0000 7f8e1e0d1640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e18106f10 0x7f8e1819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:09.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.963+0000 7f8e1e0d1640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8e18102790 0x7f8e181989a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:09.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.963+0000 7f8e1e0d1640 1 --2- 172.21.15.22:0/1421428490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e18101de0 0x7f8e18198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:09.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.963+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/1421428490 >> 172.21.15.22:0/1421428490 conn(0x7f8e180fd8c0 msgr2=0x7f8e180fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:09.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.963+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/1421428490 shutdown_connections 2024-09-10T08:07:09.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:09.963+0000 7f8e1e0d1640 1 -- 172.21.15.22:0/1421428490 wait complete. 2024-09-10T08:07:10.682 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:10 smithi022 ceph-mon[30854]: pgmap v287: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 7.1 KiB/s wr, 28 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:10.682 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:10 smithi022 ceph-mon[30854]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T08:07:10.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T08:07:10.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:10 smithi100 ceph-mon[35102]: pgmap v287: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 7.1 KiB/s wr, 28 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:10.770 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:10 smithi100 ceph-mon[35102]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T08:07:10.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:10 smithi153 ceph-mon[35609]: pgmap v287: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 7.1 KiB/s wr, 28 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:10.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:10 smithi153 ceph-mon[35609]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T08:07:10.969 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:11.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.440+0000 7f0c30e7e640 1 -- 172.21.15.22:0/2500144288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c2c102df0 msgr2=0x7f0c2c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:11.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.440+0000 7f0c30e7e640 1 --2- 172.21.15.22:0/2500144288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c2c102df0 0x7f0c2c1031d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009900 tx=0x7f0c1c02a410 comp rx=0 tx=0).stop 2024-09-10T08:07:11.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.440+0000 7f0c30e7e640 1 -- 172.21.15.22:0/2500144288 shutdown_connections 2024-09-10T08:07:11.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.440+0000 7f0c30e7e640 1 --2- 172.21.15.22:0/2500144288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c2c10c2f0 0x7f0c2c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:11.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.440+0000 7f0c30e7e640 1 --2- 172.21.15.22:0/2500144288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c2c1037a0 0x7f0c2c10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:11.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.440+0000 7f0c30e7e640 1 --2- 172.21.15.22:0/2500144288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c2c102df0 0x7f0c2c1031d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:11.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.440+0000 7f0c30e7e640 1 -- 172.21.15.22:0/2500144288 >> 172.21.15.22:0/2500144288 conn(0x7f0c2c0fc7d0 msgr2=0x7f0c2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:11.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.440+0000 7f0c30e7e640 1 -- 172.21.15.22:0/2500144288 shutdown_connections 2024-09-10T08:07:11.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.440+0000 7f0c30e7e640 1 -- 172.21.15.22:0/2500144288 wait complete. 2024-09-10T08:07:11.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.441+0000 7f0c30e7e640 1 Processor -- start 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.441+0000 7f0c30e7e640 1 -- start start 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.441+0000 7f0c30e7e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c2c102df0 0x7f0c2c100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.441+0000 7f0c30e7e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c2c1037a0 0x7f0c2c100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.441+0000 7f0c30e7e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c2c10c2f0 0x7f0c2c1014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.441+0000 7f0c30e7e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c112140 con 0x7f0c2c10c2f0 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.441+0000 7f0c30e7e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c111fc0 con 0x7f0c2c102df0 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.441+0000 7f0c30e7e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c1122c0 con 0x7f0c2c1037a0 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.441+0000 7f0c2ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c2c10c2f0 0x7f0c2c1014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.441+0000 7f0c2ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c2c10c2f0 0x7f0c2c1014d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34022/0 (socket says 172.21.15.22:34022) 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.441+0000 7f0c2ad9d640 1 -- 172.21.15.22:0/1577713322 learned_addr learned my addr 172.21.15.22:0/1577713322 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c23fff640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c2c1037a0 0x7f0c2c100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c2a59c640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c2c102df0 0x7f0c2c100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:11.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c2ad9d640 1 -- 172.21.15.22:0/1577713322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c2c1037a0 msgr2=0x7f0c2c100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c2ad9d640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c2c1037a0 0x7f0c2c100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c2ad9d640 1 -- 172.21.15.22:0/1577713322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c2c102df0 msgr2=0x7f0c2c100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c2ad9d640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c2c102df0 0x7f0c2c100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c2ad9d640 1 -- 172.21.15.22:0/1577713322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c1a6ac0 con 0x7f0c2c10c2f0 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c2ad9d640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c2c10c2f0 0x7f0c2c1014d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400eaa0 tx=0x7f0c2400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c237fe640 1 -- 172.21.15.22:0/1577713322 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2400cdb0 con 0x7f0c2c10c2f0 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c30e7e640 1 -- 172.21.15.22:0/1577713322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c1a6db0 con 0x7f0c2c10c2f0 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c237fe640 1 -- 172.21.15.22:0/1577713322 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c24005020 con 0x7f0c2c10c2f0 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c237fe640 1 -- 172.21.15.22:0/1577713322 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c240116b0 con 0x7f0c2c10c2f0 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.442+0000 7f0c30e7e640 1 -- 172.21.15.22:0/1577713322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c1a72c0 con 0x7f0c2c10c2f0 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.443+0000 7f0c30e7e640 1 -- 172.21.15.22:0/1577713322 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c06a790 con 0x7f0c2c10c2f0 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.444+0000 7f0c237fe640 1 -- 172.21.15.22:0/1577713322 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0c24005560 con 0x7f0c2c10c2f0 2024-09-10T08:07:11.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.445+0000 7f0c237fe640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0c180a2c10 0x7f0c180a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:11.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.445+0000 7f0c2a59c640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0c180a2c10 0x7f0c180a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:11.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.445+0000 7f0c237fe640 1 -- 172.21.15.22:0/1577713322 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f0c240cf340 con 0x7f0c2c10c2f0 2024-09-10T08:07:11.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.445+0000 7f0c2a59c640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0c180a2c10 0x7f0c180a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c000c00 tx=0x7f0c1c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:11.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.449+0000 7f0c237fe640 1 -- 172.21.15.22:0/1577713322 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c24016030 con 0x7f0c2c10c2f0 2024-09-10T08:07:11.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.656+0000 7f0c30e7e640 1 -- 172.21.15.22:0/1577713322 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f0c2c062630 con 0x7f0c180a2c10 2024-09-10T08:07:11.656 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:11 smithi022 ceph-mon[30854]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:11.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.661+0000 7f0c237fe640 1 -- 172.21.15.22:0/1577713322 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0c2c062630 con 0x7f0c180a2c10 2024-09-10T08:07:11.660 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/qa/sv_0/64bfc571-de0d-4a2a-b314-6c1c54400f4a 2024-09-10T08:07:11.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.663+0000 7f0c30e7e640 1 -- 172.21.15.22:0/1577713322 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0c180a2c10 msgr2=0x7f0c180a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:11.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.663+0000 7f0c30e7e640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0c180a2c10 0x7f0c180a50d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c000c00 tx=0x7f0c1c005b50 comp rx=0 tx=0).stop 2024-09-10T08:07:11.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.663+0000 7f0c30e7e640 1 -- 172.21.15.22:0/1577713322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c2c10c2f0 msgr2=0x7f0c2c1014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:11.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.663+0000 7f0c30e7e640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c2c10c2f0 0x7f0c2c1014d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400eaa0 tx=0x7f0c2400ef60 comp rx=0 tx=0).stop 2024-09-10T08:07:11.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.663+0000 7f0c30e7e640 1 -- 172.21.15.22:0/1577713322 shutdown_connections 2024-09-10T08:07:11.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.663+0000 7f0c30e7e640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0c180a2c10 0x7f0c180a50d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:11.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.663+0000 7f0c30e7e640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c2c10c2f0 0x7f0c2c1014d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:11.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.663+0000 7f0c30e7e640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c2c1037a0 0x7f0c2c100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:11.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.663+0000 7f0c30e7e640 1 --2- 172.21.15.22:0/1577713322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c2c102df0 0x7f0c2c100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:11.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.663+0000 7f0c30e7e640 1 -- 172.21.15.22:0/1577713322 >> 172.21.15.22:0/1577713322 conn(0x7f0c2c0fc7d0 msgr2=0x7f0c2c0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:11.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.663+0000 7f0c30e7e640 1 -- 172.21.15.22:0/1577713322 shutdown_connections 2024-09-10T08:07:11.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:11.663+0000 7f0c30e7e640 1 -- 172.21.15.22:0/1577713322 wait complete. 2024-09-10T08:07:11.793 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:11 smithi100 ceph-mon[35102]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:11.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:11 smithi153 ceph-mon[35609]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:12.468 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T08:07:12.731 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:12.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:12 smithi022 ceph-mon[30854]: pgmap v288: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.0 KiB/s wr, 25 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:12.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:12 smithi022 ceph-mon[30854]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:12.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:12 smithi100 ceph-mon[35102]: pgmap v288: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.0 KiB/s wr, 25 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:12.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:12 smithi100 ceph-mon[35102]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:12.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:12 smithi153 ceph-mon[35609]: pgmap v288: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 6.0 KiB/s wr, 25 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:12.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:12 smithi153 ceph-mon[35609]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.234+0000 7faa9cf60640 1 -- 172.21.15.22:0/3940947394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa98106c30 msgr2=0x7faa98107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.234+0000 7faa9cf60640 1 --2- 172.21.15.22:0/3940947394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa98106c30 0x7faa98107010 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faa88009900 tx=0x7faa8802a410 comp rx=0 tx=0).stop 2024-09-10T08:07:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.234+0000 7faa9cf60640 1 -- 172.21.15.22:0/3940947394 shutdown_connections 2024-09-10T08:07:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.234+0000 7faa9cf60640 1 --2- 172.21.15.22:0/3940947394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa98101b40 0x7faa9810da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.234+0000 7faa9cf60640 1 --2- 172.21.15.22:0/3940947394 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa981011a0 0x7faa98101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.234+0000 7faa9cf60640 1 --2- 172.21.15.22:0/3940947394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa98106c30 0x7faa98107010 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.234+0000 7faa9cf60640 1 -- 172.21.15.22:0/3940947394 >> 172.21.15.22:0/3940947394 conn(0x7faa98077210 msgr2=0x7faa980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.234+0000 7faa9cf60640 1 -- 172.21.15.22:0/3940947394 shutdown_connections 2024-09-10T08:07:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.234+0000 7faa9cf60640 1 -- 172.21.15.22:0/3940947394 wait complete. 2024-09-10T08:07:13.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.235+0000 7faa9cf60640 1 Processor -- start 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.235+0000 7faa9cf60640 1 -- start start 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.235+0000 7faa9cf60640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa981011a0 0x7faa981985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.235+0000 7faa9cf60640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa98101b40 0x7faa98198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.235+0000 7faa9cf60640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa98106c30 0x7faa9819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.235+0000 7faa9cf60640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa98110fc0 con 0x7faa98101b40 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.235+0000 7faa9cf60640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faa98110e40 con 0x7faa981011a0 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.235+0000 7faa9cf60640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faa98111140 con 0x7faa98106c30 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.235+0000 7faa8ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa98101b40 0x7faa98198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.235+0000 7faa9659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa981011a0 0x7faa981985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.235+0000 7faa8ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa98101b40 0x7faa98198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34030/0 (socket says 172.21.15.22:34030) 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.235+0000 7faa8ffff640 1 -- 172.21.15.22:0/2427151711 learned_addr learned my addr 172.21.15.22:0/2427151711 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.236+0000 7faa96d9d640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa98106c30 0x7faa9819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:13.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.236+0000 7faa8ffff640 1 -- 172.21.15.22:0/2427151711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa98106c30 msgr2=0x7faa9819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.236+0000 7faa8ffff640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa98106c30 0x7faa9819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.236+0000 7faa8ffff640 1 -- 172.21.15.22:0/2427151711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa981011a0 msgr2=0x7faa981985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.236+0000 7faa8ffff640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa981011a0 0x7faa981985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.236+0000 7faa8ffff640 1 -- 172.21.15.22:0/2427151711 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9819d5a0 con 0x7faa98101b40 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.236+0000 7faa8ffff640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa98101b40 0x7faa98198b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa8000b4a0 tx=0x7faa8000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.236+0000 7faa8f7fe640 1 -- 172.21.15.22:0/2427151711 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80014070 con 0x7faa98101b40 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.236+0000 7faa9cf60640 1 -- 172.21.15.22:0/2427151711 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9819d890 con 0x7faa98101b40 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.236+0000 7faa8f7fe640 1 -- 172.21.15.22:0/2427151711 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa80010af0 con 0x7faa98101b40 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.236+0000 7faa8f7fe640 1 -- 172.21.15.22:0/2427151711 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80017d10 con 0x7faa98101b40 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.236+0000 7faa9cf60640 1 -- 172.21.15.22:0/2427151711 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa981a5170 con 0x7faa98101b40 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.237+0000 7faa9cf60640 1 -- 172.21.15.22:0/2427151711 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa98101600 con 0x7faa98101b40 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.238+0000 7faa8f7fe640 1 -- 172.21.15.22:0/2427151711 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7faa80017070 con 0x7faa98101b40 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.239+0000 7faa8f7fe640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7faa840a2c10 0x7faa840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:13.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.239+0000 7faa9659c640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7faa840a2c10 0x7faa840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:13.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.240+0000 7faa8f7fe640 1 -- 172.21.15.22:0/2427151711 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7faa800ce540 con 0x7faa98101b40 2024-09-10T08:07:13.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.240+0000 7faa9659c640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7faa840a2c10 0x7faa840a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faa88009230 tx=0x7faa880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:13.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.244+0000 7faa8f7fe640 1 -- 172.21.15.22:0/2427151711 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa8009b410 con 0x7faa98101b40 2024-09-10T08:07:13.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.449+0000 7faa9cf60640 1 -- 172.21.15.22:0/2427151711 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7faa98104830 con 0x7faa840a2c10 2024-09-10T08:07:13.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.473+0000 7faa8f7fe640 1 -- 172.21.15.22:0/2427151711 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faa98104830 con 0x7faa840a2c10 2024-09-10T08:07:13.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.475+0000 7faa9cf60640 1 -- 172.21.15.22:0/2427151711 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7faa840a2c10 msgr2=0x7faa840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:13.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.475+0000 7faa9cf60640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7faa840a2c10 0x7faa840a50d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faa88009230 tx=0x7faa880058d0 comp rx=0 tx=0).stop 2024-09-10T08:07:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.475+0000 7faa9cf60640 1 -- 172.21.15.22:0/2427151711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa98101b40 msgr2=0x7faa98198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.475+0000 7faa9cf60640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa98101b40 0x7faa98198b30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7faa8000b4a0 tx=0x7faa8000b960 comp rx=0 tx=0).stop 2024-09-10T08:07:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.475+0000 7faa9cf60640 1 -- 172.21.15.22:0/2427151711 shutdown_connections 2024-09-10T08:07:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.475+0000 7faa9cf60640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7faa840a2c10 0x7faa840a50d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.475+0000 7faa9cf60640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa98106c30 0x7faa9819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.475+0000 7faa9cf60640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa98101b40 0x7faa98198b30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.475+0000 7faa9cf60640 1 --2- 172.21.15.22:0/2427151711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa981011a0 0x7faa981985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.475+0000 7faa9cf60640 1 -- 172.21.15.22:0/2427151711 >> 172.21.15.22:0/2427151711 conn(0x7faa98077210 msgr2=0x7faa98100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.475+0000 7faa9cf60640 1 -- 172.21.15.22:0/2427151711 shutdown_connections 2024-09-10T08:07:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:13.475+0000 7faa9cf60640 1 -- 172.21.15.22:0/2427151711 wait complete. 2024-09-10T08:07:14.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T08:07:14.367 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:14.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:14 smithi022 ceph-mon[30854]: pgmap v289: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.6 KiB/s wr, 24 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:14.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:14 smithi022 ceph-mon[30854]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:14.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:14 smithi100 ceph-mon[35102]: pgmap v289: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.6 KiB/s wr, 24 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:14.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:14 smithi100 ceph-mon[35102]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:14.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.867+0000 7fef99723640 1 -- 172.21.15.22:0/3760852164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef94102ef0 msgr2=0x7fef9410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:14.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.867+0000 7fef99723640 1 --2- 172.21.15.22:0/3760852164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef94102ef0 0x7fef9410da40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fef8c009900 tx=0x7fef8c02a480 comp rx=0 tx=0).stop 2024-09-10T08:07:14.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.867+0000 7fef99723640 1 -- 172.21.15.22:0/3760852164 shutdown_connections 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.867+0000 7fef99723640 1 --2- 172.21.15.22:0/3760852164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef94102ef0 0x7fef9410da40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.867+0000 7fef99723640 1 --2- 172.21.15.22:0/3760852164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef94102570 0x7fef941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.867+0000 7fef99723640 1 --2- 172.21.15.22:0/3760852164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef94100e20 0x7fef94101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.867+0000 7fef99723640 1 -- 172.21.15.22:0/3760852164 >> 172.21.15.22:0/3760852164 conn(0x7fef940fc7d0 msgr2=0x7fef940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.867+0000 7fef99723640 1 -- 172.21.15.22:0/3760852164 shutdown_connections 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.867+0000 7fef99723640 1 -- 172.21.15.22:0/3760852164 wait complete. 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.868+0000 7fef99723640 1 Processor -- start 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.868+0000 7fef99723640 1 -- start start 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.868+0000 7fef99723640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef94100e20 0x7fef941984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.868+0000 7fef99723640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef94102570 0x7fef941989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.868+0000 7fef99723640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef94102ef0 0x7fef9419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.868+0000 7fef99723640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fef94110fa0 con 0x7fef94102570 2024-09-10T08:07:14.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.868+0000 7fef99723640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef94110e20 con 0x7fef94100e20 2024-09-10T08:07:14.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.868+0000 7fef99723640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fef94111120 con 0x7fef94102ef0 2024-09-10T08:07:14.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.868+0000 7fef927fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef94102570 0x7fef941989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:14.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.868+0000 7fef927fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef94102570 0x7fef941989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41378/0 (socket says 172.21.15.22:41378) 2024-09-10T08:07:14.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.868+0000 7fef927fc640 1 -- 172.21.15.22:0/282515784 learned_addr learned my addr 172.21.15.22:0/282515784 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:14.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef927fc640 1 -- 172.21.15.22:0/282515784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef94102ef0 msgr2=0x7fef9419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:14.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef937fe640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef94102ef0 0x7fef9419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:14.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef92ffd640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef94100e20 0x7fef941984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:14.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef927fc640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef94102ef0 0x7fef9419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:14.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef927fc640 1 -- 172.21.15.22:0/282515784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef94100e20 msgr2=0x7fef941984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:14.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef927fc640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef94100e20 0x7fef941984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef927fc640 1 -- 172.21.15.22:0/282515784 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9419d460 con 0x7fef94102570 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef92ffd640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef94100e20 0x7fef941984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef927fc640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef94102570 0x7fef941989f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fef8800eab0 tx=0x7fef8800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef7bfff640 1 -- 172.21.15.22:0/282515784 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8800ce40 con 0x7fef94102570 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef99723640 1 -- 172.21.15.22:0/282515784 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef9419d750 con 0x7fef94102570 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef7bfff640 1 -- 172.21.15.22:0/282515784 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef88011950 con 0x7fef94102570 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef7bfff640 1 -- 172.21.15.22:0/282515784 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef88010ae0 con 0x7fef94102570 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.869+0000 7fef99723640 1 -- 172.21.15.22:0/282515784 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef941a5030 con 0x7fef94102570 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.870+0000 7fef99723640 1 -- 172.21.15.22:0/282515784 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef94101200 con 0x7fef94102570 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.871+0000 7fef7bfff640 1 -- 172.21.15.22:0/282515784 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fef88011b00 con 0x7fef94102570 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.872+0000 7fef7bfff640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fef7c0a2c10 0x7fef7c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.872+0000 7fef92ffd640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fef7c0a2c10 0x7fef7c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.872+0000 7fef7bfff640 1 -- 172.21.15.22:0/282515784 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fef880cf9c0 con 0x7fef94102570 2024-09-10T08:07:14.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.872+0000 7fef92ffd640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fef7c0a2c10 0x7fef7c0a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fef84006fd0 tx=0x7fef84008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:14.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:14.876+0000 7fef7bfff640 1 -- 172.21.15.22:0/282515784 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef88016030 con 0x7fef94102570 2024-09-10T08:07:14.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:14 smithi153 ceph-mon[35609]: pgmap v289: 97 pgs: 97 active+clean; 591 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.6 KiB/s wr, 24 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T08:07:14.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:14 smithi153 ceph-mon[35609]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:15.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.080+0000 7fef99723640 1 -- 172.21.15.22:0/282515784 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fef94062630 con 0x7fef7c0a2c10 2024-09-10T08:07:15.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.085+0000 7fef7bfff640 1 -- 172.21.15.22:0/282515784 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fef94062630 con 0x7fef7c0a2c10 2024-09-10T08:07:15.084 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/qa/sv_1/ed8de887-cb34-4648-b138-9c2b0ae19cf9 2024-09-10T08:07:15.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.087+0000 7fef99723640 1 -- 172.21.15.22:0/282515784 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fef7c0a2c10 msgr2=0x7fef7c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:15.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.087+0000 7fef99723640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fef7c0a2c10 0x7fef7c0a50d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fef84006fd0 tx=0x7fef84008040 comp rx=0 tx=0).stop 2024-09-10T08:07:15.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.087+0000 7fef99723640 1 -- 172.21.15.22:0/282515784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef94102570 msgr2=0x7fef941989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:15.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.087+0000 7fef99723640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef94102570 0x7fef941989f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fef8800eab0 tx=0x7fef8800ef70 comp rx=0 tx=0).stop 2024-09-10T08:07:15.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.087+0000 7fef99723640 1 -- 172.21.15.22:0/282515784 shutdown_connections 2024-09-10T08:07:15.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.087+0000 7fef99723640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fef7c0a2c10 0x7fef7c0a50d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:15.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.087+0000 7fef99723640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef94102ef0 0x7fef9419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:15.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.087+0000 7fef99723640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef94102570 0x7fef941989f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:15.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.087+0000 7fef99723640 1 --2- 172.21.15.22:0/282515784 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef94100e20 0x7fef941984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:15.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.087+0000 7fef99723640 1 -- 172.21.15.22:0/282515784 >> 172.21.15.22:0/282515784 conn(0x7fef940fc7d0 msgr2=0x7fef9406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:15.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.087+0000 7fef99723640 1 -- 172.21.15.22:0/282515784 shutdown_connections 2024-09-10T08:07:15.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:15.087+0000 7fef99723640 1 -- 172.21.15.22:0/282515784 wait complete. 2024-09-10T08:07:15.815 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:07:16.075 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:16.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.572+0000 7f5717fae640 1 -- 172.21.15.22:0/1429486504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5710102d30 msgr2=0x7f5710103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.572+0000 7f5717fae640 1 --2- 172.21.15.22:0/1429486504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5710102d30 0x7f5710103110 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f570c009930 tx=0x7f570c02a440 comp rx=0 tx=0).stop 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.572+0000 7f5717fae640 1 -- 172.21.15.22:0/1429486504 shutdown_connections 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.572+0000 7f5717fae640 1 --2- 172.21.15.22:0/1429486504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57101082a0 0x7f571010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.572+0000 7f5717fae640 1 --2- 172.21.15.22:0/1429486504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57101036e0 0x7f5710107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.572+0000 7f5717fae640 1 --2- 172.21.15.22:0/1429486504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5710102d30 0x7f5710103110 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.572+0000 7f5717fae640 1 -- 172.21.15.22:0/1429486504 >> 172.21.15.22:0/1429486504 conn(0x7f57100fc7d0 msgr2=0x7f57100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.572+0000 7f5717fae640 1 -- 172.21.15.22:0/1429486504 shutdown_connections 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.572+0000 7f5717fae640 1 -- 172.21.15.22:0/1429486504 wait complete. 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.573+0000 7f5717fae640 1 Processor -- start 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.573+0000 7f5717fae640 1 -- start start 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.573+0000 7f5717fae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5710102d30 0x7f57101985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.573+0000 7f5717fae640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57101036e0 0x7f5710198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:16.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.573+0000 7f5717fae640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57101082a0 0x7f571019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.573+0000 7f5717fae640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57101120e0 con 0x7f57101036e0 2024-09-10T08:07:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.573+0000 7f5717fae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5710111f60 con 0x7f5710102d30 2024-09-10T08:07:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.573+0000 7f5717fae640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5710112260 con 0x7f57101082a0 2024-09-10T08:07:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.573+0000 7f5715549640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57101036e0 0x7f5710198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.573+0000 7f5715549640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57101036e0 0x7f5710198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41400/0 (socket says 172.21.15.22:41400) 2024-09-10T08:07:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.573+0000 7f5715549640 1 -- 172.21.15.22:0/2494421854 learned_addr learned my addr 172.21.15.22:0/2494421854 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.573+0000 7f5715d4a640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5710102d30 0x7f57101985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.574+0000 7f5715549640 1 -- 172.21.15.22:0/2494421854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57101082a0 msgr2=0x7f571019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.574+0000 7f5715549640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57101082a0 0x7f571019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.574+0000 7f5715549640 1 -- 172.21.15.22:0/2494421854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5710102d30 msgr2=0x7f57101985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.574+0000 7f5715549640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5710102d30 0x7f57101985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:16.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.574+0000 7f5715549640 1 -- 172.21.15.22:0/2494421854 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571019d560 con 0x7f57101036e0 2024-09-10T08:07:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.574+0000 7f5715549640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57101036e0 0x7f5710198af0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5700006fd0 tx=0x7f570000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.574+0000 7f5706ffd640 1 -- 172.21.15.22:0/2494421854 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700011830 con 0x7f57101036e0 2024-09-10T08:07:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.574+0000 7f5706ffd640 1 -- 172.21.15.22:0/2494421854 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5700016070 con 0x7f57101036e0 2024-09-10T08:07:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.574+0000 7f5717fae640 1 -- 172.21.15.22:0/2494421854 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571019d850 con 0x7f57101036e0 2024-09-10T08:07:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.574+0000 7f5706ffd640 1 -- 172.21.15.22:0/2494421854 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570000f2e0 con 0x7f57101036e0 2024-09-10T08:07:16.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.574+0000 7f5717fae640 1 -- 172.21.15.22:0/2494421854 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57101a5130 con 0x7f57101036e0 2024-09-10T08:07:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.575+0000 7f5717fae640 1 -- 172.21.15.22:0/2494421854 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f571006a850 con 0x7f57101036e0 2024-09-10T08:07:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.577+0000 7f5706ffd640 1 -- 172.21.15.22:0/2494421854 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f57000119d0 con 0x7f57101036e0 2024-09-10T08:07:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.577+0000 7f5706ffd640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f56fc0a2c10 0x7f56fc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.578+0000 7f5715d4a640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f56fc0a2c10 0x7f56fc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.578+0000 7f5706ffd640 1 -- 172.21.15.22:0/2494421854 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f57000cee30 con 0x7f57101036e0 2024-09-10T08:07:16.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.578+0000 7f5715d4a640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f56fc0a2c10 0x7f56fc0a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f570c009900 tx=0x7f570c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:16.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.581+0000 7f5706ffd640 1 -- 172.21.15.22:0/2494421854 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f570009bd00 con 0x7f57101036e0 2024-09-10T08:07:16.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:16 smithi153 ceph-mon[35609]: pgmap v290: 97 pgs: 97 active+clean; 605 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.1 KiB/s wr, 24 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T08:07:16.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:16 smithi153 ceph-mon[35609]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:16.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:16 smithi022 ceph-mon[30854]: pgmap v290: 97 pgs: 97 active+clean; 605 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.1 KiB/s wr, 24 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T08:07:16.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:16 smithi022 ceph-mon[30854]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:16.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.793+0000 7f5717fae640 1 -- 172.21.15.22:0/2494421854 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5710103110 con 0x7f57101036e0 2024-09-10T08:07:16.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.794+0000 7f5706ffd640 1 -- 172.21.15.22:0/2494421854 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11963 (secure 0 0 0) 0x7f5710103110 con 0x7f57101036e0 2024-09-10T08:07:16.793 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:07:16.794 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"btime":"2024-09-10T08:07:06:469020+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:06:54.609910+0000","modified":"2024-09-10T08:07:06.044085+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24512,"mds_1":24479,"mds_2":24469,"mds_3":24455,"mds_4":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/896927555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":896927555},{"type":"v1","addr":"172.21.15.22:6839","nonce":896927555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14622":{"gid":14622,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.22:6841/969125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":969125},{"type":"v1","addr":"172.21.15.22:6841","nonce":969125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/2417436521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2417436521},{"type":"v1","addr":"172.21.15.153:6837","nonce":2417436521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/1766856743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1766856743},{"type":"v1","addr":"172.21.15.153:6839","nonce":1766856743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/1987693702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1987693702},{"type":"v1","addr":"172.21.15.100:6837","nonce":1987693702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/2512683674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":2512683674},{"type":"v1","addr":"172.21.15.100:6839","nonce":2512683674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24512,"qdb_cluster":[14622,24455,24469,24479,24512]},"id":1}]} 2024-09-10T08:07:16.794 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-10T08:07:16.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.796+0000 7f5717fae640 1 -- 172.21.15.22:0/2494421854 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f56fc0a2c10 msgr2=0x7f56fc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:16.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.796+0000 7f5717fae640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f56fc0a2c10 0x7f56fc0a50d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f570c009900 tx=0x7f570c0058d0 comp rx=0 tx=0).stop 2024-09-10T08:07:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.796+0000 7f5717fae640 1 -- 172.21.15.22:0/2494421854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57101036e0 msgr2=0x7f5710198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.796+0000 7f5717fae640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57101036e0 0x7f5710198af0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5700006fd0 tx=0x7f570000b8e0 comp rx=0 tx=0).stop 2024-09-10T08:07:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.796+0000 7f5717fae640 1 -- 172.21.15.22:0/2494421854 shutdown_connections 2024-09-10T08:07:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.796+0000 7f5717fae640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f56fc0a2c10 0x7f56fc0a50d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.796+0000 7f5717fae640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57101082a0 0x7f571019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.796+0000 7f5717fae640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57101036e0 0x7f5710198af0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.796+0000 7f5717fae640 1 --2- 172.21.15.22:0/2494421854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5710102d30 0x7f57101985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.796+0000 7f5717fae640 1 -- 172.21.15.22:0/2494421854 >> 172.21.15.22:0/2494421854 conn(0x7f57100fc7d0 msgr2=0x7f5710105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.796+0000 7f5717fae640 1 -- 172.21.15.22:0/2494421854 shutdown_connections 2024-09-10T08:07:16.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:16.796+0000 7f5717fae640 1 -- 172.21.15.22:0/2494421854 wait complete. 2024-09-10T08:07:16.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:16 smithi100 ceph-mon[35102]: pgmap v290: 97 pgs: 97 active+clean; 605 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.1 KiB/s wr, 24 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T08:07:16.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:16 smithi100 ceph-mon[35102]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:07:17.450 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T08:07:17.705 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:17.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:17 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2494421854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:07:17.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:17 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2494421854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:07:17.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:17 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2494421854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:07:18.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.198+0000 7fdb7918d640 1 -- 172.21.15.22:0/1557502837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb74101420 msgr2=0x7fdb7410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:18.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.198+0000 7fdb7918d640 1 --2- 172.21.15.22:0/1557502837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb74101420 0x7fdb7410d950 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c009cd0 tx=0x7fdb6c02a8e0 comp rx=0 tx=0).stop 2024-09-10T08:07:18.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.198+0000 7fdb7918d640 1 -- 172.21.15.22:0/1557502837 shutdown_connections 2024-09-10T08:07:18.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.198+0000 7fdb7918d640 1 --2- 172.21.15.22:0/1557502837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb74101420 0x7fdb7410d950 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:18.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.198+0000 7fdb7918d640 1 --2- 172.21.15.22:0/1557502837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb74100a80 0x7fdb74100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:18.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.198+0000 7fdb7918d640 1 --2- 172.21.15.22:0/1557502837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74106a80 0x7fdb74106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:18.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.198+0000 7fdb7918d640 1 -- 172.21.15.22:0/1557502837 >> 172.21.15.22:0/1557502837 conn(0x7fdb740fc7a0 msgr2=0x7fdb740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:18.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.198+0000 7fdb7918d640 1 -- 172.21.15.22:0/1557502837 shutdown_connections 2024-09-10T08:07:18.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.198+0000 7fdb7918d640 1 -- 172.21.15.22:0/1557502837 wait complete. 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.199+0000 7fdb7918d640 1 Processor -- start 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.199+0000 7fdb7918d640 1 -- start start 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.199+0000 7fdb7918d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74100a80 0x7fdb74197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.199+0000 7fdb7918d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb74101420 0x7fdb74197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.199+0000 7fdb7918d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb74106a80 0x7fdb7419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.199+0000 7fdb7918d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdb74110ea0 con 0x7fdb74101420 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.199+0000 7fdb7918d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdb74110d20 con 0x7fdb74100a80 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.199+0000 7fdb7918d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb74111020 con 0x7fdb74106a80 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.199+0000 7fdb6bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb74101420 0x7fdb74197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.199+0000 7fdb6bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb74101420 0x7fdb74197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41422/0 (socket says 172.21.15.22:41422) 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.199+0000 7fdb6bfff640 1 -- 172.21.15.22:0/462692530 learned_addr learned my addr 172.21.15.22:0/462692530 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.199+0000 7fdb72d9d640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74100a80 0x7fdb74197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:18.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.200+0000 7fdb7359e640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb74106a80 0x7fdb7419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.200+0000 7fdb6bfff640 1 -- 172.21.15.22:0/462692530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb74106a80 msgr2=0x7fdb7419bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.200+0000 7fdb6bfff640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb74106a80 0x7fdb7419bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.200+0000 7fdb6bfff640 1 -- 172.21.15.22:0/462692530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74100a80 msgr2=0x7fdb74197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.200+0000 7fdb6bfff640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74100a80 0x7fdb74197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.200+0000 7fdb6bfff640 1 -- 172.21.15.22:0/462692530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7419c2d0 con 0x7fdb74101420 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.200+0000 7fdb6bfff640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb74101420 0x7fdb74197860 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00b4a0 tx=0x7fdb5c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.200+0000 7fdb70d99640 1 -- 172.21.15.22:0/462692530 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c014070 con 0x7fdb74101420 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.200+0000 7fdb70d99640 1 -- 172.21.15.22:0/462692530 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb5c010af0 con 0x7fdb74101420 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.200+0000 7fdb7918d640 1 -- 172.21.15.22:0/462692530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7419c5c0 con 0x7fdb74101420 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.200+0000 7fdb70d99640 1 -- 172.21.15.22:0/462692530 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c017d10 con 0x7fdb74101420 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.200+0000 7fdb7918d640 1 -- 172.21.15.22:0/462692530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb741a3ea0 con 0x7fdb74101420 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.201+0000 7fdb7918d640 1 -- 172.21.15.22:0/462692530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb74100ee0 con 0x7fdb74101420 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.202+0000 7fdb70d99640 1 -- 172.21.15.22:0/462692530 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdb5c017070 con 0x7fdb74101420 2024-09-10T08:07:18.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.203+0000 7fdb70d99640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdb600a2c10 0x7fdb600a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:18.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.203+0000 7fdb70d99640 1 -- 172.21.15.22:0/462692530 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fdb5c0ce500 con 0x7fdb74101420 2024-09-10T08:07:18.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.203+0000 7fdb72d9d640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdb600a2c10 0x7fdb600a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:18.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.203+0000 7fdb72d9d640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdb600a2c10 0x7fdb600a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400bbe0 tx=0x7fdb6400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:18.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.207+0000 7fdb70d99640 1 -- 172.21.15.22:0/462692530 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb5c09b410 con 0x7fdb74101420 2024-09-10T08:07:18.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.384+0000 7fdb7918d640 1 -- 172.21.15.22:0/462692530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb741a4140 con 0x7fdb74101420 2024-09-10T08:07:18.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.385+0000 7fdb70d99640 1 -- 172.21.15.22:0/462692530 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22791 (secure 0 0 0) 0x7fdb5c09ad10 con 0x7fdb74101420 2024-09-10T08:07:18.385 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:07:18.385 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":83,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","created":"2024-09-10T07:59:04.704048+0000","modified":"2024-09-10T08:07:02.403174+0000","last_up_change":"2024-09-10T08:06:02.535944+0000","last_in_change":"2024-09-10T08:05:39.070554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:02:15.371265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:06:50.358155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:06:52.896201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d296bd3-28a7-418c-ad73-343a5e806cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6803","nonce":4248555152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6805","nonce":4248555152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6809","nonce":4248555152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6807","nonce":4248555152}]},"public_addr":"172.21.15.22:6803/4248555152","cluster_addr":"172.21.15.22:6805/4248555152","heartbeat_back_addr":"172.21.15.22:6809/4248555152","heartbeat_front_addr":"172.21.15.22:6807/4248555152","state":["exists","up"]},{"osd":1,"uuid":"c1e2b40e-b4ab-475a-8a9e-c67409f46b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6801","nonce":2078646052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6803","nonce":2078646052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6807","nonce":2078646052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6805","nonce":2078646052}]},"public_addr":"172.21.15.100:6801/2078646052","cluster_addr":"172.21.15.100:6803/2078646052","heartbeat_back_addr":"172.21.15.100:6807/2078646052","heartbeat_front_addr":"172.21.15.100:6805/2078646052","state":["exists","up"]},{"osd":2,"uuid":"be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6801","nonce":2492419476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6803","nonce":2492419476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6807","nonce":2492419476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6805","nonce":2492419476}]},"public_addr":"172.21.15.153:6801/2492419476","cluster_addr":"172.21.15.153:6803/2492419476","heartbeat_back_addr":"172.21.15.153:6807/2492419476","heartbeat_front_addr":"172.21.15.153:6805/2492419476","state":["exists","up"]},{"osd":3,"uuid":"e980a3ba-c659-4473-9633-9cbe88296d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6811","nonce":3674495276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6813","nonce":3674495276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6817","nonce":3674495276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6815","nonce":3674495276}]},"public_addr":"172.21.15.22:6811/3674495276","cluster_addr":"172.21.15.22:6813/3674495276","heartbeat_back_addr":"172.21.15.22:6817/3674495276","heartbeat_front_addr":"172.21.15.22:6815/3674495276","state":["exists","up"]},{"osd":4,"uuid":"b37d0590-99b1-4566-96b4-9936890d4308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6809","nonce":3886932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6811","nonce":3886932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6815","nonce":3886932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6813","nonce":3886932513}]},"public_addr":"172.21.15.100:6809/3886932513","cluster_addr":"172.21.15.100:6811/3886932513","heartbeat_back_addr":"172.21.15.100:6815/3886932513","heartbeat_front_addr":"172.21.15.100:6813/3886932513","state":["exists","up"]},{"osd":5,"uuid":"6cb989a0-80a1-4a9a-8b45-51b47772b203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6809","nonce":120732073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6811","nonce":120732073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6815","nonce":120732073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6813","nonce":120732073}]},"public_addr":"172.21.15.153:6809/120732073","cluster_addr":"172.21.15.153:6811/120732073","heartbeat_back_addr":"172.21.15.153:6815/120732073","heartbeat_front_addr":"172.21.15.153:6813/120732073","state":["exists","up"]},{"osd":6,"uuid":"294887f3-3e58-4b02-884d-4e0a70a86d16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6819","nonce":3692536487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6821","nonce":3692536487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6825","nonce":3692536487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6823","nonce":3692536487}]},"public_addr":"172.21.15.22:6819/3692536487","cluster_addr":"172.21.15.22:6821/3692536487","heartbeat_back_addr":"172.21.15.22:6825/3692536487","heartbeat_front_addr":"172.21.15.22:6823/3692536487","state":["exists","up"]},{"osd":7,"uuid":"d0c0ec61-4055-46f3-a4b0-39f04c735452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6817","nonce":1221175921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6819","nonce":1221175921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6823","nonce":1221175921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6821","nonce":1221175921}]},"public_addr":"172.21.15.100:6817/1221175921","cluster_addr":"172.21.15.100:6819/1221175921","heartbeat_back_addr":"172.21.15.100:6823/1221175921","heartbeat_front_addr":"172.21.15.100:6821/1221175921","state":["exists","up"]},{"osd":8,"uuid":"bda45a16-742e-4eda-b4d4-e01d6f3dc92e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6817","nonce":1153053941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6819","nonce":1153053941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6823","nonce":1153053941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6821","nonce":1153053941}]},"public_addr":"172.21.15.153:6817/1153053941","cluster_addr":"172.21.15.153:6819/1153053941","heartbeat_back_addr":"172.21.15.153:6823/1153053941","heartbeat_front_addr":"172.21.15.153:6821/1153053941","state":["exists","up"]},{"osd":9,"uuid":"48bd3544-9028-4535-801b-3d39ecadf48e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6827","nonce":3423218876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6829","nonce":3423218876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6833","nonce":3423218876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6831","nonce":3423218876}]},"public_addr":"172.21.15.22:6827/3423218876","cluster_addr":"172.21.15.22:6829/3423218876","heartbeat_back_addr":"172.21.15.22:6833/3423218876","heartbeat_front_addr":"172.21.15.22:6831/3423218876","state":["exists","up"]},{"osd":10,"uuid":"c8716aa0-eb93-435d-a9d0-dd4c3dce1954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6825","nonce":2024112643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6827","nonce":2024112643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6831","nonce":2024112643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6829","nonce":2024112643}]},"public_addr":"172.21.15.100:6825/2024112643","cluster_addr":"172.21.15.100:6827/2024112643","heartbeat_back_addr":"172.21.15.100:6831/2024112643","heartbeat_front_addr":"172.21.15.100:6829/2024112643","state":["exists","up"]},{"osd":11,"uuid":"3c427cfe-8d7c-431e-9eb4-b03cfac3068d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6825","nonce":2245781783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6827","nonce":2245781783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6831","nonce":2245781783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6829","nonce":2245781783}]},"public_addr":"172.21.15.153:6825/2245781783","cluster_addr":"172.21.15.153:6827/2245781783","heartbeat_back_addr":"172.21.15.153:6831/2245781783","heartbeat_front_addr":"172.21.15.153:6829/2245781783","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:23.001057+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:46.353182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:11.469840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:37.557521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:02.630783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:27.374057+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:53.758498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:19.507846+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:45.080789+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:10.286820+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:35.565950+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:06:00.633384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3072001022":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/1519904928":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6801/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/2108462626":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/3337107310":"2024-09-11T07:59:36.505631+0000","172.21.15.22:6801/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/1708436544":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/278091300":"2024-09-11T07:59:36.505631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:07:18.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.388+0000 7fdb7918d640 1 -- 172.21.15.22:0/462692530 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdb600a2c10 msgr2=0x7fdb600a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:18.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.388+0000 7fdb7918d640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdb600a2c10 0x7fdb600a50d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400bbe0 tx=0x7fdb6400b390 comp rx=0 tx=0).stop 2024-09-10T08:07:18.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.388+0000 7fdb7918d640 1 -- 172.21.15.22:0/462692530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb74101420 msgr2=0x7fdb74197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:18.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.388+0000 7fdb7918d640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb74101420 0x7fdb74197860 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00b4a0 tx=0x7fdb5c00b960 comp rx=0 tx=0).stop 2024-09-10T08:07:18.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.388+0000 7fdb7918d640 1 -- 172.21.15.22:0/462692530 shutdown_connections 2024-09-10T08:07:18.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.388+0000 7fdb7918d640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdb600a2c10 0x7fdb600a50d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:18.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.388+0000 7fdb7918d640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb74106a80 0x7fdb7419bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:18.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.388+0000 7fdb7918d640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb74101420 0x7fdb74197860 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:18.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.388+0000 7fdb7918d640 1 --2- 172.21.15.22:0/462692530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb74100a80 0x7fdb74197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:18.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.388+0000 7fdb7918d640 1 -- 172.21.15.22:0/462692530 >> 172.21.15.22:0/462692530 conn(0x7fdb740fc7a0 msgr2=0x7fdb740fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:18.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.388+0000 7fdb7918d640 1 -- 172.21.15.22:0/462692530 shutdown_connections 2024-09-10T08:07:18.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:18.388+0000 7fdb7918d640 1 -- 172.21.15.22:0/462692530 wait complete. 2024-09-10T08:07:18.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:18 smithi022 ceph-mon[30854]: pgmap v291: 97 pgs: 97 active+clean; 605 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-09-10T08:07:18.712 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:18 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/462692530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:07:18.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:18 smithi100 ceph-mon[35102]: pgmap v291: 97 pgs: 97 active+clean; 605 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-09-10T08:07:18.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:18 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/462692530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:07:18.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:18 smithi153 ceph-mon[35609]: pgmap v291: 97 pgs: 97 active+clean; 605 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 KiB/s wr, 21 op/s 2024-09-10T08:07:18.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:18 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/462692530' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:07:19.068 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T08:07:19.069 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T08:07:19.329 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:19.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.791+0000 7f2aba269640 1 -- 172.21.15.22:0/4071467349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4101420 msgr2=0x7f2ab410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:19.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.791+0000 7f2aba269640 1 --2- 172.21.15.22:0/4071467349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4101420 0x7f2ab410d950 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2aac009cd0 tx=0x7f2aac02a8e0 comp rx=0 tx=0).stop 2024-09-10T08:07:19.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.791+0000 7f2aba269640 1 -- 172.21.15.22:0/4071467349 shutdown_connections 2024-09-10T08:07:19.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.791+0000 7f2aba269640 1 --2- 172.21.15.22:0/4071467349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4101420 0x7f2ab410d950 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:19.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.791+0000 7f2aba269640 1 --2- 172.21.15.22:0/4071467349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab4100a80 0x7f2ab4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.791+0000 7f2aba269640 1 --2- 172.21.15.22:0/4071467349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab4106a80 0x7f2ab4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.791+0000 7f2aba269640 1 -- 172.21.15.22:0/4071467349 >> 172.21.15.22:0/4071467349 conn(0x7f2ab40fc7a0 msgr2=0x7f2ab40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.791+0000 7f2aba269640 1 -- 172.21.15.22:0/4071467349 shutdown_connections 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.791+0000 7f2aba269640 1 -- 172.21.15.22:0/4071467349 wait complete. 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2aba269640 1 Processor -- start 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2aba269640 1 -- start start 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2aba269640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab4100a80 0x7f2ab40fcd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2aba269640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab4101420 0x7f2ab40fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2aba269640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4106a80 0x7f2ab40fd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2aba269640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab4110e80 con 0x7f2ab4106a80 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2aba269640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab4110d00 con 0x7f2ab4101420 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2aba269640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2ab4111000 con 0x7f2ab4100a80 2024-09-10T08:07:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2ab8806640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4106a80 0x7f2ab40fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2ab8806640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4106a80 0x7f2ab40fd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41432/0 (socket says 172.21.15.22:41432) 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2ab8806640 1 -- 172.21.15.22:0/1676941700 learned_addr learned my addr 172.21.15.22:0/1676941700 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2ab3fff640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab4100a80 0x7f2ab40fcd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2aabfff640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab4101420 0x7f2ab40fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2ab8806640 1 -- 172.21.15.22:0/1676941700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab4100a80 msgr2=0x7f2ab40fcd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2ab8806640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab4100a80 0x7f2ab40fcd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2ab8806640 1 -- 172.21.15.22:0/1676941700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab4101420 msgr2=0x7f2ab40fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2ab8806640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab4101420 0x7f2ab40fd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2ab8806640 1 -- 172.21.15.22:0/1676941700 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab41a6930 con 0x7f2ab4106a80 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2aabfff640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab4101420 0x7f2ab40fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.792+0000 7f2ab8806640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4106a80 0x7f2ab40fd810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2aac005cc0 tx=0x7f2aac003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.793+0000 7f2ab1ffb640 1 -- 172.21.15.22:0/1676941700 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aac004040 con 0x7f2ab4106a80 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.793+0000 7f2aba269640 1 -- 172.21.15.22:0/1676941700 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ab41a6bc0 con 0x7f2ab4106a80 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.793+0000 7f2ab1ffb640 1 -- 172.21.15.22:0/1676941700 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2aac0046c0 con 0x7f2ab4106a80 2024-09-10T08:07:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.793+0000 7f2ab1ffb640 1 -- 172.21.15.22:0/1676941700 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aac046480 con 0x7f2ab4106a80 2024-09-10T08:07:19.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.793+0000 7f2aba269640 1 -- 172.21.15.22:0/1676941700 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ab41a7100 con 0x7f2ab4106a80 2024-09-10T08:07:19.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.794+0000 7f2aba269640 1 -- 172.21.15.22:0/1676941700 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ab4100ee0 con 0x7f2ab4106a80 2024-09-10T08:07:19.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.795+0000 7f2ab1ffb640 1 -- 172.21.15.22:0/1676941700 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2aac0305a0 con 0x7f2ab4106a80 2024-09-10T08:07:19.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.795+0000 7f2ab1ffb640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2aa00a2c10 0x7f2aa00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:19.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.796+0000 7f2ab3fff640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2aa00a2c10 0x7f2aa00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:19.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.796+0000 7f2ab1ffb640 1 -- 172.21.15.22:0/1676941700 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2aac02e030 con 0x7f2ab4106a80 2024-09-10T08:07:19.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.796+0000 7f2ab3fff640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2aa00a2c10 0x7f2aa00a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400bb60 tx=0x7f2aa400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:19.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.800+0000 7f2ab1ffb640 1 -- 172.21.15.22:0/1676941700 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2aac04b060 con 0x7f2ab4106a80 2024-09-10T08:07:19.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.973+0000 7f2aba269640 1 -- 172.21.15.22:0/1676941700 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ab4062630 con 0x7f2aa00a2c10 2024-09-10T08:07:19.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.979+0000 7f2ab1ffb640 1 -- 172.21.15.22:0/1676941700 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259015 (secure 0 0 0) 0x7f2ab4062630 con 0x7f2aa00a2c10 2024-09-10T08:07:19.981 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:07:19.983 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-10T08:07:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.984+0000 7f2aba269640 1 -- 172.21.15.22:0/1676941700 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2aa00a2c10 msgr2=0x7f2aa00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.984+0000 7f2aba269640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2aa00a2c10 0x7f2aa00a50d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400bb60 tx=0x7f2aa400b390 comp rx=0 tx=0).stop 2024-09-10T08:07:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.984+0000 7f2aba269640 1 -- 172.21.15.22:0/1676941700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4106a80 msgr2=0x7f2ab40fd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.984+0000 7f2aba269640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4106a80 0x7f2ab40fd810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2aac005cc0 tx=0x7f2aac003970 comp rx=0 tx=0).stop 2024-09-10T08:07:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.984+0000 7f2aba269640 1 -- 172.21.15.22:0/1676941700 shutdown_connections 2024-09-10T08:07:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.984+0000 7f2aba269640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2aa00a2c10 0x7f2aa00a50d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.984+0000 7f2aba269640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ab4106a80 0x7f2ab40fd810 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.984+0000 7f2aba269640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ab4101420 0x7f2ab40fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:19.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.984+0000 7f2aba269640 1 --2- 172.21.15.22:0/1676941700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab4100a80 0x7f2ab40fcd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:19.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.984+0000 7f2aba269640 1 -- 172.21.15.22:0/1676941700 >> 172.21.15.22:0/1676941700 conn(0x7f2ab40fc7a0 msgr2=0x7f2ab406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:19.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.984+0000 7f2aba269640 1 -- 172.21.15.22:0/1676941700 shutdown_connections 2024-09-10T08:07:19.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:19.984+0000 7f2aba269640 1 -- 172.21.15.22:0/1676941700 wait complete. 2024-09-10T08:07:20.592 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:20 smithi022 ceph-mon[30854]: pgmap v292: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 19 op/s 2024-09-10T08:07:20.621 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-10T08:07:18.947955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644219,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":304,"num_read_kb":266,"num_write":413,"num_write_kb":3055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":338,"ondisk_log_size":338,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360404,"kb_used_data":11148,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581420,"statfs":{"total":1151940427776,"available":1151571374080,"internally_reserved":0,"allocated":11415552,"data_stored":7169949,"data_compressed":178551,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":47403,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":93,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003282"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.410188+0000","last_change":"2024-09-10T08:06:53.919814+0000","last_active":"2024-09-10T08:07:02.410188+0000","last_peered":"2024-09-10T08:07:02.410188+0000","last_clean":"2024-09-10T08:07:02.410188+0000","last_became_active":"2024-09-10T08:06:53.919460+0000","last_became_peered":"2024-09-10T08:06:53.919460+0000","last_unstale":"2024-09-10T08:07:02.410188+0000","last_undegraded":"2024-09-10T08:07:02.410188+0000","last_fullsized":"2024-09-10T08:07:02.410188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:39.027064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408512+0000","last_change":"2024-09-10T08:06:53.921645+0000","last_active":"2024-09-10T08:07:02.408512+0000","last_peered":"2024-09-10T08:07:02.408512+0000","last_clean":"2024-09-10T08:07:02.408512+0000","last_became_active":"2024-09-10T08:06:53.921346+0000","last_became_peered":"2024-09-10T08:06:53.921346+0000","last_unstale":"2024-09-10T08:07:02.408512+0000","last_undegraded":"2024-09-10T08:07:02.408512+0000","last_fullsized":"2024-09-10T08:07:02.408512+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:48.830824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408729+0000","last_change":"2024-09-10T08:06:53.920736+0000","last_active":"2024-09-10T08:07:02.408729+0000","last_peered":"2024-09-10T08:07:02.408729+0000","last_clean":"2024-09-10T08:07:02.408729+0000","last_became_active":"2024-09-10T08:06:53.920422+0000","last_became_peered":"2024-09-10T08:06:53.920422+0000","last_unstale":"2024-09-10T08:07:02.408729+0000","last_undegraded":"2024-09-10T08:07:02.408729+0000","last_fullsized":"2024-09-10T08:07:02.408729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:32.025610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.413898+0000","last_change":"2024-09-10T08:07:02.413480+0000","last_active":"2024-09-10T08:07:02.413898+0000","last_peered":"2024-09-10T08:07:02.413898+0000","last_clean":"2024-09-10T08:07:02.413898+0000","last_became_active":"2024-09-10T08:07:02.413146+0000","last_became_peered":"2024-09-10T08:07:02.413146+0000","last_unstale":"2024-09-10T08:07:02.413898+0000","last_undegraded":"2024-09-10T08:07:02.413898+0000","last_fullsized":"2024-09-10T08:07:02.413898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:47.348670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411798+0000","last_change":"2024-09-10T08:06:53.915703+0000","last_active":"2024-09-10T08:07:02.411798+0000","last_peered":"2024-09-10T08:07:02.411798+0000","last_clean":"2024-09-10T08:07:02.411798+0000","last_became_active":"2024-09-10T08:06:53.915375+0000","last_became_peered":"2024-09-10T08:06:53.915375+0000","last_unstale":"2024-09-10T08:07:02.411798+0000","last_undegraded":"2024-09-10T08:07:02.411798+0000","last_fullsized":"2024-09-10T08:07:02.411798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:40.425133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427232+0000","last_change":"2024-09-10T08:06:53.927711+0000","last_active":"2024-09-10T08:07:02.427232+0000","last_peered":"2024-09-10T08:07:02.427232+0000","last_clean":"2024-09-10T08:07:02.427232+0000","last_became_active":"2024-09-10T08:06:53.927398+0000","last_became_peered":"2024-09-10T08:06:53.927398+0000","last_unstale":"2024-09-10T08:07:02.427232+0000","last_undegraded":"2024-09-10T08:07:02.427232+0000","last_fullsized":"2024-09-10T08:07:02.427232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:00.614829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409283+0000","last_change":"2024-09-10T08:06:53.924069+0000","last_active":"2024-09-10T08:07:02.409283+0000","last_peered":"2024-09-10T08:07:02.409283+0000","last_clean":"2024-09-10T08:07:02.409283+0000","last_became_active":"2024-09-10T08:06:53.923743+0000","last_became_peered":"2024-09-10T08:06:53.923743+0000","last_unstale":"2024-09-10T08:07:02.409283+0000","last_undegraded":"2024-09-10T08:07:02.409283+0000","last_fullsized":"2024-09-10T08:07:02.409283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:18.943432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428903+0000","last_change":"2024-09-10T08:06:53.921446+0000","last_active":"2024-09-10T08:07:02.428903+0000","last_peered":"2024-09-10T08:07:02.428903+0000","last_clean":"2024-09-10T08:07:02.428903+0000","last_became_active":"2024-09-10T08:06:53.921141+0000","last_became_peered":"2024-09-10T08:06:53.921141+0000","last_unstale":"2024-09-10T08:07:02.428903+0000","last_undegraded":"2024-09-10T08:07:02.428903+0000","last_fullsized":"2024-09-10T08:07:02.428903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:58.255095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428152+0000","last_change":"2024-09-10T08:06:53.919967+0000","last_active":"2024-09-10T08:07:02.428152+0000","last_peered":"2024-09-10T08:07:02.428152+0000","last_clean":"2024-09-10T08:07:02.428152+0000","last_became_active":"2024-09-10T08:06:53.919600+0000","last_became_peered":"2024-09-10T08:06:53.919600+0000","last_unstale":"2024-09-10T08:07:02.428152+0000","last_undegraded":"2024-09-10T08:07:02.428152+0000","last_fullsized":"2024-09-10T08:07:02.428152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:32.298128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428189+0000","last_change":"2024-09-10T08:06:53.925851+0000","last_active":"2024-09-10T08:07:02.428189+0000","last_peered":"2024-09-10T08:07:02.428189+0000","last_clean":"2024-09-10T08:07:02.428189+0000","last_became_active":"2024-09-10T08:06:53.925548+0000","last_became_peered":"2024-09-10T08:06:53.925548+0000","last_unstale":"2024-09-10T08:07:02.428189+0000","last_undegraded":"2024-09-10T08:07:02.428189+0000","last_fullsized":"2024-09-10T08:07:02.428189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:11.231320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409681+0000","last_change":"2024-09-10T08:06:53.935162+0000","last_active":"2024-09-10T08:07:02.409681+0000","last_peered":"2024-09-10T08:07:02.409681+0000","last_clean":"2024-09-10T08:07:02.409681+0000","last_became_active":"2024-09-10T08:06:53.934790+0000","last_became_peered":"2024-09-10T08:06:53.934790+0000","last_unstale":"2024-09-10T08:07:02.409681+0000","last_undegraded":"2024-09-10T08:07:02.409681+0000","last_fullsized":"2024-09-10T08:07:02.409681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:10.729869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407066+0000","last_change":"2024-09-10T08:06:53.926420+0000","last_active":"2024-09-10T08:07:02.407066+0000","last_peered":"2024-09-10T08:07:02.407066+0000","last_clean":"2024-09-10T08:07:02.407066+0000","last_became_active":"2024-09-10T08:06:53.925016+0000","last_became_peered":"2024-09-10T08:06:53.925016+0000","last_unstale":"2024-09-10T08:07:02.407066+0000","last_undegraded":"2024-09-10T08:07:02.407066+0000","last_fullsized":"2024-09-10T08:07:02.407066+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:07.459413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428465+0000","last_change":"2024-09-10T08:06:53.922632+0000","last_active":"2024-09-10T08:07:02.428465+0000","last_peered":"2024-09-10T08:07:02.428465+0000","last_clean":"2024-09-10T08:07:02.428465+0000","last_became_active":"2024-09-10T08:06:53.922328+0000","last_became_peered":"2024-09-10T08:06:53.922328+0000","last_unstale":"2024-09-10T08:07:02.428465+0000","last_undegraded":"2024-09-10T08:07:02.428465+0000","last_fullsized":"2024-09-10T08:07:02.428465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:14.136508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408385+0000","last_change":"2024-09-10T08:06:53.922697+0000","last_active":"2024-09-10T08:07:02.408385+0000","last_peered":"2024-09-10T08:07:02.408385+0000","last_clean":"2024-09-10T08:07:02.408385+0000","last_became_active":"2024-09-10T08:06:53.922392+0000","last_became_peered":"2024-09-10T08:06:53.922392+0000","last_unstale":"2024-09-10T08:07:02.408385+0000","last_undegraded":"2024-09-10T08:07:02.408385+0000","last_fullsized":"2024-09-10T08:07:02.408385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:24.823244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408339+0000","last_change":"2024-09-10T08:06:53.926966+0000","last_active":"2024-09-10T08:07:02.408339+0000","last_peered":"2024-09-10T08:07:02.408339+0000","last_clean":"2024-09-10T08:07:02.408339+0000","last_became_active":"2024-09-10T08:06:53.926611+0000","last_became_peered":"2024-09-10T08:06:53.926611+0000","last_unstale":"2024-09-10T08:07:02.408339+0000","last_undegraded":"2024-09-10T08:07:02.408339+0000","last_fullsized":"2024-09-10T08:07:02.408339+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:20.810104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428439+0000","last_change":"2024-09-10T08:06:53.928443+0000","last_active":"2024-09-10T08:07:02.428439+0000","last_peered":"2024-09-10T08:07:02.428439+0000","last_clean":"2024-09-10T08:07:02.428439+0000","last_became_active":"2024-09-10T08:06:53.926742+0000","last_became_peered":"2024-09-10T08:06:53.926742+0000","last_unstale":"2024-09-10T08:07:02.428439+0000","last_undegraded":"2024-09-10T08:07:02.428439+0000","last_fullsized":"2024-09-10T08:07:02.428439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:46.056335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.410219+0000","last_change":"2024-09-10T08:06:53.922295+0000","last_active":"2024-09-10T08:07:02.410219+0000","last_peered":"2024-09-10T08:07:02.410219+0000","last_clean":"2024-09-10T08:07:02.410219+0000","last_became_active":"2024-09-10T08:06:53.921920+0000","last_became_peered":"2024-09-10T08:06:53.921920+0000","last_unstale":"2024-09-10T08:07:02.410219+0000","last_undegraded":"2024-09-10T08:07:02.410219+0000","last_fullsized":"2024-09-10T08:07:02.410219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:41.005973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.406177+0000","last_change":"2024-09-10T08:06:53.926107+0000","last_active":"2024-09-10T08:07:02.406177+0000","last_peered":"2024-09-10T08:07:02.406177+0000","last_clean":"2024-09-10T08:07:02.406177+0000","last_became_active":"2024-09-10T08:06:53.925763+0000","last_became_peered":"2024-09-10T08:06:53.925763+0000","last_unstale":"2024-09-10T08:07:02.406177+0000","last_undegraded":"2024-09-10T08:07:02.406177+0000","last_fullsized":"2024-09-10T08:07:02.406177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:25.756418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407360+0000","last_change":"2024-09-10T08:06:53.917946+0000","last_active":"2024-09-10T08:07:02.407360+0000","last_peered":"2024-09-10T08:07:02.407360+0000","last_clean":"2024-09-10T08:07:02.407360+0000","last_became_active":"2024-09-10T08:06:53.917597+0000","last_became_peered":"2024-09-10T08:06:53.917597+0000","last_unstale":"2024-09-10T08:07:02.407360+0000","last_undegraded":"2024-09-10T08:07:02.407360+0000","last_fullsized":"2024-09-10T08:07:02.407360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:36.218971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409658+0000","last_change":"2024-09-10T08:06:53.926365+0000","last_active":"2024-09-10T08:07:02.409658+0000","last_peered":"2024-09-10T08:07:02.409658+0000","last_clean":"2024-09-10T08:07:02.409658+0000","last_became_active":"2024-09-10T08:06:53.926045+0000","last_became_peered":"2024-09-10T08:06:53.926045+0000","last_unstale":"2024-09-10T08:07:02.409658+0000","last_undegraded":"2024-09-10T08:07:02.409658+0000","last_fullsized":"2024-09-10T08:07:02.409658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:31.300495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428586+0000","last_change":"2024-09-10T08:06:53.924758+0000","last_active":"2024-09-10T08:07:02.428586+0000","last_peered":"2024-09-10T08:07:02.428586+0000","last_clean":"2024-09-10T08:07:02.428586+0000","last_became_active":"2024-09-10T08:06:53.924456+0000","last_became_peered":"2024-09-10T08:06:53.924456+0000","last_unstale":"2024-09-10T08:07:02.428586+0000","last_undegraded":"2024-09-10T08:07:02.428586+0000","last_fullsized":"2024-09-10T08:07:02.428586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:23.912453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427744+0000","last_change":"2024-09-10T08:06:53.929854+0000","last_active":"2024-09-10T08:07:02.427744+0000","last_peered":"2024-09-10T08:07:02.427744+0000","last_clean":"2024-09-10T08:07:02.427744+0000","last_became_active":"2024-09-10T08:06:53.929537+0000","last_became_peered":"2024-09-10T08:06:53.929537+0000","last_unstale":"2024-09-10T08:07:02.427744+0000","last_undegraded":"2024-09-10T08:07:02.427744+0000","last_fullsized":"2024-09-10T08:07:02.427744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:42.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.412582+0000","last_change":"2024-09-10T08:07:02.412169+0000","last_active":"2024-09-10T08:07:02.412582+0000","last_peered":"2024-09-10T08:07:02.412582+0000","last_clean":"2024-09-10T08:07:02.412582+0000","last_became_active":"2024-09-10T08:07:02.411592+0000","last_became_peered":"2024-09-10T08:07:02.411592+0000","last_unstale":"2024-09-10T08:07:02.412582+0000","last_undegraded":"2024-09-10T08:07:02.412582+0000","last_fullsized":"2024-09-10T08:07:02.412582+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:43.477920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.413886+0000","last_change":"2024-09-10T08:06:53.915136+0000","last_active":"2024-09-10T08:07:02.413886+0000","last_peered":"2024-09-10T08:07:02.413886+0000","last_clean":"2024-09-10T08:07:02.413886+0000","last_became_active":"2024-09-10T08:06:53.914825+0000","last_became_peered":"2024-09-10T08:06:53.914825+0000","last_unstale":"2024-09-10T08:07:02.413886+0000","last_undegraded":"2024-09-10T08:07:02.413886+0000","last_fullsized":"2024-09-10T08:07:02.413886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:17.619930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428479+0000","last_change":"2024-09-10T08:06:53.925991+0000","last_active":"2024-09-10T08:07:02.428479+0000","last_peered":"2024-09-10T08:07:02.428479+0000","last_clean":"2024-09-10T08:07:02.428479+0000","last_became_active":"2024-09-10T08:06:53.925657+0000","last_became_peered":"2024-09-10T08:06:53.925657+0000","last_unstale":"2024-09-10T08:07:02.428479+0000","last_undegraded":"2024-09-10T08:07:02.428479+0000","last_fullsized":"2024-09-10T08:07:02.428479+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:54.562209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407466+0000","last_change":"2024-09-10T08:06:53.931858+0000","last_active":"2024-09-10T08:07:02.407466+0000","last_peered":"2024-09-10T08:07:02.407466+0000","last_clean":"2024-09-10T08:07:02.407466+0000","last_became_active":"2024-09-10T08:06:53.931520+0000","last_became_peered":"2024-09-10T08:06:53.931520+0000","last_unstale":"2024-09-10T08:07:02.407466+0000","last_undegraded":"2024-09-10T08:07:02.407466+0000","last_fullsized":"2024-09-10T08:07:02.407466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:12.750769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409564+0000","last_change":"2024-09-10T08:06:53.915466+0000","last_active":"2024-09-10T08:07:02.409564+0000","last_peered":"2024-09-10T08:07:02.409564+0000","last_clean":"2024-09-10T08:07:02.409564+0000","last_became_active":"2024-09-10T08:06:53.915115+0000","last_became_peered":"2024-09-10T08:06:53.915115+0000","last_unstale":"2024-09-10T08:07:02.409564+0000","last_undegraded":"2024-09-10T08:07:02.409564+0000","last_fullsized":"2024-09-10T08:07:02.409564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:05.436530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428345+0000","last_change":"2024-09-10T08:06:53.928001+0000","last_active":"2024-09-10T08:07:02.428345+0000","last_peered":"2024-09-10T08:07:02.428345+0000","last_clean":"2024-09-10T08:07:02.428345+0000","last_became_active":"2024-09-10T08:06:53.927693+0000","last_became_peered":"2024-09-10T08:06:53.927693+0000","last_unstale":"2024-09-10T08:07:02.428345+0000","last_undegraded":"2024-09-10T08:07:02.428345+0000","last_fullsized":"2024-09-10T08:07:02.428345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:30.712600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408691+0000","last_change":"2024-09-10T08:06:53.927006+0000","last_active":"2024-09-10T08:07:02.408691+0000","last_peered":"2024-09-10T08:07:02.408691+0000","last_clean":"2024-09-10T08:07:02.408691+0000","last_became_active":"2024-09-10T08:06:53.925607+0000","last_became_peered":"2024-09-10T08:06:53.925607+0000","last_unstale":"2024-09-10T08:07:02.408691+0000","last_undegraded":"2024-09-10T08:07:02.408691+0000","last_fullsized":"2024-09-10T08:07:02.408691+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:31.640763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407216+0000","last_change":"2024-09-10T08:06:53.917197+0000","last_active":"2024-09-10T08:07:02.407216+0000","last_peered":"2024-09-10T08:07:02.407216+0000","last_clean":"2024-09-10T08:07:02.407216+0000","last_became_active":"2024-09-10T08:06:53.916830+0000","last_became_peered":"2024-09-10T08:06:53.916830+0000","last_unstale":"2024-09-10T08:07:02.407216+0000","last_undegraded":"2024-09-10T08:07:02.407216+0000","last_fullsized":"2024-09-10T08:07:02.407216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:00.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.416146+0000","last_change":"2024-09-10T08:07:02.416146+0000","last_active":"2024-09-10T08:07:02.416146+0000","last_peered":"2024-09-10T08:07:02.416146+0000","last_clean":"2024-09-10T08:07:02.416146+0000","last_became_active":"2024-09-10T08:07:02.415734+0000","last_became_peered":"2024-09-10T08:07:02.415734+0000","last_unstale":"2024-09-10T08:07:02.416146+0000","last_undegraded":"2024-09-10T08:07:02.416146+0000","last_fullsized":"2024-09-10T08:07:02.416146+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:26.811995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409617+0000","last_change":"2024-09-10T08:06:53.923406+0000","last_active":"2024-09-10T08:07:02.409617+0000","last_peered":"2024-09-10T08:07:02.409617+0000","last_clean":"2024-09-10T08:07:02.409617+0000","last_became_active":"2024-09-10T08:06:53.923012+0000","last_became_peered":"2024-09-10T08:06:53.923012+0000","last_unstale":"2024-09-10T08:07:02.409617+0000","last_undegraded":"2024-09-10T08:07:02.409617+0000","last_fullsized":"2024-09-10T08:07:02.409617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:39.426727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411368+0000","last_change":"2024-09-10T08:06:53.914764+0000","last_active":"2024-09-10T08:07:02.411368+0000","last_peered":"2024-09-10T08:07:02.411368+0000","last_clean":"2024-09-10T08:07:02.411368+0000","last_became_active":"2024-09-10T08:06:53.914431+0000","last_became_peered":"2024-09-10T08:06:53.914431+0000","last_unstale":"2024-09-10T08:07:02.411368+0000","last_undegraded":"2024-09-10T08:07:02.411368+0000","last_fullsized":"2024-09-10T08:07:02.411368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:29.703828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:13.478160+0000","last_change":"2024-09-10T08:06:51.854086+0000","last_active":"2024-09-10T08:07:13.478160+0000","last_peered":"2024-09-10T08:07:13.478160+0000","last_clean":"2024-09-10T08:07:13.478160+0000","last_became_active":"2024-09-10T08:06:51.853394+0000","last_became_peered":"2024-09-10T08:06:51.853394+0000","last_unstale":"2024-09-10T08:07:13.478160+0000","last_undegraded":"2024-09-10T08:07:13.478160+0000","last_fullsized":"2024-09-10T08:07:13.478160+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:33.688809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.414270+0000","last_change":"2024-09-10T08:06:53.927461+0000","last_active":"2024-09-10T08:07:02.414270+0000","last_peered":"2024-09-10T08:07:02.414270+0000","last_clean":"2024-09-10T08:07:02.414270+0000","last_became_active":"2024-09-10T08:06:53.927152+0000","last_became_peered":"2024-09-10T08:06:53.927152+0000","last_unstale":"2024-09-10T08:07:02.414270+0000","last_undegraded":"2024-09-10T08:07:02.414270+0000","last_fullsized":"2024-09-10T08:07:02.414270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:12.001671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.444057+0000","last_change":"2024-09-10T08:06:51.848621+0000","last_active":"2024-09-10T08:07:04.444057+0000","last_peered":"2024-09-10T08:07:04.444057+0000","last_clean":"2024-09-10T08:07:04.444057+0000","last_became_active":"2024-09-10T08:06:51.848239+0000","last_became_peered":"2024-09-10T08:06:51.848239+0000","last_unstale":"2024-09-10T08:07:04.444057+0000","last_undegraded":"2024-09-10T08:07:04.444057+0000","last_fullsized":"2024-09-10T08:07:04.444057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:00.816865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:03.436227+0000","last_change":"2024-09-10T08:06:51.844344+0000","last_active":"2024-09-10T08:07:03.436227+0000","last_peered":"2024-09-10T08:07:03.436227+0000","last_clean":"2024-09-10T08:07:03.436227+0000","last_became_active":"2024-09-10T08:06:51.844054+0000","last_became_peered":"2024-09-10T08:06:51.844054+0000","last_unstale":"2024-09-10T08:07:03.436227+0000","last_undegraded":"2024-09-10T08:07:03.436227+0000","last_fullsized":"2024-09-10T08:07:03.436227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:43.646632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428861+0000","last_change":"2024-09-10T08:06:53.914172+0000","last_active":"2024-09-10T08:07:02.428861+0000","last_peered":"2024-09-10T08:07:02.428861+0000","last_clean":"2024-09-10T08:07:02.428861+0000","last_became_active":"2024-09-10T08:06:53.913837+0000","last_became_peered":"2024-09-10T08:06:53.913837+0000","last_unstale":"2024-09-10T08:07:02.428861+0000","last_undegraded":"2024-09-10T08:07:02.428861+0000","last_fullsized":"2024-09-10T08:07:02.428861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:54.095685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.463531+0000","last_change":"2024-09-10T08:06:51.852474+0000","last_active":"2024-09-10T08:07:04.463531+0000","last_peered":"2024-09-10T08:07:04.463531+0000","last_clean":"2024-09-10T08:07:04.463531+0000","last_became_active":"2024-09-10T08:06:51.852097+0000","last_became_peered":"2024-09-10T08:06:51.852097+0000","last_unstale":"2024-09-10T08:07:04.463531+0000","last_undegraded":"2024-09-10T08:07:04.463531+0000","last_fullsized":"2024-09-10T08:07:04.463531+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:20.611988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.405898+0000","last_change":"2024-09-10T08:06:53.925345+0000","last_active":"2024-09-10T08:07:02.405898+0000","last_peered":"2024-09-10T08:07:02.405898+0000","last_clean":"2024-09-10T08:07:02.405898+0000","last_became_active":"2024-09-10T08:06:53.925017+0000","last_became_peered":"2024-09-10T08:06:53.925017+0000","last_unstale":"2024-09-10T08:07:02.405898+0000","last_undegraded":"2024-09-10T08:07:02.405898+0000","last_fullsized":"2024-09-10T08:07:02.405898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:22.692658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":54,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:17.482913+0000","last_change":"2024-09-10T08:06:51.849126+0000","last_active":"2024-09-10T08:07:17.482913+0000","last_peered":"2024-09-10T08:07:17.482913+0000","last_clean":"2024-09-10T08:07:17.482913+0000","last_became_active":"2024-09-10T08:06:51.848504+0000","last_became_peered":"2024-09-10T08:06:51.848504+0000","last_unstale":"2024-09-10T08:07:17.482913+0000","last_undegraded":"2024-09-10T08:07:17.482913+0000","last_fullsized":"2024-09-10T08:07:17.482913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:36.691846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428899+0000","last_change":"2024-09-10T08:06:53.930777+0000","last_active":"2024-09-10T08:07:02.428899+0000","last_peered":"2024-09-10T08:07:02.428899+0000","last_clean":"2024-09-10T08:07:02.428899+0000","last_became_active":"2024-09-10T08:06:53.929781+0000","last_became_peered":"2024-09-10T08:06:53.929781+0000","last_unstale":"2024-09-10T08:07:02.428899+0000","last_undegraded":"2024-09-10T08:07:02.428899+0000","last_fullsized":"2024-09-10T08:07:02.428899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:07.184254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.465673+0000","last_change":"2024-09-10T08:07:02.431452+0000","last_active":"2024-09-10T08:07:04.465673+0000","last_peered":"2024-09-10T08:07:04.465673+0000","last_clean":"2024-09-10T08:07:04.465673+0000","last_became_active":"2024-09-10T08:07:02.430794+0000","last_became_peered":"2024-09-10T08:07:02.430794+0000","last_unstale":"2024-09-10T08:07:04.465673+0000","last_undegraded":"2024-09-10T08:07:04.465673+0000","last_fullsized":"2024-09-10T08:07:04.465673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:48.313101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408754+0000","last_change":"2024-09-10T08:06:53.924896+0000","last_active":"2024-09-10T08:07:02.408754+0000","last_peered":"2024-09-10T08:07:02.408754+0000","last_clean":"2024-09-10T08:07:02.408754+0000","last_became_active":"2024-09-10T08:06:53.924593+0000","last_became_peered":"2024-09-10T08:06:53.924593+0000","last_unstale":"2024-09-10T08:07:02.408754+0000","last_undegraded":"2024-09-10T08:07:02.408754+0000","last_fullsized":"2024-09-10T08:07:02.408754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:49.802792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.444479+0000","last_change":"2024-09-10T08:06:52.045216+0000","last_active":"2024-09-10T08:07:04.444479+0000","last_peered":"2024-09-10T08:07:04.444479+0000","last_clean":"2024-09-10T08:07:04.444479+0000","last_became_active":"2024-09-10T08:06:52.044707+0000","last_became_peered":"2024-09-10T08:06:52.044707+0000","last_unstale":"2024-09-10T08:07:04.444479+0000","last_undegraded":"2024-09-10T08:07:04.444479+0000","last_fullsized":"2024-09-10T08:07:04.444479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:59.778427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427975+0000","last_change":"2024-09-10T08:06:53.932607+0000","last_active":"2024-09-10T08:07:02.427975+0000","last_peered":"2024-09-10T08:07:02.427975+0000","last_clean":"2024-09-10T08:07:02.427975+0000","last_became_active":"2024-09-10T08:06:53.932149+0000","last_became_peered":"2024-09-10T08:06:53.932149+0000","last_unstale":"2024-09-10T08:07:02.427975+0000","last_undegraded":"2024-09-10T08:07:02.427975+0000","last_fullsized":"2024-09-10T08:07:02.427975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:40.969547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'24","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:17.484978+0000","last_change":"2024-09-10T08:06:51.854321+0000","last_active":"2024-09-10T08:07:17.484978+0000","last_peered":"2024-09-10T08:07:17.484978+0000","last_clean":"2024-09-10T08:07:17.484978+0000","last_became_active":"2024-09-10T08:06:51.853931+0000","last_became_peered":"2024-09-10T08:06:51.853931+0000","last_unstale":"2024-09-10T08:07:17.484978+0000","last_undegraded":"2024-09-10T08:07:17.484978+0000","last_fullsized":"2024-09-10T08:07:17.484978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:30.930761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":62,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411799+0000","last_change":"2024-09-10T08:06:53.924899+0000","last_active":"2024-09-10T08:07:02.411799+0000","last_peered":"2024-09-10T08:07:02.411799+0000","last_clean":"2024-09-10T08:07:02.411799+0000","last_became_active":"2024-09-10T08:06:53.924571+0000","last_became_peered":"2024-09-10T08:06:53.924571+0000","last_unstale":"2024-09-10T08:07:02.411799+0000","last_undegraded":"2024-09-10T08:07:02.411799+0000","last_fullsized":"2024-09-10T08:07:02.411799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:04.681689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.467171+0000","last_change":"2024-09-10T08:06:51.851860+0000","last_active":"2024-09-10T08:07:04.467171+0000","last_peered":"2024-09-10T08:07:04.467171+0000","last_clean":"2024-09-10T08:07:04.467171+0000","last_became_active":"2024-09-10T08:06:51.851520+0000","last_became_peered":"2024-09-10T08:06:51.851520+0000","last_unstale":"2024-09-10T08:07:04.467171+0000","last_undegraded":"2024-09-10T08:07:04.467171+0000","last_fullsized":"2024-09-10T08:07:04.467171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.182866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427983+0000","last_change":"2024-09-10T08:06:53.924888+0000","last_active":"2024-09-10T08:07:02.427983+0000","last_peered":"2024-09-10T08:07:02.427983+0000","last_clean":"2024-09-10T08:07:02.427983+0000","last_became_active":"2024-09-10T08:06:53.924572+0000","last_became_peered":"2024-09-10T08:06:53.924572+0000","last_unstale":"2024-09-10T08:07:02.427983+0000","last_undegraded":"2024-09-10T08:07:02.427983+0000","last_fullsized":"2024-09-10T08:07:02.427983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:19.446554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.465505+0000","last_change":"2024-09-10T08:06:51.848665+0000","last_active":"2024-09-10T08:07:04.465505+0000","last_peered":"2024-09-10T08:07:04.465505+0000","last_clean":"2024-09-10T08:07:04.465505+0000","last_became_active":"2024-09-10T08:06:51.848301+0000","last_became_peered":"2024-09-10T08:06:51.848301+0000","last_unstale":"2024-09-10T08:07:04.465505+0000","last_undegraded":"2024-09-10T08:07:04.465505+0000","last_fullsized":"2024-09-10T08:07:04.465505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:32.754470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409650+0000","last_change":"2024-09-10T08:06:53.933953+0000","last_active":"2024-09-10T08:07:02.409650+0000","last_peered":"2024-09-10T08:07:02.409650+0000","last_clean":"2024-09-10T08:07:02.409650+0000","last_became_active":"2024-09-10T08:06:53.933590+0000","last_became_peered":"2024-09-10T08:06:53.933590+0000","last_unstale":"2024-09-10T08:07:02.409650+0000","last_undegraded":"2024-09-10T08:07:02.409650+0000","last_fullsized":"2024-09-10T08:07:02.409650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:54.530660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:14.478329+0000","last_change":"2024-09-10T08:06:51.847673+0000","last_active":"2024-09-10T08:07:14.478329+0000","last_peered":"2024-09-10T08:07:14.478329+0000","last_clean":"2024-09-10T08:07:14.478329+0000","last_became_active":"2024-09-10T08:06:51.847324+0000","last_became_peered":"2024-09-10T08:06:51.847324+0000","last_unstale":"2024-09-10T08:07:14.478329+0000","last_undegraded":"2024-09-10T08:07:14.478329+0000","last_fullsized":"2024-09-10T08:07:14.478329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:24.962333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409220+0000","last_change":"2024-09-10T08:06:53.929884+0000","last_active":"2024-09-10T08:07:02.409220+0000","last_peered":"2024-09-10T08:07:02.409220+0000","last_clean":"2024-09-10T08:07:02.409220+0000","last_became_active":"2024-09-10T08:06:53.927766+0000","last_became_peered":"2024-09-10T08:06:53.927766+0000","last_unstale":"2024-09-10T08:07:02.409220+0000","last_undegraded":"2024-09-10T08:07:02.409220+0000","last_fullsized":"2024-09-10T08:07:02.409220+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:18.403993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.458590+0000","last_change":"2024-09-10T08:07:02.425907+0000","last_active":"2024-09-10T08:07:04.458590+0000","last_peered":"2024-09-10T08:07:04.458590+0000","last_clean":"2024-09-10T08:07:04.458590+0000","last_became_active":"2024-09-10T08:07:02.416949+0000","last_became_peered":"2024-09-10T08:07:02.416949+0000","last_unstale":"2024-09-10T08:07:04.458590+0000","last_undegraded":"2024-09-10T08:07:04.458590+0000","last_fullsized":"2024-09-10T08:07:04.458590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:01.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.413786+0000","last_change":"2024-09-10T08:06:53.927620+0000","last_active":"2024-09-10T08:07:02.413786+0000","last_peered":"2024-09-10T08:07:02.413786+0000","last_clean":"2024-09-10T08:07:02.413786+0000","last_became_active":"2024-09-10T08:06:53.926543+0000","last_became_peered":"2024-09-10T08:06:53.926543+0000","last_unstale":"2024-09-10T08:07:02.413786+0000","last_undegraded":"2024-09-10T08:07:02.413786+0000","last_fullsized":"2024-09-10T08:07:02.413786+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:18.210472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.432980+0000","last_change":"2024-09-10T08:07:02.430550+0000","last_active":"2024-09-10T08:07:04.432980+0000","last_peered":"2024-09-10T08:07:04.432980+0000","last_clean":"2024-09-10T08:07:04.432980+0000","last_became_active":"2024-09-10T08:07:02.416317+0000","last_became_peered":"2024-09-10T08:07:02.416317+0000","last_unstale":"2024-09-10T08:07:04.432980+0000","last_undegraded":"2024-09-10T08:07:04.432980+0000","last_fullsized":"2024-09-10T08:07:04.432980+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:10.317471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409840+0000","last_change":"2024-09-10T08:06:53.925598+0000","last_active":"2024-09-10T08:07:02.409840+0000","last_peered":"2024-09-10T08:07:02.409840+0000","last_clean":"2024-09-10T08:07:02.409840+0000","last_became_active":"2024-09-10T08:06:53.925253+0000","last_became_peered":"2024-09-10T08:06:53.925253+0000","last_unstale":"2024-09-10T08:07:02.409840+0000","last_undegraded":"2024-09-10T08:07:02.409840+0000","last_fullsized":"2024-09-10T08:07:02.409840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:29.662057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.465757+0000","last_change":"2024-09-10T08:06:51.851790+0000","last_active":"2024-09-10T08:07:04.465757+0000","last_peered":"2024-09-10T08:07:04.465757+0000","last_clean":"2024-09-10T08:07:04.465757+0000","last_became_active":"2024-09-10T08:06:51.851417+0000","last_became_peered":"2024-09-10T08:06:51.851417+0000","last_unstale":"2024-09-10T08:07:04.465757+0000","last_undegraded":"2024-09-10T08:07:04.465757+0000","last_fullsized":"2024-09-10T08:07:04.465757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:41.432728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409698+0000","last_change":"2024-09-10T08:06:53.926530+0000","last_active":"2024-09-10T08:07:02.409698+0000","last_peered":"2024-09-10T08:07:02.409698+0000","last_clean":"2024-09-10T08:07:02.409698+0000","last_became_active":"2024-09-10T08:06:53.926191+0000","last_became_peered":"2024-09-10T08:06:53.926191+0000","last_unstale":"2024-09-10T08:07:02.409698+0000","last_undegraded":"2024-09-10T08:07:02.409698+0000","last_fullsized":"2024-09-10T08:07:02.409698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:09.789763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.458396+0000","last_change":"2024-09-10T08:06:51.846679+0000","last_active":"2024-09-10T08:07:04.458396+0000","last_peered":"2024-09-10T08:07:04.458396+0000","last_clean":"2024-09-10T08:07:04.458396+0000","last_became_active":"2024-09-10T08:06:51.846328+0000","last_became_peered":"2024-09-10T08:06:51.846328+0000","last_unstale":"2024-09-10T08:07:04.458396+0000","last_undegraded":"2024-09-10T08:07:04.458396+0000","last_fullsized":"2024-09-10T08:07:04.458396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:09.207285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409613+0000","last_change":"2024-09-10T08:06:53.928316+0000","last_active":"2024-09-10T08:07:02.409613+0000","last_peered":"2024-09-10T08:07:02.409613+0000","last_clean":"2024-09-10T08:07:02.409613+0000","last_became_active":"2024-09-10T08:06:53.927974+0000","last_became_peered":"2024-09-10T08:06:53.927974+0000","last_unstale":"2024-09-10T08:07:02.409613+0000","last_undegraded":"2024-09-10T08:07:02.409613+0000","last_fullsized":"2024-09-10T08:07:02.409613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:06.875492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:17.483625+0000","last_change":"2024-09-10T08:06:52.151494+0000","last_active":"2024-09-10T08:07:17.483625+0000","last_peered":"2024-09-10T08:07:17.483625+0000","last_clean":"2024-09-10T08:07:17.483625+0000","last_became_active":"2024-09-10T08:06:52.151029+0000","last_became_peered":"2024-09-10T08:06:52.151029+0000","last_unstale":"2024-09-10T08:07:17.483625+0000","last_undegraded":"2024-09-10T08:07:17.483625+0000","last_fullsized":"2024-09-10T08:07:17.483625+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:23.632526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409767+0000","last_change":"2024-09-10T08:06:53.935415+0000","last_active":"2024-09-10T08:07:02.409767+0000","last_peered":"2024-09-10T08:07:02.409767+0000","last_clean":"2024-09-10T08:07:02.409767+0000","last_became_active":"2024-09-10T08:06:53.934855+0000","last_became_peered":"2024-09-10T08:06:53.934855+0000","last_unstale":"2024-09-10T08:07:02.409767+0000","last_undegraded":"2024-09-10T08:07:02.409767+0000","last_fullsized":"2024-09-10T08:07:02.409767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:08.799487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409575+0000","last_change":"2024-09-10T08:05:41.349856+0000","last_active":"2024-09-10T08:07:02.409575+0000","last_peered":"2024-09-10T08:07:02.409575+0000","last_clean":"2024-09-10T08:07:02.409575+0000","last_became_active":"2024-09-10T08:05:41.349403+0000","last_became_peered":"2024-09-10T08:05:41.349403+0000","last_unstale":"2024-09-10T08:07:02.409575+0000","last_undegraded":"2024-09-10T08:07:02.409575+0000","last_fullsized":"2024-09-10T08:07:02.409575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:02:15.710253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:02:15.710253+0000","last_clean_scrub_stamp":"2024-09-10T08:02:15.710253+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:43.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.466365+0000","last_change":"2024-09-10T08:06:51.846885+0000","last_active":"2024-09-10T08:07:04.466365+0000","last_peered":"2024-09-10T08:07:04.466365+0000","last_clean":"2024-09-10T08:07:04.466365+0000","last_became_active":"2024-09-10T08:06:51.846548+0000","last_became_peered":"2024-09-10T08:06:51.846548+0000","last_unstale":"2024-09-10T08:07:04.466365+0000","last_undegraded":"2024-09-10T08:07:04.466365+0000","last_fullsized":"2024-09-10T08:07:04.466365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:00.702987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428558+0000","last_change":"2024-09-10T08:06:53.916122+0000","last_active":"2024-09-10T08:07:02.428558+0000","last_peered":"2024-09-10T08:07:02.428558+0000","last_clean":"2024-09-10T08:07:02.428558+0000","last_became_active":"2024-09-10T08:06:53.915816+0000","last_became_peered":"2024-09-10T08:06:53.915816+0000","last_unstale":"2024-09-10T08:07:02.428558+0000","last_undegraded":"2024-09-10T08:07:02.428558+0000","last_fullsized":"2024-09-10T08:07:02.428558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:59.454276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:03.436486+0000","last_change":"2024-09-10T08:06:51.851031+0000","last_active":"2024-09-10T08:07:03.436486+0000","last_peered":"2024-09-10T08:07:03.436486+0000","last_clean":"2024-09-10T08:07:03.436486+0000","last_became_active":"2024-09-10T08:06:51.850518+0000","last_became_peered":"2024-09-10T08:06:51.850518+0000","last_unstale":"2024-09-10T08:07:03.436486+0000","last_undegraded":"2024-09-10T08:07:03.436486+0000","last_fullsized":"2024-09-10T08:07:03.436486+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:29.350976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427966+0000","last_change":"2024-09-10T08:06:53.923868+0000","last_active":"2024-09-10T08:07:02.427966+0000","last_peered":"2024-09-10T08:07:02.427966+0000","last_clean":"2024-09-10T08:07:02.427966+0000","last_became_active":"2024-09-10T08:06:53.923536+0000","last_became_peered":"2024-09-10T08:06:53.923536+0000","last_unstale":"2024-09-10T08:07:02.427966+0000","last_undegraded":"2024-09-10T08:07:02.427966+0000","last_fullsized":"2024-09-10T08:07:02.427966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:51.635192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:15.479244+0000","last_change":"2024-09-10T08:06:52.044706+0000","last_active":"2024-09-10T08:07:15.479244+0000","last_peered":"2024-09-10T08:07:15.479244+0000","last_clean":"2024-09-10T08:07:15.479244+0000","last_became_active":"2024-09-10T08:06:52.044363+0000","last_became_peered":"2024-09-10T08:06:52.044363+0000","last_unstale":"2024-09-10T08:07:15.479244+0000","last_undegraded":"2024-09-10T08:07:15.479244+0000","last_fullsized":"2024-09-10T08:07:15.479244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:34.190568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409680+0000","last_change":"2024-09-10T08:07:02.409349+0000","last_active":"2024-09-10T08:07:02.409680+0000","last_peered":"2024-09-10T08:07:02.409680+0000","last_clean":"2024-09-10T08:07:02.409680+0000","last_became_active":"2024-09-10T08:07:02.408940+0000","last_became_peered":"2024-09-10T08:07:02.408940+0000","last_unstale":"2024-09-10T08:07:02.409680+0000","last_undegraded":"2024-09-10T08:07:02.409680+0000","last_fullsized":"2024-09-10T08:07:02.409680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:10.702479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:14.487604+0000","last_change":"2024-09-10T08:06:51.851874+0000","last_active":"2024-09-10T08:07:14.487604+0000","last_peered":"2024-09-10T08:07:14.487604+0000","last_clean":"2024-09-10T08:07:14.487604+0000","last_became_active":"2024-09-10T08:06:51.851473+0000","last_became_peered":"2024-09-10T08:06:51.851473+0000","last_unstale":"2024-09-10T08:07:14.487604+0000","last_undegraded":"2024-09-10T08:07:14.487604+0000","last_fullsized":"2024-09-10T08:07:14.487604+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:29.273643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427638+0000","last_change":"2024-09-10T08:06:53.925677+0000","last_active":"2024-09-10T08:07:02.427638+0000","last_peered":"2024-09-10T08:07:02.427638+0000","last_clean":"2024-09-10T08:07:02.427638+0000","last_became_active":"2024-09-10T08:06:53.925374+0000","last_became_peered":"2024-09-10T08:06:53.925374+0000","last_unstale":"2024-09-10T08:07:02.427638+0000","last_undegraded":"2024-09-10T08:07:02.427638+0000","last_fullsized":"2024-09-10T08:07:02.427638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:13.138156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.406100+0000","last_change":"2024-09-10T08:06:52.044960+0000","last_active":"2024-09-10T08:07:02.406100+0000","last_peered":"2024-09-10T08:07:02.406100+0000","last_clean":"2024-09-10T08:07:02.406100+0000","last_became_active":"2024-09-10T08:06:52.044606+0000","last_became_peered":"2024-09-10T08:06:52.044606+0000","last_unstale":"2024-09-10T08:07:02.406100+0000","last_undegraded":"2024-09-10T08:07:02.406100+0000","last_fullsized":"2024-09-10T08:07:02.406100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:53.165305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428241+0000","last_change":"2024-09-10T08:06:53.922433+0000","last_active":"2024-09-10T08:07:02.428241+0000","last_peered":"2024-09-10T08:07:02.428241+0000","last_clean":"2024-09-10T08:07:02.428241+0000","last_became_active":"2024-09-10T08:06:53.922071+0000","last_became_peered":"2024-09-10T08:06:53.922071+0000","last_unstale":"2024-09-10T08:07:02.428241+0000","last_undegraded":"2024-09-10T08:07:02.428241+0000","last_fullsized":"2024-09-10T08:07:02.428241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:50.971467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.458913+0000","last_change":"2024-09-10T08:06:52.045082+0000","last_active":"2024-09-10T08:07:04.458913+0000","last_peered":"2024-09-10T08:07:04.458913+0000","last_clean":"2024-09-10T08:07:04.458913+0000","last_became_active":"2024-09-10T08:06:52.044536+0000","last_became_peered":"2024-09-10T08:06:52.044536+0000","last_unstale":"2024-09-10T08:07:04.458913+0000","last_undegraded":"2024-09-10T08:07:04.458913+0000","last_fullsized":"2024-09-10T08:07:04.458913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:49.639035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428443+0000","last_change":"2024-09-10T08:06:53.923357+0000","last_active":"2024-09-10T08:07:02.428443+0000","last_peered":"2024-09-10T08:07:02.428443+0000","last_clean":"2024-09-10T08:07:02.428443+0000","last_became_active":"2024-09-10T08:06:53.923060+0000","last_became_peered":"2024-09-10T08:06:53.923060+0000","last_unstale":"2024-09-10T08:07:02.428443+0000","last_undegraded":"2024-09-10T08:07:02.428443+0000","last_fullsized":"2024-09-10T08:07:02.428443+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:28.242894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:15.381198+0000","last_change":"2024-09-10T08:06:51.846268+0000","last_active":"2024-09-10T08:07:15.381198+0000","last_peered":"2024-09-10T08:07:15.381198+0000","last_clean":"2024-09-10T08:07:15.381198+0000","last_became_active":"2024-09-10T08:06:51.845891+0000","last_became_peered":"2024-09-10T08:06:51.845891+0000","last_unstale":"2024-09-10T08:07:15.381198+0000","last_undegraded":"2024-09-10T08:07:15.381198+0000","last_fullsized":"2024-09-10T08:07:15.381198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:52.621019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428556+0000","last_change":"2024-09-10T08:06:53.927836+0000","last_active":"2024-09-10T08:07:02.428556+0000","last_peered":"2024-09-10T08:07:02.428556+0000","last_clean":"2024-09-10T08:07:02.428556+0000","last_became_active":"2024-09-10T08:06:53.927339+0000","last_became_peered":"2024-09-10T08:06:53.927339+0000","last_unstale":"2024-09-10T08:07:02.428556+0000","last_undegraded":"2024-09-10T08:07:02.428556+0000","last_fullsized":"2024-09-10T08:07:02.428556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:55.569050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.466698+0000","last_change":"2024-09-10T08:06:52.151335+0000","last_active":"2024-09-10T08:07:04.466698+0000","last_peered":"2024-09-10T08:07:04.466698+0000","last_clean":"2024-09-10T08:07:04.466698+0000","last_became_active":"2024-09-10T08:06:52.150965+0000","last_became_peered":"2024-09-10T08:06:52.150965+0000","last_unstale":"2024-09-10T08:07:04.466698+0000","last_undegraded":"2024-09-10T08:07:04.466698+0000","last_fullsized":"2024-09-10T08:07:04.466698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:43.933254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.431020+0000","last_change":"2024-09-10T08:07:02.431020+0000","last_active":"2024-09-10T08:07:02.431020+0000","last_peered":"2024-09-10T08:07:02.431020+0000","last_clean":"2024-09-10T08:07:02.431020+0000","last_became_active":"2024-09-10T08:07:02.429794+0000","last_became_peered":"2024-09-10T08:07:02.429794+0000","last_unstale":"2024-09-10T08:07:02.431020+0000","last_undegraded":"2024-09-10T08:07:02.431020+0000","last_fullsized":"2024-09-10T08:07:02.431020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:49.386164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.433054+0000","last_change":"2024-09-10T08:06:52.044739+0000","last_active":"2024-09-10T08:07:02.433054+0000","last_peered":"2024-09-10T08:07:02.433054+0000","last_clean":"2024-09-10T08:07:02.433054+0000","last_became_active":"2024-09-10T08:06:52.044424+0000","last_became_peered":"2024-09-10T08:06:52.044424+0000","last_unstale":"2024-09-10T08:07:02.433054+0000","last_undegraded":"2024-09-10T08:07:02.433054+0000","last_fullsized":"2024-09-10T08:07:02.433054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:01.279274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411626+0000","last_change":"2024-09-10T08:06:53.918245+0000","last_active":"2024-09-10T08:07:02.411626+0000","last_peered":"2024-09-10T08:07:02.411626+0000","last_clean":"2024-09-10T08:07:02.411626+0000","last_became_active":"2024-09-10T08:06:53.917857+0000","last_became_peered":"2024-09-10T08:06:53.917857+0000","last_unstale":"2024-09-10T08:07:02.411626+0000","last_undegraded":"2024-09-10T08:07:02.411626+0000","last_fullsized":"2024-09-10T08:07:02.411626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:53.762361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.466341+0000","last_change":"2024-09-10T08:06:51.845368+0000","last_active":"2024-09-10T08:07:04.466341+0000","last_peered":"2024-09-10T08:07:04.466341+0000","last_clean":"2024-09-10T08:07:04.466341+0000","last_became_active":"2024-09-10T08:06:51.845052+0000","last_became_peered":"2024-09-10T08:06:51.845052+0000","last_unstale":"2024-09-10T08:07:04.466341+0000","last_undegraded":"2024-09-10T08:07:04.466341+0000","last_fullsized":"2024-09-10T08:07:04.466341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:45.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409721+0000","last_change":"2024-09-10T08:06:53.923576+0000","last_active":"2024-09-10T08:07:02.409721+0000","last_peered":"2024-09-10T08:07:02.409721+0000","last_clean":"2024-09-10T08:07:02.409721+0000","last_became_active":"2024-09-10T08:06:53.922934+0000","last_became_peered":"2024-09-10T08:06:53.922934+0000","last_unstale":"2024-09-10T08:07:02.409721+0000","last_undegraded":"2024-09-10T08:07:02.409721+0000","last_fullsized":"2024-09-10T08:07:02.409721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:48:06.088145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.444804+0000","last_change":"2024-09-10T08:06:51.850535+0000","last_active":"2024-09-10T08:07:04.444804+0000","last_peered":"2024-09-10T08:07:04.444804+0000","last_clean":"2024-09-10T08:07:04.444804+0000","last_became_active":"2024-09-10T08:06:51.850146+0000","last_became_peered":"2024-09-10T08:06:51.850146+0000","last_unstale":"2024-09-10T08:07:04.444804+0000","last_undegraded":"2024-09-10T08:07:04.444804+0000","last_fullsized":"2024-09-10T08:07:04.444804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:28.327887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.429015+0000","last_change":"2024-09-10T08:06:53.922375+0000","last_active":"2024-09-10T08:07:02.429015+0000","last_peered":"2024-09-10T08:07:02.429015+0000","last_clean":"2024-09-10T08:07:02.429015+0000","last_became_active":"2024-09-10T08:06:53.922038+0000","last_became_peered":"2024-09-10T08:06:53.922038+0000","last_unstale":"2024-09-10T08:07:02.429015+0000","last_undegraded":"2024-09-10T08:07:02.429015+0000","last_fullsized":"2024-09-10T08:07:02.429015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:32.710083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:03.149639+0000","last_change":"2024-09-10T08:07:02.419694+0000","last_active":"2024-09-10T08:07:03.149639+0000","last_peered":"2024-09-10T08:07:03.149639+0000","last_clean":"2024-09-10T08:07:03.149639+0000","last_became_active":"2024-09-10T08:07:02.415181+0000","last_became_peered":"2024-09-10T08:07:02.415181+0000","last_unstale":"2024-09-10T08:07:03.149639+0000","last_undegraded":"2024-09-10T08:07:03.149639+0000","last_fullsized":"2024-09-10T08:07:03.149639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:01.023611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409406+0000","last_change":"2024-09-10T08:06:53.934546+0000","last_active":"2024-09-10T08:07:02.409406+0000","last_peered":"2024-09-10T08:07:02.409406+0000","last_clean":"2024-09-10T08:07:02.409406+0000","last_became_active":"2024-09-10T08:06:53.933883+0000","last_became_peered":"2024-09-10T08:06:53.933883+0000","last_unstale":"2024-09-10T08:07:02.409406+0000","last_undegraded":"2024-09-10T08:07:02.409406+0000","last_fullsized":"2024-09-10T08:07:02.409406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:09.396870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.414803+0000","last_change":"2024-09-10T08:06:53.925407+0000","last_active":"2024-09-10T08:07:02.414803+0000","last_peered":"2024-09-10T08:07:02.414803+0000","last_clean":"2024-09-10T08:07:02.414803+0000","last_became_active":"2024-09-10T08:06:53.925057+0000","last_became_peered":"2024-09-10T08:06:53.925057+0000","last_unstale":"2024-09-10T08:07:02.414803+0000","last_undegraded":"2024-09-10T08:07:02.414803+0000","last_fullsized":"2024-09-10T08:07:02.414803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:52.012219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.467437+0000","last_change":"2024-09-10T08:06:51.852922+0000","last_active":"2024-09-10T08:07:04.467437+0000","last_peered":"2024-09-10T08:07:04.467437+0000","last_clean":"2024-09-10T08:07:04.467437+0000","last_became_active":"2024-09-10T08:06:51.852354+0000","last_became_peered":"2024-09-10T08:06:51.852354+0000","last_unstale":"2024-09-10T08:07:04.467437+0000","last_undegraded":"2024-09-10T08:07:04.467437+0000","last_fullsized":"2024-09-10T08:07:04.467437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:21.559686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427871+0000","last_change":"2024-09-10T08:06:53.932155+0000","last_active":"2024-09-10T08:07:02.427871+0000","last_peered":"2024-09-10T08:07:02.427871+0000","last_clean":"2024-09-10T08:07:02.427871+0000","last_became_active":"2024-09-10T08:06:53.931688+0000","last_became_peered":"2024-09-10T08:06:53.931688+0000","last_unstale":"2024-09-10T08:07:02.427871+0000","last_undegraded":"2024-09-10T08:07:02.427871+0000","last_fullsized":"2024-09-10T08:07:02.427871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:58.481716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.467357+0000","last_change":"2024-09-10T08:06:51.851900+0000","last_active":"2024-09-10T08:07:04.467357+0000","last_peered":"2024-09-10T08:07:04.467357+0000","last_clean":"2024-09-10T08:07:04.467357+0000","last_became_active":"2024-09-10T08:06:51.851509+0000","last_became_peered":"2024-09-10T08:06:51.851509+0000","last_unstale":"2024-09-10T08:07:04.467357+0000","last_undegraded":"2024-09-10T08:07:04.467357+0000","last_fullsized":"2024-09-10T08:07:04.467357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:41.250995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408641+0000","last_change":"2024-09-10T08:06:53.917320+0000","last_active":"2024-09-10T08:07:02.408641+0000","last_peered":"2024-09-10T08:07:02.408641+0000","last_clean":"2024-09-10T08:07:02.408641+0000","last_became_active":"2024-09-10T08:06:53.917027+0000","last_became_peered":"2024-09-10T08:06:53.917027+0000","last_unstale":"2024-09-10T08:07:02.408641+0000","last_undegraded":"2024-09-10T08:07:02.408641+0000","last_fullsized":"2024-09-10T08:07:02.408641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:08.882036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428812+0000","last_change":"2024-09-10T08:06:52.046168+0000","last_active":"2024-09-10T08:07:02.428812+0000","last_peered":"2024-09-10T08:07:02.428812+0000","last_clean":"2024-09-10T08:07:02.428812+0000","last_became_active":"2024-09-10T08:06:52.045825+0000","last_became_peered":"2024-09-10T08:06:52.045825+0000","last_unstale":"2024-09-10T08:07:02.428812+0000","last_undegraded":"2024-09-10T08:07:02.428812+0000","last_fullsized":"2024-09-10T08:07:02.428812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:15.467875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428487+0000","last_change":"2024-09-10T08:06:53.922449+0000","last_active":"2024-09-10T08:07:02.428487+0000","last_peered":"2024-09-10T08:07:02.428487+0000","last_clean":"2024-09-10T08:07:02.428487+0000","last_became_active":"2024-09-10T08:06:53.922123+0000","last_became_peered":"2024-09-10T08:06:53.922123+0000","last_unstale":"2024-09-10T08:07:02.428487+0000","last_undegraded":"2024-09-10T08:07:02.428487+0000","last_fullsized":"2024-09-10T08:07:02.428487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:44.424257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:16.489815+0000","last_change":"2024-09-10T08:06:51.847689+0000","last_active":"2024-09-10T08:07:16.489815+0000","last_peered":"2024-09-10T08:07:16.489815+0000","last_clean":"2024-09-10T08:07:16.489815+0000","last_became_active":"2024-09-10T08:06:51.847394+0000","last_became_peered":"2024-09-10T08:06:51.847394+0000","last_unstale":"2024-09-10T08:07:16.489815+0000","last_undegraded":"2024-09-10T08:07:16.489815+0000","last_fullsized":"2024-09-10T08:07:16.489815+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:58.581814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53617,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":168,"num_read_kb":147,"num_write":230,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":160851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285538,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547218,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":438048,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":1075464,"data_compressed":42108,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":437563,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168609,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":437919,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397541,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":1030068,"data_compressed":42108,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561067,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":437280,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":1029746,"data_compressed":42108,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":437253,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":437105,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":485496,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":484995,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":439012,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34671,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34671,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34671,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":48554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":49055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:07:20.626 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T08:07:20.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:20 smithi100 ceph-mon[35102]: pgmap v292: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 19 op/s 2024-09-10T08:07:20.882 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:20.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:20 smithi153 ceph-mon[35609]: pgmap v292: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 KiB/s wr, 19 op/s 2024-09-10T08:07:21.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.395+0000 7fcb9b24d640 1 -- 172.21.15.22:0/770624181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb94102ef0 msgr2=0x7fcb9410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:21.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.395+0000 7fcb9b24d640 1 --2- 172.21.15.22:0/770624181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb94102ef0 0x7fcb9410da40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009ca0 tx=0x7fcb8c02a950 comp rx=0 tx=0).stop 2024-09-10T08:07:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.395+0000 7fcb9b24d640 1 -- 172.21.15.22:0/770624181 shutdown_connections 2024-09-10T08:07:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.395+0000 7fcb9b24d640 1 --2- 172.21.15.22:0/770624181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb94102ef0 0x7fcb9410da40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.395+0000 7fcb9b24d640 1 --2- 172.21.15.22:0/770624181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb94102570 0x7fcb941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.395+0000 7fcb9b24d640 1 --2- 172.21.15.22:0/770624181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94100e20 0x7fcb94101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.395+0000 7fcb9b24d640 1 -- 172.21.15.22:0/770624181 >> 172.21.15.22:0/770624181 conn(0x7fcb940fc7d0 msgr2=0x7fcb940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.395+0000 7fcb9b24d640 1 -- 172.21.15.22:0/770624181 shutdown_connections 2024-09-10T08:07:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.395+0000 7fcb9b24d640 1 -- 172.21.15.22:0/770624181 wait complete. 2024-09-10T08:07:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb9b24d640 1 Processor -- start 2024-09-10T08:07:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb9b24d640 1 -- start start 2024-09-10T08:07:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb9b24d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb94100e20 0x7fcb941984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb9b24d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb94102570 0x7fcb94198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:21.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb9b24d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94102ef0 0x7fcb9419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb9b24d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcb94110fa0 con 0x7fcb94102570 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb9b24d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb94110e20 con 0x7fcb94100e20 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb9b24d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcb94111120 con 0x7fcb94102ef0 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb93fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb94102570 0x7fcb94198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb93fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb94102570 0x7fcb94198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41448/0 (socket says 172.21.15.22:41448) 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb93fff640 1 -- 172.21.15.22:0/2189865057 learned_addr learned my addr 172.21.15.22:0/2189865057 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb98fe9640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb94100e20 0x7fcb941984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb997ea640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94102ef0 0x7fcb9419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb93fff640 1 -- 172.21.15.22:0/2189865057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94102ef0 msgr2=0x7fcb9419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb93fff640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94102ef0 0x7fcb9419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb93fff640 1 -- 172.21.15.22:0/2189865057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb94100e20 msgr2=0x7fcb941984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb93fff640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb94100e20 0x7fcb941984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:21.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb93fff640 1 -- 172.21.15.22:0/2189865057 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9419d480 con 0x7fcb94102570 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb997ea640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94102ef0 0x7fcb9419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.396+0000 7fcb93fff640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb94102570 0x7fcb94198a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000c890 tx=0x7fcb8000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.397+0000 7fcb91ffb640 1 -- 172.21.15.22:0/2189865057 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb80004220 con 0x7fcb94102570 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.397+0000 7fcb91ffb640 1 -- 172.21.15.22:0/2189865057 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb800043c0 con 0x7fcb94102570 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.397+0000 7fcb9b24d640 1 -- 172.21.15.22:0/2189865057 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb9419d770 con 0x7fcb94102570 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.397+0000 7fcb91ffb640 1 -- 172.21.15.22:0/2189865057 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb800049e0 con 0x7fcb94102570 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.397+0000 7fcb9b24d640 1 -- 172.21.15.22:0/2189865057 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb941a5050 con 0x7fcb94102570 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.398+0000 7fcb9b24d640 1 -- 172.21.15.22:0/2189865057 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb94101200 con 0x7fcb94102570 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.399+0000 7fcb91ffb640 1 -- 172.21.15.22:0/2189865057 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fcb800079b0 con 0x7fcb94102570 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.400+0000 7fcb91ffb640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fcb840a2c10 0x7fcb840a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.400+0000 7fcb98fe9640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fcb840a2c10 0x7fcb840a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.400+0000 7fcb91ffb640 1 -- 172.21.15.22:0/2189865057 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fcb800cf370 con 0x7fcb94102570 2024-09-10T08:07:21.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.400+0000 7fcb98fe9640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fcb840a2c10 0x7fcb840a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009890 tx=0x7fcb88008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:21.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.403+0000 7fcb91ffb640 1 -- 172.21.15.22:0/2189865057 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb80014030 con 0x7fcb94102570 2024-09-10T08:07:21.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.576+0000 7fcb9b24d640 1 -- 172.21.15.22:0/2189865057 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb94062630 con 0x7fcb840a2c10 2024-09-10T08:07:21.576 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:21 smithi022 ceph-mon[30854]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:07:21.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.585+0000 7fcb91ffb640 1 -- 172.21.15.22:0/2189865057 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259010 (secure 0 0 0) 0x7fcb94062630 con 0x7fcb840a2c10 2024-09-10T08:07:21.587 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:07:21.588 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-10T08:07:21.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.588+0000 7fcb9b24d640 1 -- 172.21.15.22:0/2189865057 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fcb840a2c10 msgr2=0x7fcb840a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:21.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.588+0000 7fcb9b24d640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fcb840a2c10 0x7fcb840a50d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009890 tx=0x7fcb88008040 comp rx=0 tx=0).stop 2024-09-10T08:07:21.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.588+0000 7fcb9b24d640 1 -- 172.21.15.22:0/2189865057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb94102570 msgr2=0x7fcb94198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:21.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.588+0000 7fcb9b24d640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb94102570 0x7fcb94198a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb8000c890 tx=0x7fcb8000cd50 comp rx=0 tx=0).stop 2024-09-10T08:07:21.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.589+0000 7fcb9b24d640 1 -- 172.21.15.22:0/2189865057 shutdown_connections 2024-09-10T08:07:21.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.589+0000 7fcb9b24d640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fcb840a2c10 0x7fcb840a50d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:21.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.589+0000 7fcb9b24d640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb94102ef0 0x7fcb9419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:21.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.589+0000 7fcb9b24d640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb94102570 0x7fcb94198a10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:21.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.589+0000 7fcb9b24d640 1 --2- 172.21.15.22:0/2189865057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb94100e20 0x7fcb941984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:21.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.589+0000 7fcb9b24d640 1 -- 172.21.15.22:0/2189865057 >> 172.21.15.22:0/2189865057 conn(0x7fcb940fc7d0 msgr2=0x7fcb9406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:21.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.589+0000 7fcb9b24d640 1 -- 172.21.15.22:0/2189865057 shutdown_connections 2024-09-10T08:07:21.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:21.589+0000 7fcb9b24d640 1 -- 172.21.15.22:0/2189865057 wait complete. 2024-09-10T08:07:21.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:21 smithi100 ceph-mon[35102]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:07:21.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:21 smithi153 ceph-mon[35609]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:07:22.366 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-09-10T08:07:20.948498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644219,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":319,"num_read_kb":266,"num_write":413,"num_write_kb":3055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":338,"ondisk_log_size":338,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360404,"kb_used_data":11148,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581420,"statfs":{"total":1151940427776,"available":1151571374080,"internally_reserved":0,"allocated":11415552,"data_stored":7169949,"data_compressed":178551,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":38822,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":98,"num_write":23,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003271"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.410188+0000","last_change":"2024-09-10T08:06:53.919814+0000","last_active":"2024-09-10T08:07:02.410188+0000","last_peered":"2024-09-10T08:07:02.410188+0000","last_clean":"2024-09-10T08:07:02.410188+0000","last_became_active":"2024-09-10T08:06:53.919460+0000","last_became_peered":"2024-09-10T08:06:53.919460+0000","last_unstale":"2024-09-10T08:07:02.410188+0000","last_undegraded":"2024-09-10T08:07:02.410188+0000","last_fullsized":"2024-09-10T08:07:02.410188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:39.027064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408512+0000","last_change":"2024-09-10T08:06:53.921645+0000","last_active":"2024-09-10T08:07:02.408512+0000","last_peered":"2024-09-10T08:07:02.408512+0000","last_clean":"2024-09-10T08:07:02.408512+0000","last_became_active":"2024-09-10T08:06:53.921346+0000","last_became_peered":"2024-09-10T08:06:53.921346+0000","last_unstale":"2024-09-10T08:07:02.408512+0000","last_undegraded":"2024-09-10T08:07:02.408512+0000","last_fullsized":"2024-09-10T08:07:02.408512+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:48.830824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408729+0000","last_change":"2024-09-10T08:06:53.920736+0000","last_active":"2024-09-10T08:07:02.408729+0000","last_peered":"2024-09-10T08:07:02.408729+0000","last_clean":"2024-09-10T08:07:02.408729+0000","last_became_active":"2024-09-10T08:06:53.920422+0000","last_became_peered":"2024-09-10T08:06:53.920422+0000","last_unstale":"2024-09-10T08:07:02.408729+0000","last_undegraded":"2024-09-10T08:07:02.408729+0000","last_fullsized":"2024-09-10T08:07:02.408729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:32.025610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.413898+0000","last_change":"2024-09-10T08:07:02.413480+0000","last_active":"2024-09-10T08:07:02.413898+0000","last_peered":"2024-09-10T08:07:02.413898+0000","last_clean":"2024-09-10T08:07:02.413898+0000","last_became_active":"2024-09-10T08:07:02.413146+0000","last_became_peered":"2024-09-10T08:07:02.413146+0000","last_unstale":"2024-09-10T08:07:02.413898+0000","last_undegraded":"2024-09-10T08:07:02.413898+0000","last_fullsized":"2024-09-10T08:07:02.413898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:47.348670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411798+0000","last_change":"2024-09-10T08:06:53.915703+0000","last_active":"2024-09-10T08:07:02.411798+0000","last_peered":"2024-09-10T08:07:02.411798+0000","last_clean":"2024-09-10T08:07:02.411798+0000","last_became_active":"2024-09-10T08:06:53.915375+0000","last_became_peered":"2024-09-10T08:06:53.915375+0000","last_unstale":"2024-09-10T08:07:02.411798+0000","last_undegraded":"2024-09-10T08:07:02.411798+0000","last_fullsized":"2024-09-10T08:07:02.411798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:40.425133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427232+0000","last_change":"2024-09-10T08:06:53.927711+0000","last_active":"2024-09-10T08:07:02.427232+0000","last_peered":"2024-09-10T08:07:02.427232+0000","last_clean":"2024-09-10T08:07:02.427232+0000","last_became_active":"2024-09-10T08:06:53.927398+0000","last_became_peered":"2024-09-10T08:06:53.927398+0000","last_unstale":"2024-09-10T08:07:02.427232+0000","last_undegraded":"2024-09-10T08:07:02.427232+0000","last_fullsized":"2024-09-10T08:07:02.427232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:00.614829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409283+0000","last_change":"2024-09-10T08:06:53.924069+0000","last_active":"2024-09-10T08:07:02.409283+0000","last_peered":"2024-09-10T08:07:02.409283+0000","last_clean":"2024-09-10T08:07:02.409283+0000","last_became_active":"2024-09-10T08:06:53.923743+0000","last_became_peered":"2024-09-10T08:06:53.923743+0000","last_unstale":"2024-09-10T08:07:02.409283+0000","last_undegraded":"2024-09-10T08:07:02.409283+0000","last_fullsized":"2024-09-10T08:07:02.409283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:18.943432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428903+0000","last_change":"2024-09-10T08:06:53.921446+0000","last_active":"2024-09-10T08:07:02.428903+0000","last_peered":"2024-09-10T08:07:02.428903+0000","last_clean":"2024-09-10T08:07:02.428903+0000","last_became_active":"2024-09-10T08:06:53.921141+0000","last_became_peered":"2024-09-10T08:06:53.921141+0000","last_unstale":"2024-09-10T08:07:02.428903+0000","last_undegraded":"2024-09-10T08:07:02.428903+0000","last_fullsized":"2024-09-10T08:07:02.428903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:58.255095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428152+0000","last_change":"2024-09-10T08:06:53.919967+0000","last_active":"2024-09-10T08:07:02.428152+0000","last_peered":"2024-09-10T08:07:02.428152+0000","last_clean":"2024-09-10T08:07:02.428152+0000","last_became_active":"2024-09-10T08:06:53.919600+0000","last_became_peered":"2024-09-10T08:06:53.919600+0000","last_unstale":"2024-09-10T08:07:02.428152+0000","last_undegraded":"2024-09-10T08:07:02.428152+0000","last_fullsized":"2024-09-10T08:07:02.428152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:32.298128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428189+0000","last_change":"2024-09-10T08:06:53.925851+0000","last_active":"2024-09-10T08:07:02.428189+0000","last_peered":"2024-09-10T08:07:02.428189+0000","last_clean":"2024-09-10T08:07:02.428189+0000","last_became_active":"2024-09-10T08:06:53.925548+0000","last_became_peered":"2024-09-10T08:06:53.925548+0000","last_unstale":"2024-09-10T08:07:02.428189+0000","last_undegraded":"2024-09-10T08:07:02.428189+0000","last_fullsized":"2024-09-10T08:07:02.428189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:11.231320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409681+0000","last_change":"2024-09-10T08:06:53.935162+0000","last_active":"2024-09-10T08:07:02.409681+0000","last_peered":"2024-09-10T08:07:02.409681+0000","last_clean":"2024-09-10T08:07:02.409681+0000","last_became_active":"2024-09-10T08:06:53.934790+0000","last_became_peered":"2024-09-10T08:06:53.934790+0000","last_unstale":"2024-09-10T08:07:02.409681+0000","last_undegraded":"2024-09-10T08:07:02.409681+0000","last_fullsized":"2024-09-10T08:07:02.409681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:10.729869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407066+0000","last_change":"2024-09-10T08:06:53.926420+0000","last_active":"2024-09-10T08:07:02.407066+0000","last_peered":"2024-09-10T08:07:02.407066+0000","last_clean":"2024-09-10T08:07:02.407066+0000","last_became_active":"2024-09-10T08:06:53.925016+0000","last_became_peered":"2024-09-10T08:06:53.925016+0000","last_unstale":"2024-09-10T08:07:02.407066+0000","last_undegraded":"2024-09-10T08:07:02.407066+0000","last_fullsized":"2024-09-10T08:07:02.407066+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:07.459413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428465+0000","last_change":"2024-09-10T08:06:53.922632+0000","last_active":"2024-09-10T08:07:02.428465+0000","last_peered":"2024-09-10T08:07:02.428465+0000","last_clean":"2024-09-10T08:07:02.428465+0000","last_became_active":"2024-09-10T08:06:53.922328+0000","last_became_peered":"2024-09-10T08:06:53.922328+0000","last_unstale":"2024-09-10T08:07:02.428465+0000","last_undegraded":"2024-09-10T08:07:02.428465+0000","last_fullsized":"2024-09-10T08:07:02.428465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:14.136508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408385+0000","last_change":"2024-09-10T08:06:53.922697+0000","last_active":"2024-09-10T08:07:02.408385+0000","last_peered":"2024-09-10T08:07:02.408385+0000","last_clean":"2024-09-10T08:07:02.408385+0000","last_became_active":"2024-09-10T08:06:53.922392+0000","last_became_peered":"2024-09-10T08:06:53.922392+0000","last_unstale":"2024-09-10T08:07:02.408385+0000","last_undegraded":"2024-09-10T08:07:02.408385+0000","last_fullsized":"2024-09-10T08:07:02.408385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:24.823244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408339+0000","last_change":"2024-09-10T08:06:53.926966+0000","last_active":"2024-09-10T08:07:02.408339+0000","last_peered":"2024-09-10T08:07:02.408339+0000","last_clean":"2024-09-10T08:07:02.408339+0000","last_became_active":"2024-09-10T08:06:53.926611+0000","last_became_peered":"2024-09-10T08:06:53.926611+0000","last_unstale":"2024-09-10T08:07:02.408339+0000","last_undegraded":"2024-09-10T08:07:02.408339+0000","last_fullsized":"2024-09-10T08:07:02.408339+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:20.810104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428439+0000","last_change":"2024-09-10T08:06:53.928443+0000","last_active":"2024-09-10T08:07:02.428439+0000","last_peered":"2024-09-10T08:07:02.428439+0000","last_clean":"2024-09-10T08:07:02.428439+0000","last_became_active":"2024-09-10T08:06:53.926742+0000","last_became_peered":"2024-09-10T08:06:53.926742+0000","last_unstale":"2024-09-10T08:07:02.428439+0000","last_undegraded":"2024-09-10T08:07:02.428439+0000","last_fullsized":"2024-09-10T08:07:02.428439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:46.056335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.410219+0000","last_change":"2024-09-10T08:06:53.922295+0000","last_active":"2024-09-10T08:07:02.410219+0000","last_peered":"2024-09-10T08:07:02.410219+0000","last_clean":"2024-09-10T08:07:02.410219+0000","last_became_active":"2024-09-10T08:06:53.921920+0000","last_became_peered":"2024-09-10T08:06:53.921920+0000","last_unstale":"2024-09-10T08:07:02.410219+0000","last_undegraded":"2024-09-10T08:07:02.410219+0000","last_fullsized":"2024-09-10T08:07:02.410219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:41.005973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.406177+0000","last_change":"2024-09-10T08:06:53.926107+0000","last_active":"2024-09-10T08:07:02.406177+0000","last_peered":"2024-09-10T08:07:02.406177+0000","last_clean":"2024-09-10T08:07:02.406177+0000","last_became_active":"2024-09-10T08:06:53.925763+0000","last_became_peered":"2024-09-10T08:06:53.925763+0000","last_unstale":"2024-09-10T08:07:02.406177+0000","last_undegraded":"2024-09-10T08:07:02.406177+0000","last_fullsized":"2024-09-10T08:07:02.406177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:25.756418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407360+0000","last_change":"2024-09-10T08:06:53.917946+0000","last_active":"2024-09-10T08:07:02.407360+0000","last_peered":"2024-09-10T08:07:02.407360+0000","last_clean":"2024-09-10T08:07:02.407360+0000","last_became_active":"2024-09-10T08:06:53.917597+0000","last_became_peered":"2024-09-10T08:06:53.917597+0000","last_unstale":"2024-09-10T08:07:02.407360+0000","last_undegraded":"2024-09-10T08:07:02.407360+0000","last_fullsized":"2024-09-10T08:07:02.407360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:36.218971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409658+0000","last_change":"2024-09-10T08:06:53.926365+0000","last_active":"2024-09-10T08:07:02.409658+0000","last_peered":"2024-09-10T08:07:02.409658+0000","last_clean":"2024-09-10T08:07:02.409658+0000","last_became_active":"2024-09-10T08:06:53.926045+0000","last_became_peered":"2024-09-10T08:06:53.926045+0000","last_unstale":"2024-09-10T08:07:02.409658+0000","last_undegraded":"2024-09-10T08:07:02.409658+0000","last_fullsized":"2024-09-10T08:07:02.409658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:31.300495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428586+0000","last_change":"2024-09-10T08:06:53.924758+0000","last_active":"2024-09-10T08:07:02.428586+0000","last_peered":"2024-09-10T08:07:02.428586+0000","last_clean":"2024-09-10T08:07:02.428586+0000","last_became_active":"2024-09-10T08:06:53.924456+0000","last_became_peered":"2024-09-10T08:06:53.924456+0000","last_unstale":"2024-09-10T08:07:02.428586+0000","last_undegraded":"2024-09-10T08:07:02.428586+0000","last_fullsized":"2024-09-10T08:07:02.428586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:23.912453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427744+0000","last_change":"2024-09-10T08:06:53.929854+0000","last_active":"2024-09-10T08:07:02.427744+0000","last_peered":"2024-09-10T08:07:02.427744+0000","last_clean":"2024-09-10T08:07:02.427744+0000","last_became_active":"2024-09-10T08:06:53.929537+0000","last_became_peered":"2024-09-10T08:06:53.929537+0000","last_unstale":"2024-09-10T08:07:02.427744+0000","last_undegraded":"2024-09-10T08:07:02.427744+0000","last_fullsized":"2024-09-10T08:07:02.427744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:42.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.412582+0000","last_change":"2024-09-10T08:07:02.412169+0000","last_active":"2024-09-10T08:07:02.412582+0000","last_peered":"2024-09-10T08:07:02.412582+0000","last_clean":"2024-09-10T08:07:02.412582+0000","last_became_active":"2024-09-10T08:07:02.411592+0000","last_became_peered":"2024-09-10T08:07:02.411592+0000","last_unstale":"2024-09-10T08:07:02.412582+0000","last_undegraded":"2024-09-10T08:07:02.412582+0000","last_fullsized":"2024-09-10T08:07:02.412582+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:43.477920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.413886+0000","last_change":"2024-09-10T08:06:53.915136+0000","last_active":"2024-09-10T08:07:02.413886+0000","last_peered":"2024-09-10T08:07:02.413886+0000","last_clean":"2024-09-10T08:07:02.413886+0000","last_became_active":"2024-09-10T08:06:53.914825+0000","last_became_peered":"2024-09-10T08:06:53.914825+0000","last_unstale":"2024-09-10T08:07:02.413886+0000","last_undegraded":"2024-09-10T08:07:02.413886+0000","last_fullsized":"2024-09-10T08:07:02.413886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:17.619930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428479+0000","last_change":"2024-09-10T08:06:53.925991+0000","last_active":"2024-09-10T08:07:02.428479+0000","last_peered":"2024-09-10T08:07:02.428479+0000","last_clean":"2024-09-10T08:07:02.428479+0000","last_became_active":"2024-09-10T08:06:53.925657+0000","last_became_peered":"2024-09-10T08:06:53.925657+0000","last_unstale":"2024-09-10T08:07:02.428479+0000","last_undegraded":"2024-09-10T08:07:02.428479+0000","last_fullsized":"2024-09-10T08:07:02.428479+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:54.562209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407466+0000","last_change":"2024-09-10T08:06:53.931858+0000","last_active":"2024-09-10T08:07:02.407466+0000","last_peered":"2024-09-10T08:07:02.407466+0000","last_clean":"2024-09-10T08:07:02.407466+0000","last_became_active":"2024-09-10T08:06:53.931520+0000","last_became_peered":"2024-09-10T08:06:53.931520+0000","last_unstale":"2024-09-10T08:07:02.407466+0000","last_undegraded":"2024-09-10T08:07:02.407466+0000","last_fullsized":"2024-09-10T08:07:02.407466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:12.750769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409564+0000","last_change":"2024-09-10T08:06:53.915466+0000","last_active":"2024-09-10T08:07:02.409564+0000","last_peered":"2024-09-10T08:07:02.409564+0000","last_clean":"2024-09-10T08:07:02.409564+0000","last_became_active":"2024-09-10T08:06:53.915115+0000","last_became_peered":"2024-09-10T08:06:53.915115+0000","last_unstale":"2024-09-10T08:07:02.409564+0000","last_undegraded":"2024-09-10T08:07:02.409564+0000","last_fullsized":"2024-09-10T08:07:02.409564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:05.436530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428345+0000","last_change":"2024-09-10T08:06:53.928001+0000","last_active":"2024-09-10T08:07:02.428345+0000","last_peered":"2024-09-10T08:07:02.428345+0000","last_clean":"2024-09-10T08:07:02.428345+0000","last_became_active":"2024-09-10T08:06:53.927693+0000","last_became_peered":"2024-09-10T08:06:53.927693+0000","last_unstale":"2024-09-10T08:07:02.428345+0000","last_undegraded":"2024-09-10T08:07:02.428345+0000","last_fullsized":"2024-09-10T08:07:02.428345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:30.712600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408691+0000","last_change":"2024-09-10T08:06:53.927006+0000","last_active":"2024-09-10T08:07:02.408691+0000","last_peered":"2024-09-10T08:07:02.408691+0000","last_clean":"2024-09-10T08:07:02.408691+0000","last_became_active":"2024-09-10T08:06:53.925607+0000","last_became_peered":"2024-09-10T08:06:53.925607+0000","last_unstale":"2024-09-10T08:07:02.408691+0000","last_undegraded":"2024-09-10T08:07:02.408691+0000","last_fullsized":"2024-09-10T08:07:02.408691+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:31.640763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407216+0000","last_change":"2024-09-10T08:06:53.917197+0000","last_active":"2024-09-10T08:07:02.407216+0000","last_peered":"2024-09-10T08:07:02.407216+0000","last_clean":"2024-09-10T08:07:02.407216+0000","last_became_active":"2024-09-10T08:06:53.916830+0000","last_became_peered":"2024-09-10T08:06:53.916830+0000","last_unstale":"2024-09-10T08:07:02.407216+0000","last_undegraded":"2024-09-10T08:07:02.407216+0000","last_fullsized":"2024-09-10T08:07:02.407216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:00.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.416146+0000","last_change":"2024-09-10T08:07:02.416146+0000","last_active":"2024-09-10T08:07:02.416146+0000","last_peered":"2024-09-10T08:07:02.416146+0000","last_clean":"2024-09-10T08:07:02.416146+0000","last_became_active":"2024-09-10T08:07:02.415734+0000","last_became_peered":"2024-09-10T08:07:02.415734+0000","last_unstale":"2024-09-10T08:07:02.416146+0000","last_undegraded":"2024-09-10T08:07:02.416146+0000","last_fullsized":"2024-09-10T08:07:02.416146+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:26.811995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409617+0000","last_change":"2024-09-10T08:06:53.923406+0000","last_active":"2024-09-10T08:07:02.409617+0000","last_peered":"2024-09-10T08:07:02.409617+0000","last_clean":"2024-09-10T08:07:02.409617+0000","last_became_active":"2024-09-10T08:06:53.923012+0000","last_became_peered":"2024-09-10T08:06:53.923012+0000","last_unstale":"2024-09-10T08:07:02.409617+0000","last_undegraded":"2024-09-10T08:07:02.409617+0000","last_fullsized":"2024-09-10T08:07:02.409617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:39.426727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411368+0000","last_change":"2024-09-10T08:06:53.914764+0000","last_active":"2024-09-10T08:07:02.411368+0000","last_peered":"2024-09-10T08:07:02.411368+0000","last_clean":"2024-09-10T08:07:02.411368+0000","last_became_active":"2024-09-10T08:06:53.914431+0000","last_became_peered":"2024-09-10T08:06:53.914431+0000","last_unstale":"2024-09-10T08:07:02.411368+0000","last_undegraded":"2024-09-10T08:07:02.411368+0000","last_fullsized":"2024-09-10T08:07:02.411368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:29.703828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:18.485152+0000","last_change":"2024-09-10T08:06:51.854086+0000","last_active":"2024-09-10T08:07:18.485152+0000","last_peered":"2024-09-10T08:07:18.485152+0000","last_clean":"2024-09-10T08:07:18.485152+0000","last_became_active":"2024-09-10T08:06:51.853394+0000","last_became_peered":"2024-09-10T08:06:51.853394+0000","last_unstale":"2024-09-10T08:07:18.485152+0000","last_undegraded":"2024-09-10T08:07:18.485152+0000","last_fullsized":"2024-09-10T08:07:18.485152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:33.688809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.414270+0000","last_change":"2024-09-10T08:06:53.927461+0000","last_active":"2024-09-10T08:07:02.414270+0000","last_peered":"2024-09-10T08:07:02.414270+0000","last_clean":"2024-09-10T08:07:02.414270+0000","last_became_active":"2024-09-10T08:06:53.927152+0000","last_became_peered":"2024-09-10T08:06:53.927152+0000","last_unstale":"2024-09-10T08:07:02.414270+0000","last_undegraded":"2024-09-10T08:07:02.414270+0000","last_fullsized":"2024-09-10T08:07:02.414270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:12.001671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.444057+0000","last_change":"2024-09-10T08:06:51.848621+0000","last_active":"2024-09-10T08:07:04.444057+0000","last_peered":"2024-09-10T08:07:04.444057+0000","last_clean":"2024-09-10T08:07:04.444057+0000","last_became_active":"2024-09-10T08:06:51.848239+0000","last_became_peered":"2024-09-10T08:06:51.848239+0000","last_unstale":"2024-09-10T08:07:04.444057+0000","last_undegraded":"2024-09-10T08:07:04.444057+0000","last_fullsized":"2024-09-10T08:07:04.444057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:00.816865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:03.436227+0000","last_change":"2024-09-10T08:06:51.844344+0000","last_active":"2024-09-10T08:07:03.436227+0000","last_peered":"2024-09-10T08:07:03.436227+0000","last_clean":"2024-09-10T08:07:03.436227+0000","last_became_active":"2024-09-10T08:06:51.844054+0000","last_became_peered":"2024-09-10T08:06:51.844054+0000","last_unstale":"2024-09-10T08:07:03.436227+0000","last_undegraded":"2024-09-10T08:07:03.436227+0000","last_fullsized":"2024-09-10T08:07:03.436227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:43.646632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428861+0000","last_change":"2024-09-10T08:06:53.914172+0000","last_active":"2024-09-10T08:07:02.428861+0000","last_peered":"2024-09-10T08:07:02.428861+0000","last_clean":"2024-09-10T08:07:02.428861+0000","last_became_active":"2024-09-10T08:06:53.913837+0000","last_became_peered":"2024-09-10T08:06:53.913837+0000","last_unstale":"2024-09-10T08:07:02.428861+0000","last_undegraded":"2024-09-10T08:07:02.428861+0000","last_fullsized":"2024-09-10T08:07:02.428861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:54.095685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.463531+0000","last_change":"2024-09-10T08:06:51.852474+0000","last_active":"2024-09-10T08:07:04.463531+0000","last_peered":"2024-09-10T08:07:04.463531+0000","last_clean":"2024-09-10T08:07:04.463531+0000","last_became_active":"2024-09-10T08:06:51.852097+0000","last_became_peered":"2024-09-10T08:06:51.852097+0000","last_unstale":"2024-09-10T08:07:04.463531+0000","last_undegraded":"2024-09-10T08:07:04.463531+0000","last_fullsized":"2024-09-10T08:07:04.463531+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:20.611988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.405898+0000","last_change":"2024-09-10T08:06:53.925345+0000","last_active":"2024-09-10T08:07:02.405898+0000","last_peered":"2024-09-10T08:07:02.405898+0000","last_clean":"2024-09-10T08:07:02.405898+0000","last_became_active":"2024-09-10T08:06:53.925017+0000","last_became_peered":"2024-09-10T08:06:53.925017+0000","last_unstale":"2024-09-10T08:07:02.405898+0000","last_undegraded":"2024-09-10T08:07:02.405898+0000","last_fullsized":"2024-09-10T08:07:02.405898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:22.692658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":54,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:17.482913+0000","last_change":"2024-09-10T08:06:51.849126+0000","last_active":"2024-09-10T08:07:17.482913+0000","last_peered":"2024-09-10T08:07:17.482913+0000","last_clean":"2024-09-10T08:07:17.482913+0000","last_became_active":"2024-09-10T08:06:51.848504+0000","last_became_peered":"2024-09-10T08:06:51.848504+0000","last_unstale":"2024-09-10T08:07:17.482913+0000","last_undegraded":"2024-09-10T08:07:17.482913+0000","last_fullsized":"2024-09-10T08:07:17.482913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:36.691846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428899+0000","last_change":"2024-09-10T08:06:53.930777+0000","last_active":"2024-09-10T08:07:02.428899+0000","last_peered":"2024-09-10T08:07:02.428899+0000","last_clean":"2024-09-10T08:07:02.428899+0000","last_became_active":"2024-09-10T08:06:53.929781+0000","last_became_peered":"2024-09-10T08:06:53.929781+0000","last_unstale":"2024-09-10T08:07:02.428899+0000","last_undegraded":"2024-09-10T08:07:02.428899+0000","last_fullsized":"2024-09-10T08:07:02.428899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:07.184254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.465673+0000","last_change":"2024-09-10T08:07:02.431452+0000","last_active":"2024-09-10T08:07:04.465673+0000","last_peered":"2024-09-10T08:07:04.465673+0000","last_clean":"2024-09-10T08:07:04.465673+0000","last_became_active":"2024-09-10T08:07:02.430794+0000","last_became_peered":"2024-09-10T08:07:02.430794+0000","last_unstale":"2024-09-10T08:07:04.465673+0000","last_undegraded":"2024-09-10T08:07:04.465673+0000","last_fullsized":"2024-09-10T08:07:04.465673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:48.313101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408754+0000","last_change":"2024-09-10T08:06:53.924896+0000","last_active":"2024-09-10T08:07:02.408754+0000","last_peered":"2024-09-10T08:07:02.408754+0000","last_clean":"2024-09-10T08:07:02.408754+0000","last_became_active":"2024-09-10T08:06:53.924593+0000","last_became_peered":"2024-09-10T08:06:53.924593+0000","last_unstale":"2024-09-10T08:07:02.408754+0000","last_undegraded":"2024-09-10T08:07:02.408754+0000","last_fullsized":"2024-09-10T08:07:02.408754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:49.802792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.444479+0000","last_change":"2024-09-10T08:06:52.045216+0000","last_active":"2024-09-10T08:07:04.444479+0000","last_peered":"2024-09-10T08:07:04.444479+0000","last_clean":"2024-09-10T08:07:04.444479+0000","last_became_active":"2024-09-10T08:06:52.044707+0000","last_became_peered":"2024-09-10T08:06:52.044707+0000","last_unstale":"2024-09-10T08:07:04.444479+0000","last_undegraded":"2024-09-10T08:07:04.444479+0000","last_fullsized":"2024-09-10T08:07:04.444479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:59.778427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427975+0000","last_change":"2024-09-10T08:06:53.932607+0000","last_active":"2024-09-10T08:07:02.427975+0000","last_peered":"2024-09-10T08:07:02.427975+0000","last_clean":"2024-09-10T08:07:02.427975+0000","last_became_active":"2024-09-10T08:06:53.932149+0000","last_became_peered":"2024-09-10T08:06:53.932149+0000","last_unstale":"2024-09-10T08:07:02.427975+0000","last_undegraded":"2024-09-10T08:07:02.427975+0000","last_fullsized":"2024-09-10T08:07:02.427975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:40.969547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'24","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:17.484978+0000","last_change":"2024-09-10T08:06:51.854321+0000","last_active":"2024-09-10T08:07:17.484978+0000","last_peered":"2024-09-10T08:07:17.484978+0000","last_clean":"2024-09-10T08:07:17.484978+0000","last_became_active":"2024-09-10T08:06:51.853931+0000","last_became_peered":"2024-09-10T08:06:51.853931+0000","last_unstale":"2024-09-10T08:07:17.484978+0000","last_undegraded":"2024-09-10T08:07:17.484978+0000","last_fullsized":"2024-09-10T08:07:17.484978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:30.930761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":62,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411799+0000","last_change":"2024-09-10T08:06:53.924899+0000","last_active":"2024-09-10T08:07:02.411799+0000","last_peered":"2024-09-10T08:07:02.411799+0000","last_clean":"2024-09-10T08:07:02.411799+0000","last_became_active":"2024-09-10T08:06:53.924571+0000","last_became_peered":"2024-09-10T08:06:53.924571+0000","last_unstale":"2024-09-10T08:07:02.411799+0000","last_undegraded":"2024-09-10T08:07:02.411799+0000","last_fullsized":"2024-09-10T08:07:02.411799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:04.681689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.467171+0000","last_change":"2024-09-10T08:06:51.851860+0000","last_active":"2024-09-10T08:07:04.467171+0000","last_peered":"2024-09-10T08:07:04.467171+0000","last_clean":"2024-09-10T08:07:04.467171+0000","last_became_active":"2024-09-10T08:06:51.851520+0000","last_became_peered":"2024-09-10T08:06:51.851520+0000","last_unstale":"2024-09-10T08:07:04.467171+0000","last_undegraded":"2024-09-10T08:07:04.467171+0000","last_fullsized":"2024-09-10T08:07:04.467171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.182866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427983+0000","last_change":"2024-09-10T08:06:53.924888+0000","last_active":"2024-09-10T08:07:02.427983+0000","last_peered":"2024-09-10T08:07:02.427983+0000","last_clean":"2024-09-10T08:07:02.427983+0000","last_became_active":"2024-09-10T08:06:53.924572+0000","last_became_peered":"2024-09-10T08:06:53.924572+0000","last_unstale":"2024-09-10T08:07:02.427983+0000","last_undegraded":"2024-09-10T08:07:02.427983+0000","last_fullsized":"2024-09-10T08:07:02.427983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:19.446554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.465505+0000","last_change":"2024-09-10T08:06:51.848665+0000","last_active":"2024-09-10T08:07:04.465505+0000","last_peered":"2024-09-10T08:07:04.465505+0000","last_clean":"2024-09-10T08:07:04.465505+0000","last_became_active":"2024-09-10T08:06:51.848301+0000","last_became_peered":"2024-09-10T08:06:51.848301+0000","last_unstale":"2024-09-10T08:07:04.465505+0000","last_undegraded":"2024-09-10T08:07:04.465505+0000","last_fullsized":"2024-09-10T08:07:04.465505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:32.754470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409650+0000","last_change":"2024-09-10T08:06:53.933953+0000","last_active":"2024-09-10T08:07:02.409650+0000","last_peered":"2024-09-10T08:07:02.409650+0000","last_clean":"2024-09-10T08:07:02.409650+0000","last_became_active":"2024-09-10T08:06:53.933590+0000","last_became_peered":"2024-09-10T08:06:53.933590+0000","last_unstale":"2024-09-10T08:07:02.409650+0000","last_undegraded":"2024-09-10T08:07:02.409650+0000","last_fullsized":"2024-09-10T08:07:02.409650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:54.530660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:19.486158+0000","last_change":"2024-09-10T08:06:51.847673+0000","last_active":"2024-09-10T08:07:19.486158+0000","last_peered":"2024-09-10T08:07:19.486158+0000","last_clean":"2024-09-10T08:07:19.486158+0000","last_became_active":"2024-09-10T08:06:51.847324+0000","last_became_peered":"2024-09-10T08:06:51.847324+0000","last_unstale":"2024-09-10T08:07:19.486158+0000","last_undegraded":"2024-09-10T08:07:19.486158+0000","last_fullsized":"2024-09-10T08:07:19.486158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:24.962333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409220+0000","last_change":"2024-09-10T08:06:53.929884+0000","last_active":"2024-09-10T08:07:02.409220+0000","last_peered":"2024-09-10T08:07:02.409220+0000","last_clean":"2024-09-10T08:07:02.409220+0000","last_became_active":"2024-09-10T08:06:53.927766+0000","last_became_peered":"2024-09-10T08:06:53.927766+0000","last_unstale":"2024-09-10T08:07:02.409220+0000","last_undegraded":"2024-09-10T08:07:02.409220+0000","last_fullsized":"2024-09-10T08:07:02.409220+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:18.403993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.458590+0000","last_change":"2024-09-10T08:07:02.425907+0000","last_active":"2024-09-10T08:07:04.458590+0000","last_peered":"2024-09-10T08:07:04.458590+0000","last_clean":"2024-09-10T08:07:04.458590+0000","last_became_active":"2024-09-10T08:07:02.416949+0000","last_became_peered":"2024-09-10T08:07:02.416949+0000","last_unstale":"2024-09-10T08:07:04.458590+0000","last_undegraded":"2024-09-10T08:07:04.458590+0000","last_fullsized":"2024-09-10T08:07:04.458590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:01.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.413786+0000","last_change":"2024-09-10T08:06:53.927620+0000","last_active":"2024-09-10T08:07:02.413786+0000","last_peered":"2024-09-10T08:07:02.413786+0000","last_clean":"2024-09-10T08:07:02.413786+0000","last_became_active":"2024-09-10T08:06:53.926543+0000","last_became_peered":"2024-09-10T08:06:53.926543+0000","last_unstale":"2024-09-10T08:07:02.413786+0000","last_undegraded":"2024-09-10T08:07:02.413786+0000","last_fullsized":"2024-09-10T08:07:02.413786+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:18.210472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.432980+0000","last_change":"2024-09-10T08:07:02.430550+0000","last_active":"2024-09-10T08:07:04.432980+0000","last_peered":"2024-09-10T08:07:04.432980+0000","last_clean":"2024-09-10T08:07:04.432980+0000","last_became_active":"2024-09-10T08:07:02.416317+0000","last_became_peered":"2024-09-10T08:07:02.416317+0000","last_unstale":"2024-09-10T08:07:04.432980+0000","last_undegraded":"2024-09-10T08:07:04.432980+0000","last_fullsized":"2024-09-10T08:07:04.432980+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:10.317471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409840+0000","last_change":"2024-09-10T08:06:53.925598+0000","last_active":"2024-09-10T08:07:02.409840+0000","last_peered":"2024-09-10T08:07:02.409840+0000","last_clean":"2024-09-10T08:07:02.409840+0000","last_became_active":"2024-09-10T08:06:53.925253+0000","last_became_peered":"2024-09-10T08:06:53.925253+0000","last_unstale":"2024-09-10T08:07:02.409840+0000","last_undegraded":"2024-09-10T08:07:02.409840+0000","last_fullsized":"2024-09-10T08:07:02.409840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:29.662057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.465757+0000","last_change":"2024-09-10T08:06:51.851790+0000","last_active":"2024-09-10T08:07:04.465757+0000","last_peered":"2024-09-10T08:07:04.465757+0000","last_clean":"2024-09-10T08:07:04.465757+0000","last_became_active":"2024-09-10T08:06:51.851417+0000","last_became_peered":"2024-09-10T08:06:51.851417+0000","last_unstale":"2024-09-10T08:07:04.465757+0000","last_undegraded":"2024-09-10T08:07:04.465757+0000","last_fullsized":"2024-09-10T08:07:04.465757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:41.432728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409698+0000","last_change":"2024-09-10T08:06:53.926530+0000","last_active":"2024-09-10T08:07:02.409698+0000","last_peered":"2024-09-10T08:07:02.409698+0000","last_clean":"2024-09-10T08:07:02.409698+0000","last_became_active":"2024-09-10T08:06:53.926191+0000","last_became_peered":"2024-09-10T08:06:53.926191+0000","last_unstale":"2024-09-10T08:07:02.409698+0000","last_undegraded":"2024-09-10T08:07:02.409698+0000","last_fullsized":"2024-09-10T08:07:02.409698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:09.789763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.458396+0000","last_change":"2024-09-10T08:06:51.846679+0000","last_active":"2024-09-10T08:07:04.458396+0000","last_peered":"2024-09-10T08:07:04.458396+0000","last_clean":"2024-09-10T08:07:04.458396+0000","last_became_active":"2024-09-10T08:06:51.846328+0000","last_became_peered":"2024-09-10T08:06:51.846328+0000","last_unstale":"2024-09-10T08:07:04.458396+0000","last_undegraded":"2024-09-10T08:07:04.458396+0000","last_fullsized":"2024-09-10T08:07:04.458396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:09.207285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409613+0000","last_change":"2024-09-10T08:06:53.928316+0000","last_active":"2024-09-10T08:07:02.409613+0000","last_peered":"2024-09-10T08:07:02.409613+0000","last_clean":"2024-09-10T08:07:02.409613+0000","last_became_active":"2024-09-10T08:06:53.927974+0000","last_became_peered":"2024-09-10T08:06:53.927974+0000","last_unstale":"2024-09-10T08:07:02.409613+0000","last_undegraded":"2024-09-10T08:07:02.409613+0000","last_fullsized":"2024-09-10T08:07:02.409613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:06.875492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:17.483625+0000","last_change":"2024-09-10T08:06:52.151494+0000","last_active":"2024-09-10T08:07:17.483625+0000","last_peered":"2024-09-10T08:07:17.483625+0000","last_clean":"2024-09-10T08:07:17.483625+0000","last_became_active":"2024-09-10T08:06:52.151029+0000","last_became_peered":"2024-09-10T08:06:52.151029+0000","last_unstale":"2024-09-10T08:07:17.483625+0000","last_undegraded":"2024-09-10T08:07:17.483625+0000","last_fullsized":"2024-09-10T08:07:17.483625+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:23.632526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409767+0000","last_change":"2024-09-10T08:06:53.935415+0000","last_active":"2024-09-10T08:07:02.409767+0000","last_peered":"2024-09-10T08:07:02.409767+0000","last_clean":"2024-09-10T08:07:02.409767+0000","last_became_active":"2024-09-10T08:06:53.934855+0000","last_became_peered":"2024-09-10T08:06:53.934855+0000","last_unstale":"2024-09-10T08:07:02.409767+0000","last_undegraded":"2024-09-10T08:07:02.409767+0000","last_fullsized":"2024-09-10T08:07:02.409767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:08.799487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409575+0000","last_change":"2024-09-10T08:05:41.349856+0000","last_active":"2024-09-10T08:07:02.409575+0000","last_peered":"2024-09-10T08:07:02.409575+0000","last_clean":"2024-09-10T08:07:02.409575+0000","last_became_active":"2024-09-10T08:05:41.349403+0000","last_became_peered":"2024-09-10T08:05:41.349403+0000","last_unstale":"2024-09-10T08:07:02.409575+0000","last_undegraded":"2024-09-10T08:07:02.409575+0000","last_fullsized":"2024-09-10T08:07:02.409575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:02:15.710253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:02:15.710253+0000","last_clean_scrub_stamp":"2024-09-10T08:02:15.710253+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:43.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.466365+0000","last_change":"2024-09-10T08:06:51.846885+0000","last_active":"2024-09-10T08:07:04.466365+0000","last_peered":"2024-09-10T08:07:04.466365+0000","last_clean":"2024-09-10T08:07:04.466365+0000","last_became_active":"2024-09-10T08:06:51.846548+0000","last_became_peered":"2024-09-10T08:06:51.846548+0000","last_unstale":"2024-09-10T08:07:04.466365+0000","last_undegraded":"2024-09-10T08:07:04.466365+0000","last_fullsized":"2024-09-10T08:07:04.466365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:00.702987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428558+0000","last_change":"2024-09-10T08:06:53.916122+0000","last_active":"2024-09-10T08:07:02.428558+0000","last_peered":"2024-09-10T08:07:02.428558+0000","last_clean":"2024-09-10T08:07:02.428558+0000","last_became_active":"2024-09-10T08:06:53.915816+0000","last_became_peered":"2024-09-10T08:06:53.915816+0000","last_unstale":"2024-09-10T08:07:02.428558+0000","last_undegraded":"2024-09-10T08:07:02.428558+0000","last_fullsized":"2024-09-10T08:07:02.428558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:59.454276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:03.436486+0000","last_change":"2024-09-10T08:06:51.851031+0000","last_active":"2024-09-10T08:07:03.436486+0000","last_peered":"2024-09-10T08:07:03.436486+0000","last_clean":"2024-09-10T08:07:03.436486+0000","last_became_active":"2024-09-10T08:06:51.850518+0000","last_became_peered":"2024-09-10T08:06:51.850518+0000","last_unstale":"2024-09-10T08:07:03.436486+0000","last_undegraded":"2024-09-10T08:07:03.436486+0000","last_fullsized":"2024-09-10T08:07:03.436486+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:29.350976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427966+0000","last_change":"2024-09-10T08:06:53.923868+0000","last_active":"2024-09-10T08:07:02.427966+0000","last_peered":"2024-09-10T08:07:02.427966+0000","last_clean":"2024-09-10T08:07:02.427966+0000","last_became_active":"2024-09-10T08:06:53.923536+0000","last_became_peered":"2024-09-10T08:06:53.923536+0000","last_unstale":"2024-09-10T08:07:02.427966+0000","last_undegraded":"2024-09-10T08:07:02.427966+0000","last_fullsized":"2024-09-10T08:07:02.427966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:51.635192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:15.479244+0000","last_change":"2024-09-10T08:06:52.044706+0000","last_active":"2024-09-10T08:07:15.479244+0000","last_peered":"2024-09-10T08:07:15.479244+0000","last_clean":"2024-09-10T08:07:15.479244+0000","last_became_active":"2024-09-10T08:06:52.044363+0000","last_became_peered":"2024-09-10T08:06:52.044363+0000","last_unstale":"2024-09-10T08:07:15.479244+0000","last_undegraded":"2024-09-10T08:07:15.479244+0000","last_fullsized":"2024-09-10T08:07:15.479244+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:34.190568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409680+0000","last_change":"2024-09-10T08:07:02.409349+0000","last_active":"2024-09-10T08:07:02.409680+0000","last_peered":"2024-09-10T08:07:02.409680+0000","last_clean":"2024-09-10T08:07:02.409680+0000","last_became_active":"2024-09-10T08:07:02.408940+0000","last_became_peered":"2024-09-10T08:07:02.408940+0000","last_unstale":"2024-09-10T08:07:02.409680+0000","last_undegraded":"2024-09-10T08:07:02.409680+0000","last_fullsized":"2024-09-10T08:07:02.409680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:10.702479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:19.494510+0000","last_change":"2024-09-10T08:06:51.851874+0000","last_active":"2024-09-10T08:07:19.494510+0000","last_peered":"2024-09-10T08:07:19.494510+0000","last_clean":"2024-09-10T08:07:19.494510+0000","last_became_active":"2024-09-10T08:06:51.851473+0000","last_became_peered":"2024-09-10T08:06:51.851473+0000","last_unstale":"2024-09-10T08:07:19.494510+0000","last_undegraded":"2024-09-10T08:07:19.494510+0000","last_fullsized":"2024-09-10T08:07:19.494510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:29.273643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427638+0000","last_change":"2024-09-10T08:06:53.925677+0000","last_active":"2024-09-10T08:07:02.427638+0000","last_peered":"2024-09-10T08:07:02.427638+0000","last_clean":"2024-09-10T08:07:02.427638+0000","last_became_active":"2024-09-10T08:06:53.925374+0000","last_became_peered":"2024-09-10T08:06:53.925374+0000","last_unstale":"2024-09-10T08:07:02.427638+0000","last_undegraded":"2024-09-10T08:07:02.427638+0000","last_fullsized":"2024-09-10T08:07:02.427638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:13.138156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.406100+0000","last_change":"2024-09-10T08:06:52.044960+0000","last_active":"2024-09-10T08:07:02.406100+0000","last_peered":"2024-09-10T08:07:02.406100+0000","last_clean":"2024-09-10T08:07:02.406100+0000","last_became_active":"2024-09-10T08:06:52.044606+0000","last_became_peered":"2024-09-10T08:06:52.044606+0000","last_unstale":"2024-09-10T08:07:02.406100+0000","last_undegraded":"2024-09-10T08:07:02.406100+0000","last_fullsized":"2024-09-10T08:07:02.406100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:53.165305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428241+0000","last_change":"2024-09-10T08:06:53.922433+0000","last_active":"2024-09-10T08:07:02.428241+0000","last_peered":"2024-09-10T08:07:02.428241+0000","last_clean":"2024-09-10T08:07:02.428241+0000","last_became_active":"2024-09-10T08:06:53.922071+0000","last_became_peered":"2024-09-10T08:06:53.922071+0000","last_unstale":"2024-09-10T08:07:02.428241+0000","last_undegraded":"2024-09-10T08:07:02.428241+0000","last_fullsized":"2024-09-10T08:07:02.428241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:50.971467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.458913+0000","last_change":"2024-09-10T08:06:52.045082+0000","last_active":"2024-09-10T08:07:04.458913+0000","last_peered":"2024-09-10T08:07:04.458913+0000","last_clean":"2024-09-10T08:07:04.458913+0000","last_became_active":"2024-09-10T08:06:52.044536+0000","last_became_peered":"2024-09-10T08:06:52.044536+0000","last_unstale":"2024-09-10T08:07:04.458913+0000","last_undegraded":"2024-09-10T08:07:04.458913+0000","last_fullsized":"2024-09-10T08:07:04.458913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:49.639035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428443+0000","last_change":"2024-09-10T08:06:53.923357+0000","last_active":"2024-09-10T08:07:02.428443+0000","last_peered":"2024-09-10T08:07:02.428443+0000","last_clean":"2024-09-10T08:07:02.428443+0000","last_became_active":"2024-09-10T08:06:53.923060+0000","last_became_peered":"2024-09-10T08:06:53.923060+0000","last_unstale":"2024-09-10T08:07:02.428443+0000","last_undegraded":"2024-09-10T08:07:02.428443+0000","last_fullsized":"2024-09-10T08:07:02.428443+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:28.242894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'12","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:15.381198+0000","last_change":"2024-09-10T08:06:51.846268+0000","last_active":"2024-09-10T08:07:15.381198+0000","last_peered":"2024-09-10T08:07:15.381198+0000","last_clean":"2024-09-10T08:07:15.381198+0000","last_became_active":"2024-09-10T08:06:51.845891+0000","last_became_peered":"2024-09-10T08:06:51.845891+0000","last_unstale":"2024-09-10T08:07:15.381198+0000","last_undegraded":"2024-09-10T08:07:15.381198+0000","last_fullsized":"2024-09-10T08:07:15.381198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:52.621019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428556+0000","last_change":"2024-09-10T08:06:53.927836+0000","last_active":"2024-09-10T08:07:02.428556+0000","last_peered":"2024-09-10T08:07:02.428556+0000","last_clean":"2024-09-10T08:07:02.428556+0000","last_became_active":"2024-09-10T08:06:53.927339+0000","last_became_peered":"2024-09-10T08:06:53.927339+0000","last_unstale":"2024-09-10T08:07:02.428556+0000","last_undegraded":"2024-09-10T08:07:02.428556+0000","last_fullsized":"2024-09-10T08:07:02.428556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:55.569050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.466698+0000","last_change":"2024-09-10T08:06:52.151335+0000","last_active":"2024-09-10T08:07:04.466698+0000","last_peered":"2024-09-10T08:07:04.466698+0000","last_clean":"2024-09-10T08:07:04.466698+0000","last_became_active":"2024-09-10T08:06:52.150965+0000","last_became_peered":"2024-09-10T08:06:52.150965+0000","last_unstale":"2024-09-10T08:07:04.466698+0000","last_undegraded":"2024-09-10T08:07:04.466698+0000","last_fullsized":"2024-09-10T08:07:04.466698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:43.933254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.431020+0000","last_change":"2024-09-10T08:07:02.431020+0000","last_active":"2024-09-10T08:07:02.431020+0000","last_peered":"2024-09-10T08:07:02.431020+0000","last_clean":"2024-09-10T08:07:02.431020+0000","last_became_active":"2024-09-10T08:07:02.429794+0000","last_became_peered":"2024-09-10T08:07:02.429794+0000","last_unstale":"2024-09-10T08:07:02.431020+0000","last_undegraded":"2024-09-10T08:07:02.431020+0000","last_fullsized":"2024-09-10T08:07:02.431020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:49.386164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.433054+0000","last_change":"2024-09-10T08:06:52.044739+0000","last_active":"2024-09-10T08:07:02.433054+0000","last_peered":"2024-09-10T08:07:02.433054+0000","last_clean":"2024-09-10T08:07:02.433054+0000","last_became_active":"2024-09-10T08:06:52.044424+0000","last_became_peered":"2024-09-10T08:06:52.044424+0000","last_unstale":"2024-09-10T08:07:02.433054+0000","last_undegraded":"2024-09-10T08:07:02.433054+0000","last_fullsized":"2024-09-10T08:07:02.433054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:01.279274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411626+0000","last_change":"2024-09-10T08:06:53.918245+0000","last_active":"2024-09-10T08:07:02.411626+0000","last_peered":"2024-09-10T08:07:02.411626+0000","last_clean":"2024-09-10T08:07:02.411626+0000","last_became_active":"2024-09-10T08:06:53.917857+0000","last_became_peered":"2024-09-10T08:06:53.917857+0000","last_unstale":"2024-09-10T08:07:02.411626+0000","last_undegraded":"2024-09-10T08:07:02.411626+0000","last_fullsized":"2024-09-10T08:07:02.411626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:53.762361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.466341+0000","last_change":"2024-09-10T08:06:51.845368+0000","last_active":"2024-09-10T08:07:04.466341+0000","last_peered":"2024-09-10T08:07:04.466341+0000","last_clean":"2024-09-10T08:07:04.466341+0000","last_became_active":"2024-09-10T08:06:51.845052+0000","last_became_peered":"2024-09-10T08:06:51.845052+0000","last_unstale":"2024-09-10T08:07:04.466341+0000","last_undegraded":"2024-09-10T08:07:04.466341+0000","last_fullsized":"2024-09-10T08:07:04.466341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:45.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409721+0000","last_change":"2024-09-10T08:06:53.923576+0000","last_active":"2024-09-10T08:07:02.409721+0000","last_peered":"2024-09-10T08:07:02.409721+0000","last_clean":"2024-09-10T08:07:02.409721+0000","last_became_active":"2024-09-10T08:06:53.922934+0000","last_became_peered":"2024-09-10T08:06:53.922934+0000","last_unstale":"2024-09-10T08:07:02.409721+0000","last_undegraded":"2024-09-10T08:07:02.409721+0000","last_fullsized":"2024-09-10T08:07:02.409721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:48:06.088145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.444804+0000","last_change":"2024-09-10T08:06:51.850535+0000","last_active":"2024-09-10T08:07:04.444804+0000","last_peered":"2024-09-10T08:07:04.444804+0000","last_clean":"2024-09-10T08:07:04.444804+0000","last_became_active":"2024-09-10T08:06:51.850146+0000","last_became_peered":"2024-09-10T08:06:51.850146+0000","last_unstale":"2024-09-10T08:07:04.444804+0000","last_undegraded":"2024-09-10T08:07:04.444804+0000","last_fullsized":"2024-09-10T08:07:04.444804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:28.327887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.429015+0000","last_change":"2024-09-10T08:06:53.922375+0000","last_active":"2024-09-10T08:07:02.429015+0000","last_peered":"2024-09-10T08:07:02.429015+0000","last_clean":"2024-09-10T08:07:02.429015+0000","last_became_active":"2024-09-10T08:06:53.922038+0000","last_became_peered":"2024-09-10T08:06:53.922038+0000","last_unstale":"2024-09-10T08:07:02.429015+0000","last_undegraded":"2024-09-10T08:07:02.429015+0000","last_fullsized":"2024-09-10T08:07:02.429015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:32.710083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:03.149639+0000","last_change":"2024-09-10T08:07:02.419694+0000","last_active":"2024-09-10T08:07:03.149639+0000","last_peered":"2024-09-10T08:07:03.149639+0000","last_clean":"2024-09-10T08:07:03.149639+0000","last_became_active":"2024-09-10T08:07:02.415181+0000","last_became_peered":"2024-09-10T08:07:02.415181+0000","last_unstale":"2024-09-10T08:07:03.149639+0000","last_undegraded":"2024-09-10T08:07:03.149639+0000","last_fullsized":"2024-09-10T08:07:03.149639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:01.023611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409406+0000","last_change":"2024-09-10T08:06:53.934546+0000","last_active":"2024-09-10T08:07:02.409406+0000","last_peered":"2024-09-10T08:07:02.409406+0000","last_clean":"2024-09-10T08:07:02.409406+0000","last_became_active":"2024-09-10T08:06:53.933883+0000","last_became_peered":"2024-09-10T08:06:53.933883+0000","last_unstale":"2024-09-10T08:07:02.409406+0000","last_undegraded":"2024-09-10T08:07:02.409406+0000","last_fullsized":"2024-09-10T08:07:02.409406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:09.396870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.414803+0000","last_change":"2024-09-10T08:06:53.925407+0000","last_active":"2024-09-10T08:07:02.414803+0000","last_peered":"2024-09-10T08:07:02.414803+0000","last_clean":"2024-09-10T08:07:02.414803+0000","last_became_active":"2024-09-10T08:06:53.925057+0000","last_became_peered":"2024-09-10T08:06:53.925057+0000","last_unstale":"2024-09-10T08:07:02.414803+0000","last_undegraded":"2024-09-10T08:07:02.414803+0000","last_fullsized":"2024-09-10T08:07:02.414803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:52.012219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.467437+0000","last_change":"2024-09-10T08:06:51.852922+0000","last_active":"2024-09-10T08:07:04.467437+0000","last_peered":"2024-09-10T08:07:04.467437+0000","last_clean":"2024-09-10T08:07:04.467437+0000","last_became_active":"2024-09-10T08:06:51.852354+0000","last_became_peered":"2024-09-10T08:06:51.852354+0000","last_unstale":"2024-09-10T08:07:04.467437+0000","last_undegraded":"2024-09-10T08:07:04.467437+0000","last_fullsized":"2024-09-10T08:07:04.467437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:21.559686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427871+0000","last_change":"2024-09-10T08:06:53.932155+0000","last_active":"2024-09-10T08:07:02.427871+0000","last_peered":"2024-09-10T08:07:02.427871+0000","last_clean":"2024-09-10T08:07:02.427871+0000","last_became_active":"2024-09-10T08:06:53.931688+0000","last_became_peered":"2024-09-10T08:06:53.931688+0000","last_unstale":"2024-09-10T08:07:02.427871+0000","last_undegraded":"2024-09-10T08:07:02.427871+0000","last_fullsized":"2024-09-10T08:07:02.427871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:58.481716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.467357+0000","last_change":"2024-09-10T08:06:51.851900+0000","last_active":"2024-09-10T08:07:04.467357+0000","last_peered":"2024-09-10T08:07:04.467357+0000","last_clean":"2024-09-10T08:07:04.467357+0000","last_became_active":"2024-09-10T08:06:51.851509+0000","last_became_peered":"2024-09-10T08:06:51.851509+0000","last_unstale":"2024-09-10T08:07:04.467357+0000","last_undegraded":"2024-09-10T08:07:04.467357+0000","last_fullsized":"2024-09-10T08:07:04.467357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:41.250995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408641+0000","last_change":"2024-09-10T08:06:53.917320+0000","last_active":"2024-09-10T08:07:02.408641+0000","last_peered":"2024-09-10T08:07:02.408641+0000","last_clean":"2024-09-10T08:07:02.408641+0000","last_became_active":"2024-09-10T08:06:53.917027+0000","last_became_peered":"2024-09-10T08:06:53.917027+0000","last_unstale":"2024-09-10T08:07:02.408641+0000","last_undegraded":"2024-09-10T08:07:02.408641+0000","last_fullsized":"2024-09-10T08:07:02.408641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:08.882036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428812+0000","last_change":"2024-09-10T08:06:52.046168+0000","last_active":"2024-09-10T08:07:02.428812+0000","last_peered":"2024-09-10T08:07:02.428812+0000","last_clean":"2024-09-10T08:07:02.428812+0000","last_became_active":"2024-09-10T08:06:52.045825+0000","last_became_peered":"2024-09-10T08:06:52.045825+0000","last_unstale":"2024-09-10T08:07:02.428812+0000","last_undegraded":"2024-09-10T08:07:02.428812+0000","last_fullsized":"2024-09-10T08:07:02.428812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:15.467875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428487+0000","last_change":"2024-09-10T08:06:53.922449+0000","last_active":"2024-09-10T08:07:02.428487+0000","last_peered":"2024-09-10T08:07:02.428487+0000","last_clean":"2024-09-10T08:07:02.428487+0000","last_became_active":"2024-09-10T08:06:53.922123+0000","last_became_peered":"2024-09-10T08:06:53.922123+0000","last_unstale":"2024-09-10T08:07:02.428487+0000","last_undegraded":"2024-09-10T08:07:02.428487+0000","last_fullsized":"2024-09-10T08:07:02.428487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:44.424257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":49,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:16.489815+0000","last_change":"2024-09-10T08:06:51.847689+0000","last_active":"2024-09-10T08:07:16.489815+0000","last_peered":"2024-09-10T08:07:16.489815+0000","last_clean":"2024-09-10T08:07:16.489815+0000","last_became_active":"2024-09-10T08:06:51.847394+0000","last_became_peered":"2024-09-10T08:06:51.847394+0000","last_unstale":"2024-09-10T08:07:16.489815+0000","last_undegraded":"2024-09-10T08:07:16.489815+0000","last_fullsized":"2024-09-10T08:07:16.489815+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:58.581814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53617,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":183,"num_read_kb":147,"num_write":230,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":160851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285538,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547218,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":438048,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":1075464,"data_compressed":42108,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939676,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":437563,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168609,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":437919,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":1030068,"data_compressed":42108,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561067,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":437280,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790000,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":1029746,"data_compressed":42108,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953525,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":437253,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":437105,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":485496,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":484995,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":439012,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34671,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34671,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34671,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":48554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":49055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:07:22.371 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T08:07:22.371 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T08:07:22.372 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T08:07:22.636 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:22.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:22 smithi022 ceph-mon[30854]: pgmap v293: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.8 KiB/s wr, 11 op/s 2024-09-10T08:07:22.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:22 smithi022 ceph-mon[30854]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:07:22.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:22 smithi100 ceph-mon[35102]: pgmap v293: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.8 KiB/s wr, 11 op/s 2024-09-10T08:07:22.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:22 smithi100 ceph-mon[35102]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:07:22.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:22 smithi153 ceph-mon[35609]: pgmap v293: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.8 KiB/s wr, 11 op/s 2024-09-10T08:07:22.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:22 smithi153 ceph-mon[35609]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.120+0000 7f4882144640 1 -- 172.21.15.22:0/736344113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c1026a0 msgr2=0x7f487c104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.120+0000 7f4882144640 1 --2- 172.21.15.22:0/736344113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c1026a0 0x7f487c104a90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4864009900 tx=0x7f486402a410 comp rx=0 tx=0).stop 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.120+0000 7f4882144640 1 -- 172.21.15.22:0/736344113 shutdown_connections 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.120+0000 7f4882144640 1 --2- 172.21.15.22:0/736344113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f487c107900 0x7f487c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.120+0000 7f4882144640 1 --2- 172.21.15.22:0/736344113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c104fd0 0x7f487c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.120+0000 7f4882144640 1 --2- 172.21.15.22:0/736344113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c1026a0 0x7f487c104a90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.120+0000 7f4882144640 1 -- 172.21.15.22:0/736344113 >> 172.21.15.22:0/736344113 conn(0x7f487c0fc2a0 msgr2=0x7f487c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.120+0000 7f4882144640 1 -- 172.21.15.22:0/736344113 shutdown_connections 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.120+0000 7f4882144640 1 -- 172.21.15.22:0/736344113 wait complete. 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.121+0000 7f4882144640 1 Processor -- start 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.121+0000 7f4882144640 1 -- start start 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.121+0000 7f4882144640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c1026a0 0x7f487c102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:23.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.121+0000 7f4882144640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f487c104fd0 0x7f487c100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.121+0000 7f4882144640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c107900 0x7f487c100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.121+0000 7f4882144640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f487c10d920 con 0x7f487c1026a0 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.121+0000 7f4882144640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f487c10d7a0 con 0x7f487c107900 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.121+0000 7f4882144640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f487c10daa0 con 0x7f487c104fd0 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.121+0000 7f487b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c1026a0 0x7f487c102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.121+0000 7f487b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c1026a0 0x7f487c102000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41468/0 (socket says 172.21.15.22:41468) 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.121+0000 7f487b7fe640 1 -- 172.21.15.22:0/2563510801 learned_addr learned my addr 172.21.15.22:0/2563510801 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.121+0000 7f487bfff640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c107900 0x7f487c100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f487affd640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f487c104fd0 0x7f487c100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f487b7fe640 1 -- 172.21.15.22:0/2563510801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f487c104fd0 msgr2=0x7f487c100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f487b7fe640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f487c104fd0 0x7f487c100650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f487b7fe640 1 -- 172.21.15.22:0/2563510801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c107900 msgr2=0x7f487c100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f487b7fe640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c107900 0x7f487c100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:23.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f487b7fe640 1 -- 172.21.15.22:0/2563510801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c101450 con 0x7f487c1026a0 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f487bfff640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c107900 0x7f487c100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f487b7fe640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c1026a0 0x7f487c102000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4864009230 tx=0x7f4864004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f4878ff9640 1 -- 172.21.15.22:0/2563510801 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486403f030 con 0x7f487c1026a0 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f4878ff9640 1 -- 172.21.15.22:0/2563510801 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4864003ce0 con 0x7f487c1026a0 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f4882144640 1 -- 172.21.15.22:0/2563510801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487c1a2020 con 0x7f487c1026a0 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f4878ff9640 1 -- 172.21.15.22:0/2563510801 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864035070 con 0x7f487c1026a0 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.122+0000 7f4882144640 1 -- 172.21.15.22:0/2563510801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487c1a2550 con 0x7f487c1026a0 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.123+0000 7f4882144640 1 -- 172.21.15.22:0/2563510801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487c0fdd90 con 0x7f487c1026a0 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.124+0000 7f4878ff9640 1 -- 172.21.15.22:0/2563510801 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f4864042030 con 0x7f487c1026a0 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.125+0000 7f4878ff9640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f48680a2c10 0x7f48680a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.125+0000 7f487affd640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f48680a2c10 0x7f48680a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.125+0000 7f4878ff9640 1 -- 172.21.15.22:0/2563510801 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f48640efa10 con 0x7f487c1026a0 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.126+0000 7f487affd640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f48680a2c10 0x7f48680a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f487c101d80 tx=0x7f486c005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:23.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.129+0000 7f4878ff9640 1 -- 172.21.15.22:0/2563510801 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f48640bc7d0 con 0x7f487c1026a0 2024-09-10T08:07:23.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.369+0000 7f4882144640 1 -- 172.21.15.22:0/2563510801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f487c02d7c0 con 0x7f487c1026a0 2024-09-10T08:07:23.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.372+0000 7f4878ff9640 1 -- 172.21.15.22:0/2563510801 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f48640bc0d0 con 0x7f487c1026a0 2024-09-10T08:07:23.371 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2024-09-10T08:07:23.371 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQA7/t9mG4AgFhAASHV63tY4zGWrhdF5/marng== 2024-09-10T08:07:23.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.374+0000 7f4882144640 1 -- 172.21.15.22:0/2563510801 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f48680a2c10 msgr2=0x7f48680a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:23.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.374+0000 7f4882144640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f48680a2c10 0x7f48680a50d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f487c101d80 tx=0x7f486c005cc0 comp rx=0 tx=0).stop 2024-09-10T08:07:23.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.374+0000 7f4882144640 1 -- 172.21.15.22:0/2563510801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c1026a0 msgr2=0x7f487c102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:23.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.374+0000 7f4882144640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c1026a0 0x7f487c102000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4864009230 tx=0x7f4864004430 comp rx=0 tx=0).stop 2024-09-10T08:07:23.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.374+0000 7f4882144640 1 -- 172.21.15.22:0/2563510801 shutdown_connections 2024-09-10T08:07:23.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.374+0000 7f4882144640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f48680a2c10 0x7f48680a50d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:23.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.374+0000 7f4882144640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f487c107900 0x7f487c100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:23.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.374+0000 7f4882144640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f487c104fd0 0x7f487c100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:23.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.374+0000 7f4882144640 1 --2- 172.21.15.22:0/2563510801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f487c1026a0 0x7f487c102000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:23.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.374+0000 7f4882144640 1 -- 172.21.15.22:0/2563510801 >> 172.21.15.22:0/2563510801 conn(0x7f487c0fc2a0 msgr2=0x7f487c102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:23.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.374+0000 7f4882144640 1 -- 172.21.15.22:0/2563510801 shutdown_connections 2024-09-10T08:07:23.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:23.374+0000 7f4882144640 1 -- 172.21.15.22:0/2563510801 wait complete. 2024-09-10T08:07:23.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:23 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2563510801' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T08:07:23.691 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:23 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2563510801' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T08:07:23.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:23 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2563510801' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T08:07:23.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:23 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2563510801' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T08:07:23.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:23 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2563510801' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-10T08:07:23.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:23 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2563510801' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T08:07:24.155 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T08:07:24.155 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T08:07:24.155 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T08:07:24.196 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T08:07:24.196 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T08:07:24.196 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T08:07:24.493 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:24.770 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:24 smithi022 ceph-mon[30854]: pgmap v294: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.8 KiB/s wr, 11 op/s 2024-09-10T08:07:24.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:24 smithi100 ceph-mon[35102]: pgmap v294: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.8 KiB/s wr, 11 op/s 2024-09-10T08:07:24.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:24 smithi153 ceph-mon[35609]: pgmap v294: 97 pgs: 97 active+clean; 629 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 3.8 KiB/s wr, 11 op/s 2024-09-10T08:07:25.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.995+0000 7f1557db2640 1 -- 172.21.15.22:0/3994920665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1550106f10 msgr2=0x7f155010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:25.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.995+0000 7f1557db2640 1 --2- 172.21.15.22:0/3994920665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1550106f10 0x7f155010ea90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1548009ca0 tx=0x7f154802a8c0 comp rx=0 tx=0).stop 2024-09-10T08:07:25.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.995+0000 7f1557db2640 1 -- 172.21.15.22:0/3994920665 shutdown_connections 2024-09-10T08:07:25.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.995+0000 7f1557db2640 1 --2- 172.21.15.22:0/3994920665 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1550106f10 0x7f155010ea90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:25.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.995+0000 7f1557db2640 1 --2- 172.21.15.22:0/3994920665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550102790 0x7f15501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:25.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.995+0000 7f1557db2640 1 --2- 172.21.15.22:0/3994920665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1550101de0 0x7f15501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:25.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.995+0000 7f1557db2640 1 -- 172.21.15.22:0/3994920665 >> 172.21.15.22:0/3994920665 conn(0x7f15500fd8c0 msgr2=0x7f15500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:25.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.995+0000 7f1557db2640 1 -- 172.21.15.22:0/3994920665 shutdown_connections 2024-09-10T08:07:25.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.995+0000 7f1557db2640 1 -- 172.21.15.22:0/3994920665 wait complete. 2024-09-10T08:07:25.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f1557db2640 1 Processor -- start 2024-09-10T08:07:25.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f1557db2640 1 -- start start 2024-09-10T08:07:25.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f1557db2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550101de0 0x7f15501985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:25.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f1557db2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1550102790 0x7f1550198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:25.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f1557db2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1550106f10 0x7f155019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:25.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f1557db2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1550112010 con 0x7f1550106f10 2024-09-10T08:07:25.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f1557db2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1550111e90 con 0x7f1550101de0 2024-09-10T08:07:25.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f1557db2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1550112190 con 0x7f1550102790 2024-09-10T08:07:25.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f155634f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1550106f10 0x7f155019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:25.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f155634f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1550106f10 0x7f155019cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53618/0 (socket says 172.21.15.22:53618) 2024-09-10T08:07:25.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f155634f640 1 -- 172.21.15.22:0/2048925821 learned_addr learned my addr 172.21.15.22:0/2048925821 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:25.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f155534d640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1550102790 0x7f1550198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:25.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f1555b4e640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550101de0 0x7f15501985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:25.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f155634f640 1 -- 172.21.15.22:0/2048925821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1550102790 msgr2=0x7f1550198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:25.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f155634f640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1550102790 0x7f1550198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:25.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f155634f640 1 -- 172.21.15.22:0/2048925821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550101de0 msgr2=0x7f15501985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:25.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f155634f640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550101de0 0x7f15501985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:25.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f155634f640 1 -- 172.21.15.22:0/2048925821 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155019d5a0 con 0x7f1550106f10 2024-09-10T08:07:25.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.996+0000 7f1555b4e640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550101de0 0x7f15501985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:25.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.997+0000 7f155634f640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1550106f10 0x7f155019cec0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1548031a60 tx=0x7f1548031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:25.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.997+0000 7f1546ffd640 1 -- 172.21.15.22:0/2048925821 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548003c30 con 0x7f1550106f10 2024-09-10T08:07:25.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.997+0000 7f1546ffd640 1 -- 172.21.15.22:0/2048925821 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1548003dd0 con 0x7f1550106f10 2024-09-10T08:07:25.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.997+0000 7f1557db2640 1 -- 172.21.15.22:0/2048925821 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155019d830 con 0x7f1550106f10 2024-09-10T08:07:25.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.997+0000 7f1546ffd640 1 -- 172.21.15.22:0/2048925821 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15480047e0 con 0x7f1550106f10 2024-09-10T08:07:25.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.997+0000 7f1557db2640 1 -- 172.21.15.22:0/2048925821 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15501a5170 con 0x7f1550106f10 2024-09-10T08:07:25.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.998+0000 7f1557db2640 1 -- 172.21.15.22:0/2048925821 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1550102240 con 0x7f1550106f10 2024-09-10T08:07:25.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:24.999+0000 7f1546ffd640 1 -- 172.21.15.22:0/2048925821 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f154802f790 con 0x7f1550106f10 2024-09-10T08:07:25.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.000+0000 7f1546ffd640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f153c0a2c90 0x7f153c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:25.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.000+0000 7f1555b4e640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f153c0a2c90 0x7f153c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:25.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.000+0000 7f1546ffd640 1 -- 172.21.15.22:0/2048925821 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f15480f0650 con 0x7f1550106f10 2024-09-10T08:07:25.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.000+0000 7f1555b4e640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f153c0a2c90 0x7f153c0a5150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f154c006fd0 tx=0x7f154c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:25.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.003+0000 7f1546ffd640 1 -- 172.21.15.22:0/2048925821 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f15480bd5f0 con 0x7f1550106f10 2024-09-10T08:07:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.224+0000 7f1557db2640 1 -- 172.21.15.22:0/2048925821 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f155010a150 con 0x7f1550106f10 2024-09-10T08:07:25.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.230+0000 7f1546ffd640 1 -- 172.21.15.22:0/2048925821 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263198 (secure 0 0 0) 0x7f15480bcef0 con 0x7f1550106f10 2024-09-10T08:07:25.232 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:07:25.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.233+0000 7f1557db2640 1 -- 172.21.15.22:0/2048925821 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f153c0a2c90 msgr2=0x7f153c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:25.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.233+0000 7f1557db2640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f153c0a2c90 0x7f153c0a5150 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f154c006fd0 tx=0x7f154c008040 comp rx=0 tx=0).stop 2024-09-10T08:07:25.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.233+0000 7f1557db2640 1 -- 172.21.15.22:0/2048925821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1550106f10 msgr2=0x7f155019cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:25.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.233+0000 7f1557db2640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1550106f10 0x7f155019cec0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1548031a60 tx=0x7f1548031a90 comp rx=0 tx=0).stop 2024-09-10T08:07:25.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.233+0000 7f1557db2640 1 -- 172.21.15.22:0/2048925821 shutdown_connections 2024-09-10T08:07:25.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.233+0000 7f1557db2640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f153c0a2c90 0x7f153c0a5150 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:25.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.233+0000 7f1557db2640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1550106f10 0x7f155019cec0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:25.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.233+0000 7f1557db2640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1550102790 0x7f1550198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:25.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.233+0000 7f1557db2640 1 --2- 172.21.15.22:0/2048925821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550101de0 0x7f15501985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:25.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.233+0000 7f1557db2640 1 -- 172.21.15.22:0/2048925821 >> 172.21.15.22:0/2048925821 conn(0x7f15500fd8c0 msgr2=0x7f15500fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:25.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.233+0000 7f1557db2640 1 -- 172.21.15.22:0/2048925821 shutdown_connections 2024-09-10T08:07:25.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:25.233+0000 7f1557db2640 1 -- 172.21.15.22:0/2048925821 wait complete. 2024-09-10T08:07:25.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:25 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2048925821' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T08:07:25.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:25 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2048925821' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T08:07:25.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:25 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2048925821' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-10T08:07:26.026 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":1767260330},{"type":"v1","addr":"172.21.15.22:6801","nonce":1767260330}]},"active_addr":"172.21.15.22:6801/1767260330","active_change":"2024-09-10T08:00:00.858428+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24122,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.22:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":3248665282}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":1730890938}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":467191986}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":3164953486}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":77349801}]}]} 2024-09-10T08:07:26.033 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T08:07:26.033 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T08:07:26.034 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T08:07:26.293 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:26.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:26 smithi022 ceph-mon[30854]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-10T08:07:26.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.774+0000 7f8b307d8640 1 -- 172.21.15.22:0/945314460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b2810c170 msgr2=0x7f8b2810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.774+0000 7f8b307d8640 1 --2- 172.21.15.22:0/945314460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b2810c170 0x7f8b2810e610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b20009ca0 tx=0x7f8b2002a950 comp rx=0 tx=0).stop 2024-09-10T08:07:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.774+0000 7f8b307d8640 1 -- 172.21.15.22:0/945314460 shutdown_connections 2024-09-10T08:07:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.774+0000 7f8b307d8640 1 --2- 172.21.15.22:0/945314460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b2810c170 0x7f8b2810e610 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.774+0000 7f8b307d8640 1 --2- 172.21.15.22:0/945314460 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b28103660 0x7f8b2810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.774+0000 7f8b307d8640 1 --2- 172.21.15.22:0/945314460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b28102d40 0x7f8b28103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.774+0000 7f8b307d8640 1 -- 172.21.15.22:0/945314460 >> 172.21.15.22:0/945314460 conn(0x7f8b280fc7a0 msgr2=0x7f8b280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.774+0000 7f8b307d8640 1 -- 172.21.15.22:0/945314460 shutdown_connections 2024-09-10T08:07:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.774+0000 7f8b307d8640 1 -- 172.21.15.22:0/945314460 wait complete. 2024-09-10T08:07:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.775+0000 7f8b307d8640 1 Processor -- start 2024-09-10T08:07:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.775+0000 7f8b307d8640 1 -- start start 2024-09-10T08:07:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.775+0000 7f8b307d8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b28102d40 0x7f8b28198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:26.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.775+0000 7f8b307d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b28103660 0x7f8b28198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.775+0000 7f8b307d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b2810c170 0x7f8b2819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.775+0000 7f8b307d8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8b28112080 con 0x7f8b2810c170 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.775+0000 7f8b307d8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b28111f00 con 0x7f8b28103660 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.775+0000 7f8b307d8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b28112200 con 0x7f8b28102d40 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.775+0000 7f8b2ed75640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b2810c170 0x7f8b2819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b2ed75640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b2810c170 0x7f8b2819ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53630/0 (socket says 172.21.15.22:53630) 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b2ed75640 1 -- 172.21.15.22:0/2938441674 learned_addr learned my addr 172.21.15.22:0/2938441674 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b2dd73640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b28103660 0x7f8b28198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b2e574640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b28102d40 0x7f8b28198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b2ed75640 1 -- 172.21.15.22:0/2938441674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b28102d40 msgr2=0x7f8b28198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b2ed75640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b28102d40 0x7f8b28198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b2ed75640 1 -- 172.21.15.22:0/2938441674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b28103660 msgr2=0x7f8b28198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:26.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b2ed75640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b28103660 0x7f8b28198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b2ed75640 1 -- 172.21.15.22:0/2938441674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2819d4f0 con 0x7f8b2810c170 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b2ed75640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b2810c170 0x7f8b2819ce10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8b200098d0 tx=0x7f8b20003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b1f7fe640 1 -- 172.21.15.22:0/2938441674 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20034040 con 0x7f8b2810c170 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b1f7fe640 1 -- 172.21.15.22:0/2938441674 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b2002fe20 con 0x7f8b2810c170 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b307d8640 1 -- 172.21.15.22:0/2938441674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2819d780 con 0x7f8b2810c170 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b1f7fe640 1 -- 172.21.15.22:0/2938441674 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20039450 con 0x7f8b2810c170 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.776+0000 7f8b307d8640 1 -- 172.21.15.22:0/2938441674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b281a50c0 con 0x7f8b2810c170 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.777+0000 7f8b307d8640 1 -- 172.21.15.22:0/2938441674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b2806b070 con 0x7f8b2810c170 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.779+0000 7f8b1f7fe640 1 -- 172.21.15.22:0/2938441674 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8b20037020 con 0x7f8b2810c170 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.780+0000 7f8b1f7fe640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b140a2c10 0x7f8b140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.780+0000 7f8b2e574640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b140a2c10 0x7f8b140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.780+0000 7f8b1f7fe640 1 -- 172.21.15.22:0/2938441674 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8b200f0360 con 0x7f8b2810c170 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.781+0000 7f8b2e574640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b140a2c10 0x7f8b140a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009890 tx=0x7f8b24008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:26.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.783+0000 7f8b1f7fe640 1 -- 172.21.15.22:0/2938441674 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b2007f1b0 con 0x7f8b2810c170 2024-09-10T08:07:26.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:26 smithi100 ceph-mon[35102]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-10T08:07:26.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:26 smithi153 ceph-mon[35609]: pgmap v295: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-10T08:07:26.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.963+0000 7f8b307d8640 1 -- 172.21.15.22:0/2938441674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b281071e0 con 0x7f8b2810c170 2024-09-10T08:07:26.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.965+0000 7f8b1f7fe640 1 -- 172.21.15.22:0/2938441674 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22791 (secure 0 0 0) 0x7f8b200bd230 con 0x7f8b2810c170 2024-09-10T08:07:26.964 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:07:26.965 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":83,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","created":"2024-09-10T07:59:04.704048+0000","modified":"2024-09-10T08:07:02.403174+0000","last_up_change":"2024-09-10T08:06:02.535944+0000","last_in_change":"2024-09-10T08:05:39.070554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:02:15.371265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:06:50.358155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:06:52.896201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d296bd3-28a7-418c-ad73-343a5e806cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6803","nonce":4248555152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6805","nonce":4248555152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6809","nonce":4248555152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6807","nonce":4248555152}]},"public_addr":"172.21.15.22:6803/4248555152","cluster_addr":"172.21.15.22:6805/4248555152","heartbeat_back_addr":"172.21.15.22:6809/4248555152","heartbeat_front_addr":"172.21.15.22:6807/4248555152","state":["exists","up"]},{"osd":1,"uuid":"c1e2b40e-b4ab-475a-8a9e-c67409f46b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6801","nonce":2078646052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6803","nonce":2078646052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6807","nonce":2078646052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6805","nonce":2078646052}]},"public_addr":"172.21.15.100:6801/2078646052","cluster_addr":"172.21.15.100:6803/2078646052","heartbeat_back_addr":"172.21.15.100:6807/2078646052","heartbeat_front_addr":"172.21.15.100:6805/2078646052","state":["exists","up"]},{"osd":2,"uuid":"be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6801","nonce":2492419476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6803","nonce":2492419476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6807","nonce":2492419476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6805","nonce":2492419476}]},"public_addr":"172.21.15.153:6801/2492419476","cluster_addr":"172.21.15.153:6803/2492419476","heartbeat_back_addr":"172.21.15.153:6807/2492419476","heartbeat_front_addr":"172.21.15.153:6805/2492419476","state":["exists","up"]},{"osd":3,"uuid":"e980a3ba-c659-4473-9633-9cbe88296d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6811","nonce":3674495276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6813","nonce":3674495276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6817","nonce":3674495276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6815","nonce":3674495276}]},"public_addr":"172.21.15.22:6811/3674495276","cluster_addr":"172.21.15.22:6813/3674495276","heartbeat_back_addr":"172.21.15.22:6817/3674495276","heartbeat_front_addr":"172.21.15.22:6815/3674495276","state":["exists","up"]},{"osd":4,"uuid":"b37d0590-99b1-4566-96b4-9936890d4308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6809","nonce":3886932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6811","nonce":3886932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6815","nonce":3886932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6813","nonce":3886932513}]},"public_addr":"172.21.15.100:6809/3886932513","cluster_addr":"172.21.15.100:6811/3886932513","heartbeat_back_addr":"172.21.15.100:6815/3886932513","heartbeat_front_addr":"172.21.15.100:6813/3886932513","state":["exists","up"]},{"osd":5,"uuid":"6cb989a0-80a1-4a9a-8b45-51b47772b203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6809","nonce":120732073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6811","nonce":120732073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6815","nonce":120732073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6813","nonce":120732073}]},"public_addr":"172.21.15.153:6809/120732073","cluster_addr":"172.21.15.153:6811/120732073","heartbeat_back_addr":"172.21.15.153:6815/120732073","heartbeat_front_addr":"172.21.15.153:6813/120732073","state":["exists","up"]},{"osd":6,"uuid":"294887f3-3e58-4b02-884d-4e0a70a86d16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6819","nonce":3692536487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6821","nonce":3692536487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6825","nonce":3692536487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6823","nonce":3692536487}]},"public_addr":"172.21.15.22:6819/3692536487","cluster_addr":"172.21.15.22:6821/3692536487","heartbeat_back_addr":"172.21.15.22:6825/3692536487","heartbeat_front_addr":"172.21.15.22:6823/3692536487","state":["exists","up"]},{"osd":7,"uuid":"d0c0ec61-4055-46f3-a4b0-39f04c735452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6817","nonce":1221175921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6819","nonce":1221175921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6823","nonce":1221175921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6821","nonce":1221175921}]},"public_addr":"172.21.15.100:6817/1221175921","cluster_addr":"172.21.15.100:6819/1221175921","heartbeat_back_addr":"172.21.15.100:6823/1221175921","heartbeat_front_addr":"172.21.15.100:6821/1221175921","state":["exists","up"]},{"osd":8,"uuid":"bda45a16-742e-4eda-b4d4-e01d6f3dc92e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6817","nonce":1153053941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6819","nonce":1153053941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6823","nonce":1153053941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6821","nonce":1153053941}]},"public_addr":"172.21.15.153:6817/1153053941","cluster_addr":"172.21.15.153:6819/1153053941","heartbeat_back_addr":"172.21.15.153:6823/1153053941","heartbeat_front_addr":"172.21.15.153:6821/1153053941","state":["exists","up"]},{"osd":9,"uuid":"48bd3544-9028-4535-801b-3d39ecadf48e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6827","nonce":3423218876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6829","nonce":3423218876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6833","nonce":3423218876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6831","nonce":3423218876}]},"public_addr":"172.21.15.22:6827/3423218876","cluster_addr":"172.21.15.22:6829/3423218876","heartbeat_back_addr":"172.21.15.22:6833/3423218876","heartbeat_front_addr":"172.21.15.22:6831/3423218876","state":["exists","up"]},{"osd":10,"uuid":"c8716aa0-eb93-435d-a9d0-dd4c3dce1954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6825","nonce":2024112643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6827","nonce":2024112643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6831","nonce":2024112643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6829","nonce":2024112643}]},"public_addr":"172.21.15.100:6825/2024112643","cluster_addr":"172.21.15.100:6827/2024112643","heartbeat_back_addr":"172.21.15.100:6831/2024112643","heartbeat_front_addr":"172.21.15.100:6829/2024112643","state":["exists","up"]},{"osd":11,"uuid":"3c427cfe-8d7c-431e-9eb4-b03cfac3068d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6825","nonce":2245781783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6827","nonce":2245781783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6831","nonce":2245781783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6829","nonce":2245781783}]},"public_addr":"172.21.15.153:6825/2245781783","cluster_addr":"172.21.15.153:6827/2245781783","heartbeat_back_addr":"172.21.15.153:6831/2245781783","heartbeat_front_addr":"172.21.15.153:6829/2245781783","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:23.001057+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:46.353182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:11.469840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:37.557521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:02.630783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:27.374057+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:53.758498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:19.507846+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:45.080789+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:10.286820+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:35.565950+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:06:00.633384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3072001022":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/1519904928":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6801/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/2108462626":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/3337107310":"2024-09-11T07:59:36.505631+0000","172.21.15.22:6801/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/1708436544":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/278091300":"2024-09-11T07:59:36.505631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:07:26.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.967+0000 7f8b307d8640 1 -- 172.21.15.22:0/2938441674 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b140a2c10 msgr2=0x7f8b140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:26.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.967+0000 7f8b307d8640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b140a2c10 0x7f8b140a50d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009890 tx=0x7f8b24008040 comp rx=0 tx=0).stop 2024-09-10T08:07:26.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.967+0000 7f8b307d8640 1 -- 172.21.15.22:0/2938441674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b2810c170 msgr2=0x7f8b2819ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:26.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.967+0000 7f8b307d8640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b2810c170 0x7f8b2819ce10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8b200098d0 tx=0x7f8b20003f10 comp rx=0 tx=0).stop 2024-09-10T08:07:26.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.967+0000 7f8b307d8640 1 -- 172.21.15.22:0/2938441674 shutdown_connections 2024-09-10T08:07:26.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.967+0000 7f8b307d8640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b140a2c10 0x7f8b140a50d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:26.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.967+0000 7f8b307d8640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b2810c170 0x7f8b2819ce10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:26.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.967+0000 7f8b307d8640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b28103660 0x7f8b28198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:26.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.967+0000 7f8b307d8640 1 --2- 172.21.15.22:0/2938441674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b28102d40 0x7f8b28198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:26.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.967+0000 7f8b307d8640 1 -- 172.21.15.22:0/2938441674 >> 172.21.15.22:0/2938441674 conn(0x7f8b280fc7a0 msgr2=0x7f8b280fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:26.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.967+0000 7f8b307d8640 1 -- 172.21.15.22:0/2938441674 shutdown_connections 2024-09-10T08:07:26.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:26.967+0000 7f8b307d8640 1 -- 172.21.15.22:0/2938441674 wait complete. 2024-09-10T08:07:27.697 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:27 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2938441674' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:07:27.724 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T08:07:27.725 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T08:07:27.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:27 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2938441674' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:07:27.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:27 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2938441674' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:07:27.978 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.445+0000 7f6b21e2b640 1 -- 172.21.15.22:0/138714150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b1c106a90 msgr2=0x7f6b1c106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.445+0000 7f6b21e2b640 1 --2- 172.21.15.22:0/138714150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b1c106a90 0x7f6b1c106e70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009930 tx=0x7f6b0c02a420 comp rx=0 tx=0).stop 2024-09-10T08:07:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.445+0000 7f6b21e2b640 1 -- 172.21.15.22:0/138714150 shutdown_connections 2024-09-10T08:07:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.445+0000 7f6b21e2b640 1 --2- 172.21.15.22:0/138714150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c101430 0x7f6b1c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.445+0000 7f6b21e2b640 1 --2- 172.21.15.22:0/138714150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b1c100a90 0x7f6b1c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.445+0000 7f6b21e2b640 1 --2- 172.21.15.22:0/138714150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b1c106a90 0x7f6b1c106e70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.445+0000 7f6b21e2b640 1 -- 172.21.15.22:0/138714150 >> 172.21.15.22:0/138714150 conn(0x7f6b1c0fc7d0 msgr2=0x7f6b1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.445+0000 7f6b21e2b640 1 -- 172.21.15.22:0/138714150 shutdown_connections 2024-09-10T08:07:28.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.445+0000 7f6b21e2b640 1 -- 172.21.15.22:0/138714150 wait complete. 2024-09-10T08:07:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.446+0000 7f6b21e2b640 1 Processor -- start 2024-09-10T08:07:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.446+0000 7f6b21e2b640 1 -- start start 2024-09-10T08:07:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.446+0000 7f6b21e2b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c100a90 0x7f6b1c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.446+0000 7f6b21e2b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b1c101430 0x7f6b1c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.446+0000 7f6b21e2b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b1c106a90 0x7f6b1c1a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.446+0000 7f6b21e2b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1c110eb0 con 0x7f6b1c101430 2024-09-10T08:07:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.446+0000 7f6b21e2b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1c110d30 con 0x7f6b1c106a90 2024-09-10T08:07:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.446+0000 7f6b21e2b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1c111030 con 0x7f6b1c100a90 2024-09-10T08:07:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.446+0000 7f6b13fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b1c101430 0x7f6b1c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.446+0000 7f6b13fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b1c101430 0x7f6b1c199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53642/0 (socket says 172.21.15.22:53642) 2024-09-10T08:07:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.446+0000 7f6b13fff640 1 -- 172.21.15.22:0/1009592703 learned_addr learned my addr 172.21.15.22:0/1009592703 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:28.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b1b7fe640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c100a90 0x7f6b1c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b1bfff640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b1c106a90 0x7f6b1c1a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b13fff640 1 -- 172.21.15.22:0/1009592703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c100a90 msgr2=0x7f6b1c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b13fff640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c100a90 0x7f6b1c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b13fff640 1 -- 172.21.15.22:0/1009592703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b1c106a90 msgr2=0x7f6b1c1a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b13fff640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b1c106a90 0x7f6b1c1a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b13fff640 1 -- 172.21.15.22:0/1009592703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1c1a48e0 con 0x7f6b1c101430 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b1bfff640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b1c106a90 0x7f6b1c1a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b13fff640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b1c101430 0x7f6b1c199860 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400b4a0 tx=0x7f6b0400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b197fa640 1 -- 172.21.15.22:0/1009592703 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04014070 con 0x7f6b1c101430 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b21e2b640 1 -- 172.21.15.22:0/1009592703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1c1a4ab0 con 0x7f6b1c101430 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b197fa640 1 -- 172.21.15.22:0/1009592703 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6b04010af0 con 0x7f6b1c101430 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b197fa640 1 -- 172.21.15.22:0/1009592703 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04017d10 con 0x7f6b1c101430 2024-09-10T08:07:28.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.447+0000 7f6b21e2b640 1 -- 172.21.15.22:0/1009592703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b1c1a5040 con 0x7f6b1c101430 2024-09-10T08:07:28.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.448+0000 7f6b21e2b640 1 -- 172.21.15.22:0/1009592703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b1c100ef0 con 0x7f6b1c101430 2024-09-10T08:07:28.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.450+0000 7f6b197fa640 1 -- 172.21.15.22:0/1009592703 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6b04017070 con 0x7f6b1c101430 2024-09-10T08:07:28.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.450+0000 7f6b197fa640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f6b080a2c10 0x7f6b080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:28.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.451+0000 7f6b197fa640 1 -- 172.21.15.22:0/1009592703 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6b040ce8e0 con 0x7f6b1c101430 2024-09-10T08:07:28.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.451+0000 7f6b1b7fe640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f6b080a2c10 0x7f6b080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:28.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.451+0000 7f6b1b7fe640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f6b080a2c10 0x7f6b080a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c000c00 tx=0x7f6b0c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:28.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.454+0000 7f6b197fa640 1 -- 172.21.15.22:0/1009592703 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b0409b7f0 con 0x7f6b1c101430 2024-09-10T08:07:28.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.636+0000 7f6b21e2b640 1 -- 172.21.15.22:0/1009592703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b1c02d7c0 con 0x7f6b1c101430 2024-09-10T08:07:28.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.638+0000 7f6b197fa640 1 -- 172.21.15.22:0/1009592703 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22791 (secure 0 0 0) 0x7f6b0409b0f0 con 0x7f6b1c101430 2024-09-10T08:07:28.638 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:07:28.638 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":83,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","created":"2024-09-10T07:59:04.704048+0000","modified":"2024-09-10T08:07:02.403174+0000","last_up_change":"2024-09-10T08:06:02.535944+0000","last_in_change":"2024-09-10T08:05:39.070554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:02:15.371265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:06:50.358155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:06:52.896201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d296bd3-28a7-418c-ad73-343a5e806cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6803","nonce":4248555152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6805","nonce":4248555152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6809","nonce":4248555152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6807","nonce":4248555152}]},"public_addr":"172.21.15.22:6803/4248555152","cluster_addr":"172.21.15.22:6805/4248555152","heartbeat_back_addr":"172.21.15.22:6809/4248555152","heartbeat_front_addr":"172.21.15.22:6807/4248555152","state":["exists","up"]},{"osd":1,"uuid":"c1e2b40e-b4ab-475a-8a9e-c67409f46b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6801","nonce":2078646052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6803","nonce":2078646052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6807","nonce":2078646052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6805","nonce":2078646052}]},"public_addr":"172.21.15.100:6801/2078646052","cluster_addr":"172.21.15.100:6803/2078646052","heartbeat_back_addr":"172.21.15.100:6807/2078646052","heartbeat_front_addr":"172.21.15.100:6805/2078646052","state":["exists","up"]},{"osd":2,"uuid":"be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6801","nonce":2492419476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6803","nonce":2492419476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6807","nonce":2492419476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6805","nonce":2492419476}]},"public_addr":"172.21.15.153:6801/2492419476","cluster_addr":"172.21.15.153:6803/2492419476","heartbeat_back_addr":"172.21.15.153:6807/2492419476","heartbeat_front_addr":"172.21.15.153:6805/2492419476","state":["exists","up"]},{"osd":3,"uuid":"e980a3ba-c659-4473-9633-9cbe88296d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6811","nonce":3674495276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6813","nonce":3674495276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6817","nonce":3674495276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6815","nonce":3674495276}]},"public_addr":"172.21.15.22:6811/3674495276","cluster_addr":"172.21.15.22:6813/3674495276","heartbeat_back_addr":"172.21.15.22:6817/3674495276","heartbeat_front_addr":"172.21.15.22:6815/3674495276","state":["exists","up"]},{"osd":4,"uuid":"b37d0590-99b1-4566-96b4-9936890d4308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6809","nonce":3886932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6811","nonce":3886932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6815","nonce":3886932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6813","nonce":3886932513}]},"public_addr":"172.21.15.100:6809/3886932513","cluster_addr":"172.21.15.100:6811/3886932513","heartbeat_back_addr":"172.21.15.100:6815/3886932513","heartbeat_front_addr":"172.21.15.100:6813/3886932513","state":["exists","up"]},{"osd":5,"uuid":"6cb989a0-80a1-4a9a-8b45-51b47772b203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6809","nonce":120732073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6811","nonce":120732073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6815","nonce":120732073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6813","nonce":120732073}]},"public_addr":"172.21.15.153:6809/120732073","cluster_addr":"172.21.15.153:6811/120732073","heartbeat_back_addr":"172.21.15.153:6815/120732073","heartbeat_front_addr":"172.21.15.153:6813/120732073","state":["exists","up"]},{"osd":6,"uuid":"294887f3-3e58-4b02-884d-4e0a70a86d16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6819","nonce":3692536487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6821","nonce":3692536487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6825","nonce":3692536487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6823","nonce":3692536487}]},"public_addr":"172.21.15.22:6819/3692536487","cluster_addr":"172.21.15.22:6821/3692536487","heartbeat_back_addr":"172.21.15.22:6825/3692536487","heartbeat_front_addr":"172.21.15.22:6823/3692536487","state":["exists","up"]},{"osd":7,"uuid":"d0c0ec61-4055-46f3-a4b0-39f04c735452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6817","nonce":1221175921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6819","nonce":1221175921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6823","nonce":1221175921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6821","nonce":1221175921}]},"public_addr":"172.21.15.100:6817/1221175921","cluster_addr":"172.21.15.100:6819/1221175921","heartbeat_back_addr":"172.21.15.100:6823/1221175921","heartbeat_front_addr":"172.21.15.100:6821/1221175921","state":["exists","up"]},{"osd":8,"uuid":"bda45a16-742e-4eda-b4d4-e01d6f3dc92e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6817","nonce":1153053941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6819","nonce":1153053941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6823","nonce":1153053941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6821","nonce":1153053941}]},"public_addr":"172.21.15.153:6817/1153053941","cluster_addr":"172.21.15.153:6819/1153053941","heartbeat_back_addr":"172.21.15.153:6823/1153053941","heartbeat_front_addr":"172.21.15.153:6821/1153053941","state":["exists","up"]},{"osd":9,"uuid":"48bd3544-9028-4535-801b-3d39ecadf48e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6827","nonce":3423218876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6829","nonce":3423218876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6833","nonce":3423218876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6831","nonce":3423218876}]},"public_addr":"172.21.15.22:6827/3423218876","cluster_addr":"172.21.15.22:6829/3423218876","heartbeat_back_addr":"172.21.15.22:6833/3423218876","heartbeat_front_addr":"172.21.15.22:6831/3423218876","state":["exists","up"]},{"osd":10,"uuid":"c8716aa0-eb93-435d-a9d0-dd4c3dce1954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6825","nonce":2024112643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6827","nonce":2024112643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6831","nonce":2024112643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6829","nonce":2024112643}]},"public_addr":"172.21.15.100:6825/2024112643","cluster_addr":"172.21.15.100:6827/2024112643","heartbeat_back_addr":"172.21.15.100:6831/2024112643","heartbeat_front_addr":"172.21.15.100:6829/2024112643","state":["exists","up"]},{"osd":11,"uuid":"3c427cfe-8d7c-431e-9eb4-b03cfac3068d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6825","nonce":2245781783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6827","nonce":2245781783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6831","nonce":2245781783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6829","nonce":2245781783}]},"public_addr":"172.21.15.153:6825/2245781783","cluster_addr":"172.21.15.153:6827/2245781783","heartbeat_back_addr":"172.21.15.153:6831/2245781783","heartbeat_front_addr":"172.21.15.153:6829/2245781783","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:23.001057+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:46.353182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:11.469840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:37.557521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:02.630783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:27.374057+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:53.758498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:19.507846+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:45.080789+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:10.286820+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:35.565950+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:06:00.633384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3072001022":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/1519904928":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6801/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/2108462626":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/3337107310":"2024-09-11T07:59:36.505631+0000","172.21.15.22:6801/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/1708436544":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/278091300":"2024-09-11T07:59:36.505631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:07:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.640+0000 7f6b21e2b640 1 -- 172.21.15.22:0/1009592703 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f6b080a2c10 msgr2=0x7f6b080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.640+0000 7f6b21e2b640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f6b080a2c10 0x7f6b080a50d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c000c00 tx=0x7f6b0c005a20 comp rx=0 tx=0).stop 2024-09-10T08:07:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.640+0000 7f6b21e2b640 1 -- 172.21.15.22:0/1009592703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b1c101430 msgr2=0x7f6b1c199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.640+0000 7f6b21e2b640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b1c101430 0x7f6b1c199860 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400b4a0 tx=0x7f6b0400b960 comp rx=0 tx=0).stop 2024-09-10T08:07:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.640+0000 7f6b21e2b640 1 -- 172.21.15.22:0/1009592703 shutdown_connections 2024-09-10T08:07:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.640+0000 7f6b21e2b640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f6b080a2c10 0x7f6b080a50d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.640+0000 7f6b21e2b640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b1c106a90 0x7f6b1c1a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.640+0000 7f6b21e2b640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b1c101430 0x7f6b1c199860 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.640+0000 7f6b21e2b640 1 --2- 172.21.15.22:0/1009592703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c100a90 0x7f6b1c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.640+0000 7f6b21e2b640 1 -- 172.21.15.22:0/1009592703 >> 172.21.15.22:0/1009592703 conn(0x7f6b1c0fc7d0 msgr2=0x7f6b1c0fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.641+0000 7f6b21e2b640 1 -- 172.21.15.22:0/1009592703 shutdown_connections 2024-09-10T08:07:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:28.641+0000 7f6b21e2b640 1 -- 172.21.15.22:0/1009592703 wait complete. 2024-09-10T08:07:28.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:28 smithi100 ceph-mon[35102]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-09-10T08:07:28.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:28 smithi153 ceph-mon[35609]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-09-10T08:07:28.997 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:28 smithi022 ceph-mon[30854]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-09-10T08:07:29.452 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T08:07:29.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T08:07:29.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T08:07:29.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T08:07:29.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T08:07:29.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T08:07:29.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T08:07:29.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T08:07:29.456 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T08:07:29.456 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T08:07:29.457 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T08:07:29.457 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T08:07:29.594 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:29 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1009592703' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:07:29.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:29 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1009592703' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:07:29.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:29 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1009592703' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:07:30.140 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:30.264 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:30.265 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:30.510 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:30.516 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:30.519 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:30.519 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:30.519 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:30.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:30 smithi022 ceph-mon[30854]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-10T08:07:30.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:30 smithi100 ceph-mon[35102]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-10T08:07:30.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:30 smithi153 ceph-mon[35609]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-10T08:07:31.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.407+0000 7fdbf777a640 1 -- 172.21.15.22:0/3128708550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbf0101de0 msgr2=0x7fdbf01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:31.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.407+0000 7fdbf777a640 1 --2- 172.21.15.22:0/3128708550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbf0101de0 0x7fdbf01021c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdbec009900 tx=0x7fdbec02a410 comp rx=0 tx=0).stop 2024-09-10T08:07:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.407+0000 7fdbf777a640 1 -- 172.21.15.22:0/3128708550 shutdown_connections 2024-09-10T08:07:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.407+0000 7fdbf777a640 1 --2- 172.21.15.22:0/3128708550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf0106f10 0x7fdbf010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.407+0000 7fdbf777a640 1 --2- 172.21.15.22:0/3128708550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbf0102790 0x7fdbf01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.407+0000 7fdbf777a640 1 --2- 172.21.15.22:0/3128708550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbf0101de0 0x7fdbf01021c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.407+0000 7fdbf777a640 1 -- 172.21.15.22:0/3128708550 >> 172.21.15.22:0/3128708550 conn(0x7fdbf00fd8c0 msgr2=0x7fdbf00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.407+0000 7fdbf777a640 1 -- 172.21.15.22:0/3128708550 shutdown_connections 2024-09-10T08:07:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.407+0000 7fdbf777a640 1 -- 172.21.15.22:0/3128708550 wait complete. 2024-09-10T08:07:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.408+0000 7fdbf777a640 1 Processor -- start 2024-09-10T08:07:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.408+0000 7fdbf777a640 1 -- start start 2024-09-10T08:07:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.408+0000 7fdbf777a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbf0101de0 0x7fdbf01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.408+0000 7fdbf777a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf0102790 0x7fdbf0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:31.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.408+0000 7fdbf777a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbf0106f10 0x7fdbf019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.408+0000 7fdbf777a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf0112010 con 0x7fdbf0106f10 2024-09-10T08:07:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.408+0000 7fdbf777a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf0111e90 con 0x7fdbf0101de0 2024-09-10T08:07:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.408+0000 7fdbf777a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf0112190 con 0x7fdbf0102790 2024-09-10T08:07:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.408+0000 7fdbf5d17640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbf0106f10 0x7fdbf019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf5d17640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbf0106f10 0x7fdbf019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53668/0 (socket says 172.21.15.22:53668) 2024-09-10T08:07:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf5d17640 1 -- 172.21.15.22:0/1000500996 learned_addr learned my addr 172.21.15.22:0/1000500996 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf4d15640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf0102790 0x7fdbf0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf5516640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbf0101de0 0x7fdbf01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf5d17640 1 -- 172.21.15.22:0/1000500996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf0102790 msgr2=0x7fdbf0198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf5d17640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf0102790 0x7fdbf0198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:31.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf5d17640 1 -- 172.21.15.22:0/1000500996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbf0101de0 msgr2=0x7fdbf01985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf5d17640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbf0101de0 0x7fdbf01985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf5d17640 1 -- 172.21.15.22:0/1000500996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf019d560 con 0x7fdbf0106f10 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf5516640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbf0101de0 0x7fdbf01985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf5d17640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbf0106f10 0x7fdbf019ce80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800b970 tx=0x7fdbe800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbe67fc640 1 -- 172.21.15.22:0/1000500996 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8019070 con 0x7fdbf0106f10 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbe67fc640 1 -- 172.21.15.22:0/1000500996 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdbe800cb40 con 0x7fdbf0106f10 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf777a640 1 -- 172.21.15.22:0/1000500996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf019d850 con 0x7fdbf0106f10 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbe67fc640 1 -- 172.21.15.22:0/1000500996 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8007650 con 0x7fdbf0106f10 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.409+0000 7fdbf777a640 1 -- 172.21.15.22:0/1000500996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf01a5130 con 0x7fdbf0106f10 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.410+0000 7fdbf777a640 1 -- 172.21.15.22:0/1000500996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdbf0062980 con 0x7fdbf0106f10 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.411+0000 7fdbe67fc640 1 -- 172.21.15.22:0/1000500996 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdbe801c070 con 0x7fdbf0106f10 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.412+0000 7fdbe67fc640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdbdc0a2c10 0x7fdbdc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:31.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.412+0000 7fdbf5516640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdbdc0a2c10 0x7fdbdc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:31.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.412+0000 7fdbe67fc640 1 -- 172.21.15.22:0/1000500996 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fdbe80cef30 con 0x7fdbf0106f10 2024-09-10T08:07:31.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.412+0000 7fdbe67fc640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876] conn(0x7fdbdc0ac840 0x7fdbdc0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:31.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.412+0000 7fdbe67fc640 1 -- 172.21.15.22:0/1000500996 --> [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbe80047d0 con 0x7fdbdc0ac840 2024-09-10T08:07:31.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.412+0000 7fdbe67fc640 1 -- 172.21.15.22:0/1000500996 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fdbe80cf360 con 0x7fdbf0106f10 2024-09-10T08:07:31.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.413+0000 7fdbf4d15640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876] conn(0x7fdbdc0ac840 0x7fdbdc0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:31.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.413+0000 7fdbf5516640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdbdc0a2c10 0x7fdbdc0a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000c00 tx=0x7fdbec032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:31.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.413+0000 7fdbf4d15640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876] conn(0x7fdbdc0ac840 0x7fdbdc0aece0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:31.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.414+0000 7fdbe67fc640 1 -- 172.21.15.22:0/1000500996 <== osd.9 v2:172.21.15.22:6826/3423218876 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdbe80047d0 con 0x7fdbdc0ac840 2024-09-10T08:07:31.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.427+0000 7fdbf777a640 1 -- 172.21.15.22:0/1000500996 --> [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdbf0062e00 con 0x7fdbdc0ac840 2024-09-10T08:07:31.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.428+0000 7fdbe67fc640 1 -- 172.21.15.22:0/1000500996 <== osd.9 v2:172.21.15.22:6826/3423218876 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdbf0062e00 con 0x7fdbdc0ac840 2024-09-10T08:07:31.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.428+0000 7fdbf777a640 1 -- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876] conn(0x7fdbdc0ac840 msgr2=0x7fdbdc0aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.428+0000 7fdbf777a640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876] conn(0x7fdbdc0ac840 0x7fdbdc0aece0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.428+0000 7fdbf777a640 1 -- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdbdc0a2c10 msgr2=0x7fdbdc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.428+0000 7fdbf777a640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdbdc0a2c10 0x7fdbdc0a50d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000c00 tx=0x7fdbec032d50 comp rx=0 tx=0).stop 2024-09-10T08:07:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.428+0000 7fdbf777a640 1 -- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbf0106f10 msgr2=0x7fdbf019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.428+0000 7fdbf777a640 1 --2- 172.21.15.22:0/1000500996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdbf0106f10 0x7fdbf019ce80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdbe800b970 tx=0x7fdbe800be30 comp rx=0 tx=0).stop 2024-09-10T08:07:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.428+0000 7fdbf5d17640 1 -- 172.21.15.22:0/1000500996 reap_dead start 2024-09-10T08:07:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.428+0000 7fdbf777a640 1 -- 172.21.15.22:0/1000500996 shutdown_connections 2024-09-10T08:07:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.428+0000 7fdbf777a640 1 -- 172.21.15.22:0/1000500996 >> 172.21.15.22:0/1000500996 conn(0x7fdbf00fd8c0 msgr2=0x7fdbf00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.428+0000 7fdbf777a640 1 -- 172.21.15.22:0/1000500996 shutdown_connections 2024-09-10T08:07:31.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.428+0000 7fdbf777a640 1 -- 172.21.15.22:0/1000500996 wait complete. 2024-09-10T08:07:31.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.953+0000 7f8875605640 1 -- 172.21.15.22:0/3149292496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8870103660 msgr2=0x7f887010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:31.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.953+0000 7f8875605640 1 --2- 172.21.15.22:0/3149292496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8870103660 0x7f887010bb50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8864009900 tx=0x7f886402a480 comp rx=0 tx=0).stop 2024-09-10T08:07:31.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.953+0000 7f8875605640 1 -- 172.21.15.22:0/3149292496 shutdown_connections 2024-09-10T08:07:31.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.953+0000 7f8875605640 1 --2- 172.21.15.22:0/3149292496 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887010c170 0x7f887010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:31.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.953+0000 7f8875605640 1 --2- 172.21.15.22:0/3149292496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8870103660 0x7f887010bb50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:31.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.953+0000 7f8875605640 1 --2- 172.21.15.22:0/3149292496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8870102d40 0x7f8870103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:31.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.953+0000 7f8875605640 1 -- 172.21.15.22:0/3149292496 >> 172.21.15.22:0/3149292496 conn(0x7f88700fc7a0 msgr2=0x7f88700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:31.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.953+0000 7f8875605640 1 -- 172.21.15.22:0/3149292496 shutdown_connections 2024-09-10T08:07:31.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.953+0000 7f8875605640 1 -- 172.21.15.22:0/3149292496 wait complete. 2024-09-10T08:07:31.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.954+0000 7f8875605640 1 Processor -- start 2024-09-10T08:07:31.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.954+0000 7f8875605640 1 -- start start 2024-09-10T08:07:31.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.954+0000 7f8875605640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8870102d40 0x7f88701983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:31.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.954+0000 7f8875605640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8870103660 0x7f8870198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.954+0000 7f8875605640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887010c170 0x7f887019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.954+0000 7f8875605640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8870111f70 con 0x7f8870103660 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.954+0000 7f8875605640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8870111df0 con 0x7f8870102d40 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.954+0000 7f8875605640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f88701120f0 con 0x7f887010c170 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.954+0000 7f886e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8870103660 0x7f8870198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f886e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8870103660 0x7f8870198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53700/0 (socket says 172.21.15.22:53700) 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f886e7fc640 1 -- 172.21.15.22:0/349731577 learned_addr learned my addr 172.21.15.22:0/349731577 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f886effd640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8870102d40 0x7f88701983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f886f7fe640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887010c170 0x7f887019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f886e7fc640 1 -- 172.21.15.22:0/349731577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887010c170 msgr2=0x7f887019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f886e7fc640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887010c170 0x7f887019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f886e7fc640 1 -- 172.21.15.22:0/349731577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8870102d40 msgr2=0x7f88701983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:31.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f886e7fc640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8870102d40 0x7f88701983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f886e7fc640 1 -- 172.21.15.22:0/349731577 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887019d3a0 con 0x7f8870103660 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f886f7fe640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f887010c170 0x7f887019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f886e7fc640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8870103660 0x7f8870198930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8864006010 tx=0x7f8864004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f8857fff640 1 -- 172.21.15.22:0/349731577 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886403f030 con 0x7f8870103660 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f8857fff640 1 -- 172.21.15.22:0/349731577 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8864004440 con 0x7f8870103660 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f8875605640 1 -- 172.21.15.22:0/349731577 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887019d630 con 0x7f8870103660 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f8857fff640 1 -- 172.21.15.22:0/349731577 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8864035070 con 0x7f8870103660 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.955+0000 7f8875605640 1 -- 172.21.15.22:0/349731577 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88701a4f70 con 0x7f8870103660 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.956+0000 7f8875605640 1 -- 172.21.15.22:0/349731577 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8870062980 con 0x7f8870103660 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.957+0000 7f8857fff640 1 -- 172.21.15.22:0/349731577 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8864042030 con 0x7f8870103660 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.958+0000 7f8857fff640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f88580a2c10 0x7f88580a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.958+0000 7f886effd640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f88580a2c10 0x7f88580a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.958+0000 7f8857fff640 1 -- 172.21.15.22:0/349731577 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f88640efe30 con 0x7f8870103660 2024-09-10T08:07:31.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.958+0000 7f8857fff640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073] conn(0x7f88580ac840 0x7f88580aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.958+0000 7f8857fff640 1 -- 172.21.15.22:0/349731577 --> [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88580af3b0 con 0x7f88580ac840 2024-09-10T08:07:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.958+0000 7f8857fff640 1 -- 172.21.15.22:0/349731577 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f88640f0260 con 0x7f8870103660 2024-09-10T08:07:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.959+0000 7f886effd640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f88580a2c10 0x7f88580a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8860009bd0 tx=0x7f8860005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.959+0000 7f886f7fe640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073] conn(0x7f88580ac840 0x7f88580aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.959+0000 7f886f7fe640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073] conn(0x7f88580ac840 0x7f88580aece0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.960+0000 7f8857fff640 1 -- 172.21.15.22:0/349731577 <== osd.5 v2:172.21.15.153:6808/120732073 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88580af3b0 con 0x7f88580ac840 2024-09-10T08:07:31.967 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:31.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.974+0000 7f8875605640 1 -- 172.21.15.22:0/349731577 --> [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8870062e00 con 0x7f88580ac840 2024-09-10T08:07:31.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.974+0000 7f8857fff640 1 -- 172.21.15.22:0/349731577 <== osd.5 v2:172.21.15.153:6808/120732073 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8870062e00 con 0x7f88580ac840 2024-09-10T08:07:31.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.975+0000 7f8875605640 1 -- 172.21.15.22:0/349731577 >> [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073] conn(0x7f88580ac840 msgr2=0x7f88580aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.975+0000 7f8875605640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073] conn(0x7f88580ac840 0x7f88580aece0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.975+0000 7f8875605640 1 -- 172.21.15.22:0/349731577 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f88580a2c10 msgr2=0x7f88580a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.975+0000 7f8875605640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f88580a2c10 0x7f88580a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8860009bd0 tx=0x7f8860005f90 comp rx=0 tx=0).stop 2024-09-10T08:07:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.975+0000 7f8875605640 1 -- 172.21.15.22:0/349731577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8870103660 msgr2=0x7f8870198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.975+0000 7f8875605640 1 --2- 172.21.15.22:0/349731577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8870103660 0x7f8870198930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8864006010 tx=0x7f8864004040 comp rx=0 tx=0).stop 2024-09-10T08:07:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.975+0000 7f886f7fe640 1 -- 172.21.15.22:0/349731577 reap_dead start 2024-09-10T08:07:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.975+0000 7f8875605640 1 -- 172.21.15.22:0/349731577 shutdown_connections 2024-09-10T08:07:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.975+0000 7f8875605640 1 -- 172.21.15.22:0/349731577 >> 172.21.15.22:0/349731577 conn(0x7f88700fc7a0 msgr2=0x7f88700fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.975+0000 7f8875605640 1 -- 172.21.15.22:0/349731577 shutdown_connections 2024-09-10T08:07:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:31.975+0000 7f8875605640 1 -- 172.21.15.22:0/349731577 wait complete. 2024-09-10T08:07:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.510+0000 7fbf9e426640 1 -- 172.21.15.22:0/474979865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf98102790 msgr2=0x7fbf981067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.510+0000 7fbf9e426640 1 --2- 172.21.15.22:0/474979865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf98102790 0x7fbf981067e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009900 tx=0x7fbf8c02a410 comp rx=0 tx=0).stop 2024-09-10T08:07:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.510+0000 7fbf9e426640 1 -- 172.21.15.22:0/474979865 shutdown_connections 2024-09-10T08:07:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.510+0000 7fbf9e426640 1 --2- 172.21.15.22:0/474979865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf98106f10 0x7fbf9810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.510+0000 7fbf9e426640 1 --2- 172.21.15.22:0/474979865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf98102790 0x7fbf981067e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.510+0000 7fbf9e426640 1 --2- 172.21.15.22:0/474979865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf98101de0 0x7fbf981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.510+0000 7fbf9e426640 1 -- 172.21.15.22:0/474979865 >> 172.21.15.22:0/474979865 conn(0x7fbf980fd8c0 msgr2=0x7fbf980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:32.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.510+0000 7fbf9e426640 1 -- 172.21.15.22:0/474979865 shutdown_connections 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.510+0000 7fbf9e426640 1 -- 172.21.15.22:0/474979865 wait complete. 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.511+0000 7fbf9e426640 1 Processor -- start 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.511+0000 7fbf9e426640 1 -- start start 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.511+0000 7fbf9e426640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf98101de0 0x7fbf98198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.511+0000 7fbf9e426640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf98102790 0x7fbf98198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.511+0000 7fbf9e426640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf98106f10 0x7fbf9819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.511+0000 7fbf9e426640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbf98111f30 con 0x7fbf98102790 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.511+0000 7fbf9e426640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf98111db0 con 0x7fbf98101de0 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.511+0000 7fbf9e426640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981120b0 con 0x7fbf98106f10 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.511+0000 7fbf977fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf98102790 0x7fbf98198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.511+0000 7fbf977fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf98102790 0x7fbf98198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53716/0 (socket says 172.21.15.22:53716) 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.511+0000 7fbf977fe640 1 -- 172.21.15.22:0/801924435 learned_addr learned my addr 172.21.15.22:0/801924435 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:32.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf9c9c3640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf98106f10 0x7fbf9819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:32.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf97fff640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf98101de0 0x7fbf98198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:32.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf977fe640 1 -- 172.21.15.22:0/801924435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf98106f10 msgr2=0x7fbf9819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:32.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf977fe640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf98106f10 0x7fbf9819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:32.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf977fe640 1 -- 172.21.15.22:0/801924435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf98101de0 msgr2=0x7fbf98198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:32.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf977fe640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf98101de0 0x7fbf98198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:32.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf977fe640 1 -- 172.21.15.22:0/801924435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9819d3e0 con 0x7fbf98102790 2024-09-10T08:07:32.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf977fe640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf98102790 0x7fbf98198970 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c006010 tx=0x7fbf8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf957fa640 1 -- 172.21.15.22:0/801924435 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c03f030 con 0x7fbf98102790 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf957fa640 1 -- 172.21.15.22:0/801924435 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf8c003ce0 con 0x7fbf98102790 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf9e426640 1 -- 172.21.15.22:0/801924435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9819d670 con 0x7fbf98102790 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf957fa640 1 -- 172.21.15.22:0/801924435 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c035070 con 0x7fbf98102790 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.512+0000 7fbf9e426640 1 -- 172.21.15.22:0/801924435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf981a4fb0 con 0x7fbf98102790 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.513+0000 7fbf9e426640 1 -- 172.21.15.22:0/801924435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf98062980 con 0x7fbf98102790 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.514+0000 7fbf957fa640 1 -- 172.21.15.22:0/801924435 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fbf8c042030 con 0x7fbf98102790 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.515+0000 7fbf957fa640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbf800a2c90 0x7fbf800a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.515+0000 7fbf97fff640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbf800a2c90 0x7fbf800a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.515+0000 7fbf957fa640 1 -- 172.21.15.22:0/801924435 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbf8c0efcc0 con 0x7fbf98102790 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.515+0000 7fbf957fa640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476] conn(0x7fbf800ac8c0 0x7fbf800aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.515+0000 7fbf957fa640 1 -- 172.21.15.22:0/801924435 --> [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf8c001d30 con 0x7fbf800ac8c0 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.515+0000 7fbf957fa640 1 -- 172.21.15.22:0/801924435 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fbf8c0f00f0 con 0x7fbf98102790 2024-09-10T08:07:32.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.516+0000 7fbf97fff640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbf800a2c90 0x7fbf800a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbf88005d00 tx=0x7fbf8800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.516+0000 7fbf9c9c3640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476] conn(0x7fbf800ac8c0 0x7fbf800aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.516+0000 7fbf9c9c3640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476] conn(0x7fbf800ac8c0 0x7fbf800aed60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.517+0000 7fbf957fa640 1 -- 172.21.15.22:0/801924435 <== osd.2 v2:172.21.15.153:6800/2492419476 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf8c001d30 con 0x7fbf800ac8c0 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.531+0000 7fbf9e426640 1 -- 172.21.15.22:0/801924435 --> [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbf98062d80 con 0x7fbf800ac8c0 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.531+0000 7fbf957fa640 1 -- 172.21.15.22:0/801924435 <== osd.2 v2:172.21.15.153:6800/2492419476 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbf98062d80 con 0x7fbf800ac8c0 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.532+0000 7fbf9e426640 1 -- 172.21.15.22:0/801924435 >> [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476] conn(0x7fbf800ac8c0 msgr2=0x7fbf800aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.532+0000 7fbf9e426640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476] conn(0x7fbf800ac8c0 0x7fbf800aed60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.532+0000 7fbf9e426640 1 -- 172.21.15.22:0/801924435 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbf800a2c90 msgr2=0x7fbf800a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.532+0000 7fbf9e426640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbf800a2c90 0x7fbf800a5150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbf88005d00 tx=0x7fbf8800b410 comp rx=0 tx=0).stop 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.532+0000 7fbf9e426640 1 -- 172.21.15.22:0/801924435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf98102790 msgr2=0x7fbf98198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.532+0000 7fbf9e426640 1 --2- 172.21.15.22:0/801924435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf98102790 0x7fbf98198970 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c006010 tx=0x7fbf8c0042f0 comp rx=0 tx=0).stop 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.532+0000 7fbf9c9c3640 1 -- 172.21.15.22:0/801924435 reap_dead start 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.532+0000 7fbf9e426640 1 -- 172.21.15.22:0/801924435 shutdown_connections 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.532+0000 7fbf9e426640 1 -- 172.21.15.22:0/801924435 >> 172.21.15.22:0/801924435 conn(0x7fbf980fd8c0 msgr2=0x7fbf980fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.532+0000 7fbf9e426640 1 -- 172.21.15.22:0/801924435 shutdown_connections 2024-09-10T08:07:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:32.532+0000 7fbf9e426640 1 -- 172.21.15.22:0/801924435 wait complete. 2024-09-10T08:07:32.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:32 smithi022 ceph-mon[30854]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-10T08:07:32.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:32 smithi100 ceph-mon[35102]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-10T08:07:32.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:32 smithi153 ceph-mon[35609]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-10T08:07:33.550 INFO:teuthology.orchestra.run.smithi022.stdout:77309411395 2024-09-10T08:07:33.551 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T08:07:34.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.921+0000 7f6dd668d640 1 -- 172.21.15.22:0/3558477121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd0102570 msgr2=0x7f6dd01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.921+0000 7f6dd668d640 1 --2- 172.21.15.22:0/3558477121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd0102570 0x7f6dd01029b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6db8009900 tx=0x7f6db802a480 comp rx=0 tx=0).stop 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.921+0000 7f6dd668d640 1 -- 172.21.15.22:0/3558477121 shutdown_connections 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.921+0000 7f6dd668d640 1 --2- 172.21.15.22:0/3558477121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dd0102ef0 0x7f6dd010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.921+0000 7f6dd668d640 1 --2- 172.21.15.22:0/3558477121 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd0102570 0x7f6dd01029b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.921+0000 7f6dd668d640 1 --2- 172.21.15.22:0/3558477121 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd0100e20 0x7f6dd0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.921+0000 7f6dd668d640 1 -- 172.21.15.22:0/3558477121 >> 172.21.15.22:0/3558477121 conn(0x7f6dd00fc7d0 msgr2=0x7f6dd00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.921+0000 7f6dd668d640 1 -- 172.21.15.22:0/3558477121 shutdown_connections 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.922+0000 7f6dd668d640 1 -- 172.21.15.22:0/3558477121 wait complete. 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.922+0000 7f6dd668d640 1 Processor -- start 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd668d640 1 -- start start 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd668d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dd0100e20 0x7f6dd019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd668d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd0102570 0x7f6dd019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:34.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd668d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd0102ef0 0x7f6dd019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd668d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0110f50 con 0x7f6dd0102ef0 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd668d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0110dd0 con 0x7f6dd0102570 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd668d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd01110d0 con 0x7f6dd0100e20 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd4c2a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd0102ef0 0x7f6dd019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd4c2a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd0102ef0 0x7f6dd019efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50062/0 (socket says 172.21.15.22:50062) 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd4c2a640 1 -- 172.21.15.22:0/2679247818 learned_addr learned my addr 172.21.15.22:0/2679247818 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dcffff640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dd0100e20 0x7f6dd019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dc7fff640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd0102570 0x7f6dd019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd4c2a640 1 -- 172.21.15.22:0/2679247818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dd0100e20 msgr2=0x7f6dd019a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd4c2a640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dd0100e20 0x7f6dd019a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd4c2a640 1 -- 172.21.15.22:0/2679247818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd0102570 msgr2=0x7f6dd019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd4c2a640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6dd0102570 0x7f6dd019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:34.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.923+0000 7f6dd4c2a640 1 -- 172.21.15.22:0/2679247818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd019f680 con 0x7f6dd0102ef0 2024-09-10T08:07:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.924+0000 7f6dd4c2a640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd0102ef0 0x7f6dd019efa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800eb10 tx=0x7f6dc800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.924+0000 7f6dcdffb640 1 -- 172.21.15.22:0/2679247818 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8004b20 con 0x7f6dd0102ef0 2024-09-10T08:07:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.924+0000 7f6dcdffb640 1 -- 172.21.15.22:0/2679247818 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6dc8004cc0 con 0x7f6dd0102ef0 2024-09-10T08:07:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.924+0000 7f6dd668d640 1 -- 172.21.15.22:0/2679247818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd019f970 con 0x7f6dd0102ef0 2024-09-10T08:07:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.924+0000 7f6dcdffb640 1 -- 172.21.15.22:0/2679247818 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8010760 con 0x7f6dd0102ef0 2024-09-10T08:07:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.924+0000 7f6dd668d640 1 -- 172.21.15.22:0/2679247818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd01a7250 con 0x7f6dd0102ef0 2024-09-10T08:07:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.925+0000 7f6dd668d640 1 -- 172.21.15.22:0/2679247818 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6dd006aaa0 con 0x7f6dd0102ef0 2024-09-10T08:07:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.927+0000 7f6dcdffb640 1 -- 172.21.15.22:0/2679247818 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6dc8005020 con 0x7f6dd0102ef0 2024-09-10T08:07:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.927+0000 7f6dcdffb640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f6dbc0a2c90 0x7f6dbc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:34.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.928+0000 7f6dcffff640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f6dbc0a2c90 0x7f6dbc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:34.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.928+0000 7f6dcdffb640 1 -- 172.21.15.22:0/2679247818 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f6dc80cfa80 con 0x7f6dd0102ef0 2024-09-10T08:07:34.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.928+0000 7f6dcdffb640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643] conn(0x7f6dbc0ac8c0 0x7f6dbc0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:34.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.928+0000 7f6dcdffb640 1 -- 172.21.15.22:0/2679247818 --> [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6dbc0af430 con 0x7f6dbc0ac8c0 2024-09-10T08:07:34.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.928+0000 7f6dcdffb640 1 -- 172.21.15.22:0/2679247818 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f6dc80cfeb0 con 0x7f6dd0102ef0 2024-09-10T08:07:34.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.928+0000 7f6dc7fff640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643] conn(0x7f6dbc0ac8c0 0x7f6dbc0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:34.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.928+0000 7f6dcffff640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f6dbc0a2c90 0x7f6dbc0a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0005d00 tx=0x7f6dc000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:34.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.928+0000 7f6dc7fff640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643] conn(0x7f6dbc0ac8c0 0x7f6dbc0aed60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:34.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.929+0000 7f6dcdffb640 1 -- 172.21.15.22:0/2679247818 <== osd.10 v2:172.21.15.100:6824/2024112643 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6dbc0af430 con 0x7f6dbc0ac8c0 2024-09-10T08:07:34.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.944+0000 7f6dd668d640 1 -- 172.21.15.22:0/2679247818 --> [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6dd01021b0 con 0x7f6dbc0ac8c0 2024-09-10T08:07:34.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.944+0000 7f6dcdffb640 1 -- 172.21.15.22:0/2679247818 <== osd.10 v2:172.21.15.100:6824/2024112643 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6dd01021b0 con 0x7f6dbc0ac8c0 2024-09-10T08:07:34.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.945+0000 7f6dd668d640 1 -- 172.21.15.22:0/2679247818 >> [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643] conn(0x7f6dbc0ac8c0 msgr2=0x7f6dbc0aed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:34.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.945+0000 7f6dd668d640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643] conn(0x7f6dbc0ac8c0 0x7f6dbc0aed60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:34.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.945+0000 7f6dd668d640 1 -- 172.21.15.22:0/2679247818 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f6dbc0a2c90 msgr2=0x7f6dbc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:34.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.945+0000 7f6dd668d640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f6dbc0a2c90 0x7f6dbc0a5150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0005d00 tx=0x7f6dc000b410 comp rx=0 tx=0).stop 2024-09-10T08:07:34.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.945+0000 7f6dd668d640 1 -- 172.21.15.22:0/2679247818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd0102ef0 msgr2=0x7f6dd019efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:34.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.945+0000 7f6dd668d640 1 --2- 172.21.15.22:0/2679247818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd0102ef0 0x7f6dd019efa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800eb10 tx=0x7f6dc800c2d0 comp rx=0 tx=0).stop 2024-09-10T08:07:34.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.945+0000 7f6dd4c2a640 1 -- 172.21.15.22:0/2679247818 reap_dead start 2024-09-10T08:07:34.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.945+0000 7f6dd668d640 1 -- 172.21.15.22:0/2679247818 shutdown_connections 2024-09-10T08:07:34.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.945+0000 7f6dd668d640 1 -- 172.21.15.22:0/2679247818 >> 172.21.15.22:0/2679247818 conn(0x7f6dd00fc7d0 msgr2=0x7f6dd00ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:34.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.945+0000 7f6dd668d640 1 -- 172.21.15.22:0/2679247818 shutdown_connections 2024-09-10T08:07:34.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:33.945+0000 7f6dd668d640 1 -- 172.21.15.22:0/2679247818 wait complete. 2024-09-10T08:07:34.681 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:34 smithi022 ceph-mon[30854]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-10T08:07:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:34 smithi100 ceph-mon[35102]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-10T08:07:34.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:34 smithi153 ceph-mon[35609]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-09-10T08:07:35.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.353+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/3796257742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d48106a80 msgr2=0x7f2d48106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.353+0000 7f2d4d2b3640 1 --2- 172.21.15.22:0/3796257742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d48106a80 0x7f2d48106e60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2d38009cd0 tx=0x7f2d3802a8e0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.353+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/3796257742 shutdown_connections 2024-09-10T08:07:35.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.353+0000 7f2d4d2b3640 1 --2- 172.21.15.22:0/3796257742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d48101420 0x7f2d4810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.353+0000 7f2d4d2b3640 1 --2- 172.21.15.22:0/3796257742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d48100a80 0x7f2d48100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.353+0000 7f2d4d2b3640 1 --2- 172.21.15.22:0/3796257742 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d48106a80 0x7f2d48106e60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.353+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/3796257742 >> 172.21.15.22:0/3796257742 conn(0x7f2d480fc7a0 msgr2=0x7f2d480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:35.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.354+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/3796257742 shutdown_connections 2024-09-10T08:07:35.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.354+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/3796257742 wait complete. 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.354+0000 7f2d4d2b3640 1 Processor -- start 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.354+0000 7f2d4d2b3640 1 -- start start 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d4d2b3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d48100a80 0x7f2d48199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d4d2b3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d48101420 0x7f2d48199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d4d2b3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d48106a80 0x7f2d481a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d4d2b3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2d48110ea0 con 0x7f2d48101420 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d4d2b3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d48110d20 con 0x7f2d48106a80 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d4d2b3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2d48111020 con 0x7f2d48100a80 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d467fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d48101420 0x7f2d48199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d467fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d48101420 0x7f2d48199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50074/0 (socket says 172.21.15.22:50074) 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d467fc640 1 -- 172.21.15.22:0/2602826329 learned_addr learned my addr 172.21.15.22:0/2602826329 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d477fe640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d48106a80 0x7f2d481a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d46ffd640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d48100a80 0x7f2d48199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d467fc640 1 -- 172.21.15.22:0/2602826329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d48100a80 msgr2=0x7f2d48199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d467fc640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d48100a80 0x7f2d48199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d467fc640 1 -- 172.21.15.22:0/2602826329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d48106a80 msgr2=0x7f2d481a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d467fc640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d48106a80 0x7f2d481a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d467fc640 1 -- 172.21.15.22:0/2602826329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d481a48d0 con 0x7f2d48101420 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d467fc640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d48101420 0x7f2d48199850 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000c890 tx=0x7f2d3000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.355+0000 7f2d3ffff640 1 -- 172.21.15.22:0/2602826329 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30004220 con 0x7f2d48101420 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.356+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/2602826329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d481a4aa0 con 0x7f2d48101420 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.356+0000 7f2d3ffff640 1 -- 172.21.15.22:0/2602826329 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d300043c0 con 0x7f2d48101420 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.356+0000 7f2d3ffff640 1 -- 172.21.15.22:0/2602826329 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30004a00 con 0x7f2d48101420 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.356+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/2602826329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d481a5030 con 0x7f2d48101420 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.356+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/2602826329 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d480628c0 con 0x7f2d48101420 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.358+0000 7f2d3ffff640 1 -- 172.21.15.22:0/2602826329 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2d300079b0 con 0x7f2d48101420 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.358+0000 7f2d3ffff640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2d340a2c10 0x7f2d340a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.358+0000 7f2d46ffd640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2d340a2c10 0x7f2d340a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.358+0000 7f2d3ffff640 1 -- 172.21.15.22:0/2602826329 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2d300cf290 con 0x7f2d48101420 2024-09-10T08:07:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.359+0000 7f2d3ffff640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921] conn(0x7f2d340ac840 0x7f2d340aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.359+0000 7f2d3ffff640 1 -- 172.21.15.22:0/2602826329 --> [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d340af3b0 con 0x7f2d340ac840 2024-09-10T08:07:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.359+0000 7f2d3ffff640 1 -- 172.21.15.22:0/2602826329 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f2d300cf6c0 con 0x7f2d48101420 2024-09-10T08:07:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.359+0000 7f2d46ffd640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2d340a2c10 0x7f2d340a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d38006010 tx=0x7f2d38009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.359+0000 7f2d477fe640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921] conn(0x7f2d340ac840 0x7f2d340aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.359+0000 7f2d477fe640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921] conn(0x7f2d340ac840 0x7f2d340aece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.360+0000 7f2d3ffff640 1 -- 172.21.15.22:0/2602826329 <== osd.7 v2:172.21.15.100:6816/1221175921 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d340af3b0 con 0x7f2d340ac840 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.374+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/2602826329 --> [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d48062cc0 con 0x7f2d340ac840 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.374+0000 7f2d3ffff640 1 -- 172.21.15.22:0/2602826329 <== osd.7 v2:172.21.15.100:6816/1221175921 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2d48062cc0 con 0x7f2d340ac840 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.375+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/2602826329 >> [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921] conn(0x7f2d340ac840 msgr2=0x7f2d340aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.375+0000 7f2d4d2b3640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921] conn(0x7f2d340ac840 0x7f2d340aece0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.375+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/2602826329 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2d340a2c10 msgr2=0x7f2d340a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.375+0000 7f2d4d2b3640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f2d340a2c10 0x7f2d340a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2d38006010 tx=0x7f2d38009800 comp rx=0 tx=0).stop 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.375+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/2602826329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d48101420 msgr2=0x7f2d48199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.375+0000 7f2d4d2b3640 1 --2- 172.21.15.22:0/2602826329 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d48101420 0x7f2d48199850 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2d3000c890 tx=0x7f2d3000cd50 comp rx=0 tx=0).stop 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.375+0000 7f2d477fe640 1 -- 172.21.15.22:0/2602826329 reap_dead start 2024-09-10T08:07:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.375+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/2602826329 shutdown_connections 2024-09-10T08:07:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.375+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/2602826329 >> 172.21.15.22:0/2602826329 conn(0x7f2d480fc7a0 msgr2=0x7f2d480fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.375+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/2602826329 shutdown_connections 2024-09-10T08:07:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:34.375+0000 7f2d4d2b3640 1 -- 172.21.15.22:0/2602826329 wait complete. 2024-09-10T08:07:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.487+0000 7fed5e19d640 1 -- 172.21.15.22:0/1621266741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5810c150 msgr2=0x7fed5810e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.487+0000 7fed5e19d640 1 --2- 172.21.15.22:0/1621266741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5810c150 0x7fed5810e5f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fed50009900 tx=0x7fed5002a480 comp rx=0 tx=0).stop 2024-09-10T08:07:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.487+0000 7fed5e19d640 1 -- 172.21.15.22:0/1621266741 shutdown_connections 2024-09-10T08:07:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.487+0000 7fed5e19d640 1 --2- 172.21.15.22:0/1621266741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5810c150 0x7fed5810e5f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.487+0000 7fed5e19d640 1 --2- 172.21.15.22:0/1621266741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed58103640 0x7fed5810bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.487+0000 7fed5e19d640 1 --2- 172.21.15.22:0/1621266741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed58102d20 0x7fed58103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.487+0000 7fed5e19d640 1 -- 172.21.15.22:0/1621266741 >> 172.21.15.22:0/1621266741 conn(0x7fed580fc780 msgr2=0x7fed580feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.487+0000 7fed5e19d640 1 -- 172.21.15.22:0/1621266741 shutdown_connections 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.487+0000 7fed5e19d640 1 -- 172.21.15.22:0/1621266741 wait complete. 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.487+0000 7fed5e19d640 1 Processor -- start 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed5e19d640 1 -- start start 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed5e19d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed58102d20 0x7fed581983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed5e19d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed58103640 0x7fed58198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed5e19d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5810c150 0x7fed5819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed5e19d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fed58111f50 con 0x7fed5810c150 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed5e19d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fed58111dd0 con 0x7fed58102d20 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed5e19d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fed581120d0 con 0x7fed58103640 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed57fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5810c150 0x7fed5819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed57fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5810c150 0x7fed5819cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50088/0 (socket says 172.21.15.22:50088) 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed57fff640 1 -- 172.21.15.22:0/852440612 learned_addr learned my addr 172.21.15.22:0/852440612 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed577fe640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed58102d20 0x7fed581983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed56ffd640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed58103640 0x7fed58198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed57fff640 1 -- 172.21.15.22:0/852440612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed58103640 msgr2=0x7fed58198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.488+0000 7fed57fff640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed58103640 0x7fed58198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.489+0000 7fed57fff640 1 -- 172.21.15.22:0/852440612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed58102d20 msgr2=0x7fed581983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.489+0000 7fed57fff640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed58102d20 0x7fed581983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.489+0000 7fed57fff640 1 -- 172.21.15.22:0/852440612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed5819d370 con 0x7fed5810c150 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.489+0000 7fed57fff640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5810c150 0x7fed5819cc90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fed50005ab0 tx=0x7fed500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.489+0000 7fed54ff9640 1 -- 172.21.15.22:0/852440612 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed5003f030 con 0x7fed5810c150 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.489+0000 7fed54ff9640 1 -- 172.21.15.22:0/852440612 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed50003ce0 con 0x7fed5810c150 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.489+0000 7fed5e19d640 1 -- 172.21.15.22:0/852440612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed5819d600 con 0x7fed5810c150 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.489+0000 7fed54ff9640 1 -- 172.21.15.22:0/852440612 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed50035070 con 0x7fed5810c150 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.489+0000 7fed5e19d640 1 -- 172.21.15.22:0/852440612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed581a4f40 con 0x7fed5810c150 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.490+0000 7fed5e19d640 1 -- 172.21.15.22:0/852440612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fed58062980 con 0x7fed5810c150 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.491+0000 7fed54ff9640 1 -- 172.21.15.22:0/852440612 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fed50042030 con 0x7fed5810c150 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.492+0000 7fed54ff9640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fed440a2c10 0x7fed440a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.492+0000 7fed577fe640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fed440a2c10 0x7fed440a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.492+0000 7fed54ff9640 1 -- 172.21.15.22:0/852440612 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fed500efc30 con 0x7fed5810c150 2024-09-10T08:07:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.493+0000 7fed54ff9640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276] conn(0x7fed440ac710 0x7fed440aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.493+0000 7fed54ff9640 1 -- 172.21.15.22:0/852440612 --> [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed50001d30 con 0x7fed440ac710 2024-09-10T08:07:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.493+0000 7fed54ff9640 1 -- 172.21.15.22:0/852440612 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fed500effe0 con 0x7fed5810c150 2024-09-10T08:07:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.493+0000 7fed56ffd640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276] conn(0x7fed440ac710 0x7fed440aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.493+0000 7fed577fe640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fed440a2c10 0x7fed440a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed48005fd0 tx=0x7fed48009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.493+0000 7fed56ffd640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276] conn(0x7fed440ac710 0x7fed440aebb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:35.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.494+0000 7fed54ff9640 1 -- 172.21.15.22:0/852440612 <== osd.3 v2:172.21.15.22:6810/3674495276 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed50001d30 con 0x7fed440ac710 2024-09-10T08:07:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.508+0000 7fed5e19d640 1 -- 172.21.15.22:0/852440612 --> [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed58062d80 con 0x7fed440ac710 2024-09-10T08:07:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.508+0000 7fed54ff9640 1 -- 172.21.15.22:0/852440612 <== osd.3 v2:172.21.15.22:6810/3674495276 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fed58062d80 con 0x7fed440ac710 2024-09-10T08:07:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.508+0000 7fed5e19d640 1 -- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276] conn(0x7fed440ac710 msgr2=0x7fed440aebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.508+0000 7fed5e19d640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276] conn(0x7fed440ac710 0x7fed440aebb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.508+0000 7fed5e19d640 1 -- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fed440a2c10 msgr2=0x7fed440a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.508+0000 7fed5e19d640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fed440a2c10 0x7fed440a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed48005fd0 tx=0x7fed48009680 comp rx=0 tx=0).stop 2024-09-10T08:07:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.508+0000 7fed5e19d640 1 -- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5810c150 msgr2=0x7fed5819cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.508+0000 7fed5e19d640 1 --2- 172.21.15.22:0/852440612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fed5810c150 0x7fed5819cc90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fed50005ab0 tx=0x7fed500042f0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.508+0000 7fed57fff640 1 -- 172.21.15.22:0/852440612 reap_dead start 2024-09-10T08:07:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.508+0000 7fed5e19d640 1 -- 172.21.15.22:0/852440612 shutdown_connections 2024-09-10T08:07:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.508+0000 7fed5e19d640 1 -- 172.21.15.22:0/852440612 >> 172.21.15.22:0/852440612 conn(0x7fed580fc780 msgr2=0x7fed580fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.509+0000 7fed5e19d640 1 -- 172.21.15.22:0/852440612 shutdown_connections 2024-09-10T08:07:35.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.509+0000 7fed5e19d640 1 -- 172.21.15.22:0/852440612 wait complete. 2024-09-10T08:07:35.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.917+0000 7f920b093640 1 -- 172.21.15.22:0/55336506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92041082a0 msgr2=0x7f920410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.917+0000 7f920b093640 1 --2- 172.21.15.22:0/55336506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92041082a0 0x7f920410ec40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009cd0 tx=0x7f91fc02a8e0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.917+0000 7f920b093640 1 -- 172.21.15.22:0/55336506 shutdown_connections 2024-09-10T08:07:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.917+0000 7f920b093640 1 --2- 172.21.15.22:0/55336506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92041082a0 0x7f920410ec40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.917+0000 7f920b093640 1 --2- 172.21.15.22:0/55336506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92041036e0 0x7f9204107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.917+0000 7f920b093640 1 --2- 172.21.15.22:0/55336506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9204102d30 0x7f9204103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.917+0000 7f920b093640 1 -- 172.21.15.22:0/55336506 >> 172.21.15.22:0/55336506 conn(0x7f92040fc7d0 msgr2=0x7f92040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.917+0000 7f920b093640 1 -- 172.21.15.22:0/55336506 shutdown_connections 2024-09-10T08:07:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.917+0000 7f920b093640 1 -- 172.21.15.22:0/55336506 wait complete. 2024-09-10T08:07:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.917+0000 7f920b093640 1 Processor -- start 2024-09-10T08:07:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.917+0000 7f920b093640 1 -- start start 2024-09-10T08:07:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f920b093640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9204102d30 0x7f9204100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f920b093640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92041036e0 0x7f9204100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f920b093640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92041082a0 0x7f9204101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f920b093640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f92041120d0 con 0x7f92041082a0 2024-09-10T08:07:35.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f920b093640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9204111f50 con 0x7f92041036e0 2024-09-10T08:07:35.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f920b093640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9204112250 con 0x7f9204102d30 2024-09-10T08:07:35.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9209630640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92041082a0 0x7f9204101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9209630640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92041082a0 0x7f9204101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50108/0 (socket says 172.21.15.22:50108) 2024-09-10T08:07:35.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9209630640 1 -- 172.21.15.22:0/2005893066 learned_addr learned my addr 172.21.15.22:0/2005893066 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:35.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9208e2f640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9204102d30 0x7f9204100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9203fff640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92041036e0 0x7f9204100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9209630640 1 -- 172.21.15.22:0/2005893066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9204102d30 msgr2=0x7f9204100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9209630640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9204102d30 0x7f9204100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9209630640 1 -- 172.21.15.22:0/2005893066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92041036e0 msgr2=0x7f9204100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9209630640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92041036e0 0x7f9204100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9209630640 1 -- 172.21.15.22:0/2005893066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92041a6a20 con 0x7f92041082a0 2024-09-10T08:07:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9203fff640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f92041036e0 0x7f9204100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:07:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9209630640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92041082a0 0x7f9204101410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f91fc033040 tx=0x7f91fc031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9201ffb640 1 -- 172.21.15.22:0/2005893066 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc004040 con 0x7f92041082a0 2024-09-10T08:07:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f920b093640 1 -- 172.21.15.22:0/2005893066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92041a6cb0 con 0x7f92041082a0 2024-09-10T08:07:35.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9201ffb640 1 -- 172.21.15.22:0/2005893066 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91fc0046c0 con 0x7f92041082a0 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.918+0000 7f9201ffb640 1 -- 172.21.15.22:0/2005893066 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc030ed0 con 0x7f92041082a0 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.919+0000 7f920b093640 1 -- 172.21.15.22:0/2005893066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92041a71f0 con 0x7f92041082a0 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.919+0000 7f920b093640 1 -- 172.21.15.22:0/2005893066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92040628c0 con 0x7f92041082a0 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.921+0000 7f9201ffb640 1 -- 172.21.15.22:0/2005893066 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f91fc0041e0 con 0x7f92041082a0 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.922+0000 7f9201ffb640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f91ec0a2c10 0x7f91ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.922+0000 7f9208e2f640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f91ec0a2c10 0x7f91ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.922+0000 7f9201ffb640 1 -- 172.21.15.22:0/2005893066 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f91fc02e030 con 0x7f92041082a0 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.922+0000 7f9201ffb640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152] conn(0x7f91ec0ac840 0x7f91ec0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.922+0000 7f9201ffb640 1 -- 172.21.15.22:0/2005893066 --> [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91fc0020b0 con 0x7f91ec0ac840 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.922+0000 7f9201ffb640 1 -- 172.21.15.22:0/2005893066 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f91fc0f0c40 con 0x7f92041082a0 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.922+0000 7f9203fff640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152] conn(0x7f91ec0ac840 0x7f91ec0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.922+0000 7f9208e2f640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f91ec0a2c10 0x7f91ec0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009bd0 tx=0x7f91f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.922+0000 7f9203fff640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152] conn(0x7f91ec0ac840 0x7f91ec0aece0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:35.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.923+0000 7f9201ffb640 1 -- 172.21.15.22:0/2005893066 <== osd.0 v2:172.21.15.22:6802/4248555152 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f91fc0020b0 con 0x7f91ec0ac840 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.937+0000 7f920b093640 1 -- 172.21.15.22:0/2005893066 --> [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9204062cc0 con 0x7f91ec0ac840 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.937+0000 7f9201ffb640 1 -- 172.21.15.22:0/2005893066 <== osd.0 v2:172.21.15.22:6802/4248555152 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9204062cc0 con 0x7f91ec0ac840 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.937+0000 7f920b093640 1 -- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152] conn(0x7f91ec0ac840 msgr2=0x7f91ec0aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.937+0000 7f920b093640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152] conn(0x7f91ec0ac840 0x7f91ec0aece0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.937+0000 7f920b093640 1 -- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f91ec0a2c10 msgr2=0x7f91ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.937+0000 7f920b093640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f91ec0a2c10 0x7f91ec0a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f91f4009bd0 tx=0x7f91f4005f90 comp rx=0 tx=0).stop 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.937+0000 7f920b093640 1 -- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92041082a0 msgr2=0x7f9204101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.937+0000 7f920b093640 1 --2- 172.21.15.22:0/2005893066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f92041082a0 0x7f9204101410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f91fc033040 tx=0x7f91fc031e60 comp rx=0 tx=0).stop 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.937+0000 7f9209630640 1 -- 172.21.15.22:0/2005893066 reap_dead start 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.937+0000 7f920b093640 1 -- 172.21.15.22:0/2005893066 shutdown_connections 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.937+0000 7f920b093640 1 -- 172.21.15.22:0/2005893066 >> 172.21.15.22:0/2005893066 conn(0x7f92040fc7d0 msgr2=0x7f9204105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.938+0000 7f920b093640 1 -- 172.21.15.22:0/2005893066 shutdown_connections 2024-09-10T08:07:35.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:35.938+0000 7f920b093640 1 -- 172.21.15.22:0/2005893066 wait complete. 2024-09-10T08:07:36.610 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:36 smithi022 ceph-mon[30854]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T08:07:36.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:36 smithi100 ceph-mon[35102]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T08:07:36.941 INFO:teuthology.orchestra.run.smithi022.stdout:270582939679 2024-09-10T08:07:36.942 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T08:07:36.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:36 smithi153 ceph-mon[35609]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-10T08:07:37.083 INFO:teuthology.orchestra.run.smithi022.stdout:292057776154 2024-09-10T08:07:37.083 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T08:07:38.089 INFO:teuthology.orchestra.run.smithi022.stdout:107374182462 2024-09-10T08:07:38.089 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T08:07:38.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.459+0000 7f98146fc640 1 -- 172.21.15.22:0/809368251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c100e20 msgr2=0x7f980c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:38.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.459+0000 7f98146fc640 1 --2- 172.21.15.22:0/809368251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c100e20 0x7f980c101200 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9808009900 tx=0x7f980802a480 comp rx=0 tx=0).stop 2024-09-10T08:07:38.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.459+0000 7f98146fc640 1 -- 172.21.15.22:0/809368251 shutdown_connections 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.459+0000 7f98146fc640 1 --2- 172.21.15.22:0/809368251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f980c102ef0 0x7f980c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.459+0000 7f98146fc640 1 --2- 172.21.15.22:0/809368251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f980c102570 0x7f980c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.459+0000 7f98146fc640 1 --2- 172.21.15.22:0/809368251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c100e20 0x7f980c101200 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.459+0000 7f98146fc640 1 -- 172.21.15.22:0/809368251 >> 172.21.15.22:0/809368251 conn(0x7f980c0fc7d0 msgr2=0x7f980c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.459+0000 7f98146fc640 1 -- 172.21.15.22:0/809368251 shutdown_connections 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.459+0000 7f98146fc640 1 -- 172.21.15.22:0/809368251 wait complete. 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.460+0000 7f98146fc640 1 Processor -- start 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.460+0000 7f98146fc640 1 -- start start 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.460+0000 7f98146fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f980c100e20 0x7f980c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.460+0000 7f98146fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f980c102570 0x7f980c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.460+0000 7f98146fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c102ef0 0x7f980c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.460+0000 7f98146fc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f980c110f80 con 0x7f980c102ef0 2024-09-10T08:07:38.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.460+0000 7f98146fc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f980c110e00 con 0x7f980c102570 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.460+0000 7f98146fc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f980c111100 con 0x7f980c100e20 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.460+0000 7f9812c99640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c102ef0 0x7f980c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.460+0000 7f9812c99640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c102ef0 0x7f980c19cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50124/0 (socket says 172.21.15.22:50124) 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.460+0000 7f9812c99640 1 -- 172.21.15.22:0/533470024 learned_addr learned my addr 172.21.15.22:0/533470024 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.460+0000 7f9812498640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f980c100e20 0x7f980c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.461+0000 7f9811c97640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f980c102570 0x7f980c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.461+0000 7f9812c99640 1 -- 172.21.15.22:0/533470024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f980c100e20 msgr2=0x7f980c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.461+0000 7f9812c99640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f980c100e20 0x7f980c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.461+0000 7f9812c99640 1 -- 172.21.15.22:0/533470024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f980c102570 msgr2=0x7f980c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.461+0000 7f9812c99640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f980c102570 0x7f980c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.461+0000 7f9812c99640 1 -- 172.21.15.22:0/533470024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980c19d4a0 con 0x7f980c102ef0 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.461+0000 7f9812c99640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c102ef0 0x7f980c19cdc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f980400eaa0 tx=0x7f980400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:38.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.461+0000 7f98037fe640 1 -- 172.21.15.22:0/533470024 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980400cdb0 con 0x7f980c102ef0 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.461+0000 7f98146fc640 1 -- 172.21.15.22:0/533470024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980c19d790 con 0x7f980c102ef0 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.461+0000 7f98037fe640 1 -- 172.21.15.22:0/533470024 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9804005020 con 0x7f980c102ef0 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.461+0000 7f98037fe640 1 -- 172.21.15.22:0/533470024 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98040116d0 con 0x7f980c102ef0 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.461+0000 7f98146fc640 1 -- 172.21.15.22:0/533470024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f980c1a5070 con 0x7f980c102ef0 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.462+0000 7f98146fc640 1 -- 172.21.15.22:0/533470024 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f980c106bf0 con 0x7f980c102ef0 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.463+0000 7f98037fe640 1 -- 172.21.15.22:0/533470024 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f98040054d0 con 0x7f980c102ef0 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.464+0000 7f98037fe640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f97f80a2c10 0x7f97f80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.465+0000 7f9812498640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f97f80a2c10 0x7f97f80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.465+0000 7f98037fe640 1 -- 172.21.15.22:0/533470024 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f98040cf800 con 0x7f980c102ef0 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.465+0000 7f98037fe640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052] conn(0x7f97f80ac830 0x7f97f80aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.465+0000 7f98037fe640 1 -- 172.21.15.22:0/533470024 --> [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9804014ec0 con 0x7f97f80ac830 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.465+0000 7f98037fe640 1 -- 172.21.15.22:0/533470024 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f98040cfbb0 con 0x7f980c102ef0 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.465+0000 7f9812498640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f97f80a2c10 0x7f97f80a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9808009230 tx=0x7f98080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.465+0000 7f9811c97640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052] conn(0x7f97f80ac830 0x7f97f80aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:38.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.466+0000 7f9811c97640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052] conn(0x7f97f80ac830 0x7f97f80aecd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.467+0000 7f98037fe640 1 -- 172.21.15.22:0/533470024 <== osd.1 v2:172.21.15.100:6800/2078646052 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9804014ec0 con 0x7f97f80ac830 2024-09-10T08:07:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.480+0000 7f98146fc640 1 -- 172.21.15.22:0/533470024 --> [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f980c1021b0 con 0x7f97f80ac830 2024-09-10T08:07:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.481+0000 7f98037fe640 1 -- 172.21.15.22:0/533470024 <== osd.1 v2:172.21.15.100:6800/2078646052 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f980c1021b0 con 0x7f97f80ac830 2024-09-10T08:07:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.481+0000 7f98146fc640 1 -- 172.21.15.22:0/533470024 >> [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052] conn(0x7f97f80ac830 msgr2=0x7f97f80aecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.481+0000 7f98146fc640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052] conn(0x7f97f80ac830 0x7f97f80aecd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.481+0000 7f98146fc640 1 -- 172.21.15.22:0/533470024 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f97f80a2c10 msgr2=0x7f97f80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.481+0000 7f98146fc640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f97f80a2c10 0x7f97f80a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9808009230 tx=0x7f98080058d0 comp rx=0 tx=0).stop 2024-09-10T08:07:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.481+0000 7f98146fc640 1 -- 172.21.15.22:0/533470024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c102ef0 msgr2=0x7f980c19cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:38.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.481+0000 7f98146fc640 1 --2- 172.21.15.22:0/533470024 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f980c102ef0 0x7f980c19cdc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f980400eaa0 tx=0x7f980400ef60 comp rx=0 tx=0).stop 2024-09-10T08:07:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.481+0000 7f9812c99640 1 -- 172.21.15.22:0/533470024 reap_dead start 2024-09-10T08:07:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.481+0000 7f98146fc640 1 -- 172.21.15.22:0/533470024 shutdown_connections 2024-09-10T08:07:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.481+0000 7f98146fc640 1 -- 172.21.15.22:0/533470024 >> 172.21.15.22:0/533470024 conn(0x7f980c0fc7d0 msgr2=0x7f980c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.482+0000 7f98146fc640 1 -- 172.21.15.22:0/533470024 shutdown_connections 2024-09-10T08:07:38.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.482+0000 7f98146fc640 1 -- 172.21.15.22:0/533470024 wait complete. 2024-09-10T08:07:38.565 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:38 smithi022 ceph-mon[30854]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T08:07:38.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:38 smithi100 ceph-mon[35102]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T08:07:38.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:38 smithi153 ceph-mon[35609]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T08:07:39.277 INFO:teuthology.orchestra.run.smithi022.stdout:55834574920 2024-09-10T08:07:39.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T08:07:39.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.460+0000 7f1ca3193640 1 -- 172.21.15.22:0/822451154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c9c1036e0 msgr2=0x7f1c9c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:39.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.460+0000 7f1ca3193640 1 --2- 172.21.15.22:0/822451154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c9c1036e0 0x7f1c9c107b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009930 tx=0x7f1c8802a420 comp rx=0 tx=0).stop 2024-09-10T08:07:39.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.460+0000 7f1ca3193640 1 -- 172.21.15.22:0/822451154 shutdown_connections 2024-09-10T08:07:39.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.460+0000 7f1ca3193640 1 --2- 172.21.15.22:0/822451154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c9c1082a0 0x7f1c9c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:39.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.460+0000 7f1ca3193640 1 --2- 172.21.15.22:0/822451154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c9c1036e0 0x7f1c9c107b90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:39.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.460+0000 7f1ca3193640 1 --2- 172.21.15.22:0/822451154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c102d30 0x7f1c9c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:39.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.460+0000 7f1ca3193640 1 -- 172.21.15.22:0/822451154 >> 172.21.15.22:0/822451154 conn(0x7f1c9c0fc7d0 msgr2=0x7f1c9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:39.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.460+0000 7f1ca3193640 1 -- 172.21.15.22:0/822451154 shutdown_connections 2024-09-10T08:07:39.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.460+0000 7f1ca3193640 1 -- 172.21.15.22:0/822451154 wait complete. 2024-09-10T08:07:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.461+0000 7f1ca3193640 1 Processor -- start 2024-09-10T08:07:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.461+0000 7f1ca3193640 1 -- start start 2024-09-10T08:07:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.461+0000 7f1ca3193640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c102d30 0x7f1c9c198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.461+0000 7f1ca3193640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c9c1036e0 0x7f1c9c198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.461+0000 7f1ca3193640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c9c1082a0 0x7f1c9c19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.461+0000 7f1ca3193640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c1120a0 con 0x7f1c9c1036e0 2024-09-10T08:07:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.461+0000 7f1ca3193640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c111f20 con 0x7f1c9c102d30 2024-09-10T08:07:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.461+0000 7f1ca3193640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c112220 con 0x7f1c9c1082a0 2024-09-10T08:07:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.461+0000 7f1c9bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c9c1036e0 0x7f1c9c198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.461+0000 7f1c9bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c9c1036e0 0x7f1c9c198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50160/0 (socket says 172.21.15.22:50160) 2024-09-10T08:07:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.461+0000 7f1c9bfff640 1 -- 172.21.15.22:0/56751832 learned_addr learned my addr 172.21.15.22:0/56751832 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:39.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1ca0f2f640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c102d30 0x7f1c9c198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:39.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1ca1730640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c9c1082a0 0x7f1c9c19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:39.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1c9bfff640 1 -- 172.21.15.22:0/56751832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c9c1082a0 msgr2=0x7f1c9c19ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:39.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1c9bfff640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c9c1082a0 0x7f1c9c19ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:39.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1c9bfff640 1 -- 172.21.15.22:0/56751832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c102d30 msgr2=0x7f1c9c198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:39.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1c9bfff640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c102d30 0x7f1c9c198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:39.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1c9bfff640 1 -- 172.21.15.22:0/56751832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c19d5b0 con 0x7f1c9c1036e0 2024-09-10T08:07:39.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1ca0f2f640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c9c102d30 0x7f1c9c198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:07:39.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1c9bfff640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c9c1036e0 0x7f1c9c198b40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1c88005940 tx=0x7f1c880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1c99ffb640 1 -- 172.21.15.22:0/56751832 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8803f030 con 0x7f1c9c1036e0 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1ca3193640 1 -- 172.21.15.22:0/56751832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9c19d840 con 0x7f1c9c1036e0 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1c99ffb640 1 -- 172.21.15.22:0/56751832 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c88003ce0 con 0x7f1c9c1036e0 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.462+0000 7f1c99ffb640 1 -- 172.21.15.22:0/56751832 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c88035070 con 0x7f1c9c1036e0 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.463+0000 7f1ca3193640 1 -- 172.21.15.22:0/56751832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9c1a5180 con 0x7f1c9c1036e0 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.464+0000 7f1ca3193640 1 -- 172.21.15.22:0/56751832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c9c062980 con 0x7f1c9c1036e0 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.465+0000 7f1c99ffb640 1 -- 172.21.15.22:0/56751832 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f1c88042030 con 0x7f1c9c1036e0 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.466+0000 7f1c99ffb640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1c8c0a2c10 0x7f1c8c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.466+0000 7f1ca0f2f640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1c8c0a2c10 0x7f1c8c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.466+0000 7f1c99ffb640 1 -- 172.21.15.22:0/56751832 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f1c880efe10 con 0x7f1c9c1036e0 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.466+0000 7f1c99ffb640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513] conn(0x7f1c8c0ac840 0x7f1c8c0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.466+0000 7f1c99ffb640 1 -- 172.21.15.22:0/56751832 --> [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c88032a80 con 0x7f1c8c0ac840 2024-09-10T08:07:39.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.466+0000 7f1c99ffb640 1 -- 172.21.15.22:0/56751832 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f1c880f0240 con 0x7f1c9c1036e0 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.466+0000 7f1ca0f2f640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1c8c0a2c10 0x7f1c8c0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c900058c0 tx=0x7f1c90005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.466+0000 7f1ca1730640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513] conn(0x7f1c8c0ac840 0x7f1c8c0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.467+0000 7f1ca1730640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513] conn(0x7f1c8c0ac840 0x7f1c8c0aece0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.468+0000 7f1c99ffb640 1 -- 172.21.15.22:0/56751832 <== osd.4 v2:172.21.15.100:6808/3886932513 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c88032a80 con 0x7f1c8c0ac840 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.481+0000 7f1ca3193640 1 -- 172.21.15.22:0/56751832 --> [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c9c062d80 con 0x7f1c8c0ac840 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.482+0000 7f1c99ffb640 1 -- 172.21.15.22:0/56751832 <== osd.4 v2:172.21.15.100:6808/3886932513 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1c9c062d80 con 0x7f1c8c0ac840 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.482+0000 7f1ca3193640 1 -- 172.21.15.22:0/56751832 >> [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513] conn(0x7f1c8c0ac840 msgr2=0x7f1c8c0aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.482+0000 7f1ca3193640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513] conn(0x7f1c8c0ac840 0x7f1c8c0aece0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.482+0000 7f1ca3193640 1 -- 172.21.15.22:0/56751832 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1c8c0a2c10 msgr2=0x7f1c8c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.482+0000 7f1ca3193640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f1c8c0a2c10 0x7f1c8c0a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1c900058c0 tx=0x7f1c90005850 comp rx=0 tx=0).stop 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.482+0000 7f1ca3193640 1 -- 172.21.15.22:0/56751832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c9c1036e0 msgr2=0x7f1c9c198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.482+0000 7f1ca3193640 1 --2- 172.21.15.22:0/56751832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c9c1036e0 0x7f1c9c198b40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1c88005940 tx=0x7f1c880042f0 comp rx=0 tx=0).stop 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.482+0000 7f1ca1730640 1 -- 172.21.15.22:0/56751832 reap_dead start 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.483+0000 7f1ca3193640 1 -- 172.21.15.22:0/56751832 shutdown_connections 2024-09-10T08:07:39.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.483+0000 7f1ca3193640 1 -- 172.21.15.22:0/56751832 >> 172.21.15.22:0/56751832 conn(0x7f1c9c0fc7d0 msgr2=0x7f1c9c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:39.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.483+0000 7f1ca3193640 1 -- 172.21.15.22:0/56751832 shutdown_connections 2024-09-10T08:07:39.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:39.483+0000 7f1ca3193640 1 -- 172.21.15.22:0/56751832 wait complete. 2024-09-10T08:07:40.236 INFO:teuthology.orchestra.run.smithi022.stdout:158913790003 2024-09-10T08:07:40.237 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T08:07:40.712 INFO:teuthology.orchestra.run.smithi022.stdout:137438953529 2024-09-10T08:07:40.712 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T08:07:40.815 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:40 smithi022 ceph-mon[30854]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T08:07:40.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:40 smithi100 ceph-mon[35102]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T08:07:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.895+0000 7fac2cc1f640 1 -- 172.21.15.22:0/4026555580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac28101df0 msgr2=0x7fac281021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.895+0000 7fac2cc1f640 1 --2- 172.21.15.22:0/4026555580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac28101df0 0x7fac281021d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fac20009ca0 tx=0x7fac2002a8c0 comp rx=0 tx=0).stop 2024-09-10T08:07:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.895+0000 7fac2cc1f640 1 -- 172.21.15.22:0/4026555580 shutdown_connections 2024-09-10T08:07:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.895+0000 7fac2cc1f640 1 --2- 172.21.15.22:0/4026555580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28106f20 0x7fac2810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.895+0000 7fac2cc1f640 1 --2- 172.21.15.22:0/4026555580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac281027a0 0x7fac281067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.895+0000 7fac2cc1f640 1 --2- 172.21.15.22:0/4026555580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac28101df0 0x7fac281021d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:40.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.895+0000 7fac2cc1f640 1 -- 172.21.15.22:0/4026555580 >> 172.21.15.22:0/4026555580 conn(0x7fac280fd8f0 msgr2=0x7fac280ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.895+0000 7fac2cc1f640 1 -- 172.21.15.22:0/4026555580 shutdown_connections 2024-09-10T08:07:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.895+0000 7fac2cc1f640 1 -- 172.21.15.22:0/4026555580 wait complete. 2024-09-10T08:07:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.896+0000 7fac2cc1f640 1 Processor -- start 2024-09-10T08:07:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.896+0000 7fac2cc1f640 1 -- start start 2024-09-10T08:07:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.896+0000 7fac2cc1f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac28101df0 0x7fac28198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.896+0000 7fac2cc1f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac281027a0 0x7fac281989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.896+0000 7fac2cc1f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28106f20 0x7fac2819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.896+0000 7fac2cc1f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fac28111f80 con 0x7fac28101df0 2024-09-10T08:07:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.896+0000 7fac2cc1f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac28111e00 con 0x7fac28106f20 2024-09-10T08:07:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.896+0000 7fac2cc1f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac28112100 con 0x7fac281027a0 2024-09-10T08:07:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.896+0000 7fac2659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac28101df0 0x7fac28198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:40.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.896+0000 7fac2659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac28101df0 0x7fac28198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50168/0 (socket says 172.21.15.22:50168) 2024-09-10T08:07:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.896+0000 7fac2659c640 1 -- 172.21.15.22:0/2780658522 learned_addr learned my addr 172.21.15.22:0/2780658522 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.896+0000 7fac25d9b640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac281027a0 0x7fac281989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac26d9d640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28106f20 0x7fac2819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac2659c640 1 -- 172.21.15.22:0/2780658522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac281027a0 msgr2=0x7fac281989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac2659c640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac281027a0 0x7fac281989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac2659c640 1 -- 172.21.15.22:0/2780658522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28106f20 msgr2=0x7fac2819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac2659c640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28106f20 0x7fac2819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac2659c640 1 -- 172.21.15.22:0/2780658522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2819d430 con 0x7fac28101df0 2024-09-10T08:07:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac25d9b640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac281027a0 0x7fac281989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:07:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac26d9d640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28106f20 0x7fac2819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac2659c640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac28101df0 0x7fac28198480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fac200097b0 tx=0x7fac20031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:40.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac1f7fe640 1 -- 172.21.15.22:0/2780658522 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2002fba0 con 0x7fac28101df0 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac2cc1f640 1 -- 172.21.15.22:0/2780658522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2819d6c0 con 0x7fac28101df0 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac1f7fe640 1 -- 172.21.15.22:0/2780658522 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac2002fd40 con 0x7fac28101df0 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac1f7fe640 1 -- 172.21.15.22:0/2780658522 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2003b930 con 0x7fac28101df0 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.897+0000 7fac2cc1f640 1 -- 172.21.15.22:0/2780658522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac281a5000 con 0x7fac28101df0 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.898+0000 7fac2cc1f640 1 -- 172.21.15.22:0/2780658522 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac28062900 con 0x7fac28101df0 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.899+0000 7fac1f7fe640 1 -- 172.21.15.22:0/2780658522 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fac20030cc0 con 0x7fac28101df0 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.900+0000 7fac1f7fe640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fac140a2c10 0x7fac140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.900+0000 7fac1f7fe640 1 -- 172.21.15.22:0/2780658522 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fac200f0a00 con 0x7fac28101df0 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.900+0000 7fac25d9b640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fac140a2c10 0x7fac140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.901+0000 7fac1f7fe640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487] conn(0x7fac140ac840 0x7fac140aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.901+0000 7fac1f7fe640 1 -- 172.21.15.22:0/2780658522 --> [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac140af3b0 con 0x7fac140ac840 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.901+0000 7fac1f7fe640 1 -- 172.21.15.22:0/2780658522 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fac200f0e30 con 0x7fac28101df0 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.901+0000 7fac26d9d640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487] conn(0x7fac140ac840 0x7fac140aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:40.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.901+0000 7fac25d9b640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fac140a2c10 0x7fac140a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fac10005fd0 tx=0x7fac10005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.901+0000 7fac26d9d640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487] conn(0x7fac140ac840 0x7fac140aece0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:40.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.902+0000 7fac1f7fe640 1 -- 172.21.15.22:0/2780658522 <== osd.6 v2:172.21.15.22:6818/3692536487 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac140af3b0 con 0x7fac140ac840 2024-09-10T08:07:40.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.917+0000 7fac2cc1f640 1 -- 172.21.15.22:0/2780658522 --> [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac28062d00 con 0x7fac140ac840 2024-09-10T08:07:40.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.917+0000 7fac1f7fe640 1 -- 172.21.15.22:0/2780658522 <== osd.6 v2:172.21.15.22:6818/3692536487 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fac28062d00 con 0x7fac140ac840 2024-09-10T08:07:40.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.917+0000 7fac2cc1f640 1 -- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487] conn(0x7fac140ac840 msgr2=0x7fac140aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:40.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.917+0000 7fac2cc1f640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487] conn(0x7fac140ac840 0x7fac140aece0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:40.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.917+0000 7fac2cc1f640 1 -- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fac140a2c10 msgr2=0x7fac140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:40.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.917+0000 7fac2cc1f640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fac140a2c10 0x7fac140a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fac10005fd0 tx=0x7fac10005ea0 comp rx=0 tx=0).stop 2024-09-10T08:07:40.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.917+0000 7fac2cc1f640 1 -- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac28101df0 msgr2=0x7fac28198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:40.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.918+0000 7fac2cc1f640 1 --2- 172.21.15.22:0/2780658522 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac28101df0 0x7fac28198480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fac200097b0 tx=0x7fac20031b10 comp rx=0 tx=0).stop 2024-09-10T08:07:40.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.918+0000 7fac26d9d640 1 -- 172.21.15.22:0/2780658522 reap_dead start 2024-09-10T08:07:40.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.918+0000 7fac2cc1f640 1 -- 172.21.15.22:0/2780658522 shutdown_connections 2024-09-10T08:07:40.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.918+0000 7fac2cc1f640 1 -- 172.21.15.22:0/2780658522 >> 172.21.15.22:0/2780658522 conn(0x7fac280fd8f0 msgr2=0x7fac280fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:40.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.918+0000 7fac2cc1f640 1 -- 172.21.15.22:0/2780658522 shutdown_connections 2024-09-10T08:07:40.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:40.918+0000 7fac2cc1f640 1 -- 172.21.15.22:0/2780658522 wait complete. 2024-09-10T08:07:40.945 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:40 smithi153 ceph-mon[35609]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T08:07:41.720 INFO:teuthology.orchestra.run.smithi022.stdout:188978561072 2024-09-10T08:07:41.720 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T08:07:41.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.544+0000 7f95b5430640 1 -- 172.21.15.22:0/2867867016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95b0106f10 msgr2=0x7f95b010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:41.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.544+0000 7f95b5430640 1 --2- 172.21.15.22:0/2867867016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95b0106f10 0x7f95b010ea90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009ca0 tx=0x7f95a802a8c0 comp rx=0 tx=0).stop 2024-09-10T08:07:41.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.545+0000 7f95b5430640 1 -- 172.21.15.22:0/2867867016 shutdown_connections 2024-09-10T08:07:41.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.545+0000 7f95b5430640 1 --2- 172.21.15.22:0/2867867016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95b0106f10 0x7f95b010ea90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:41.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.545+0000 7f95b5430640 1 --2- 172.21.15.22:0/2867867016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95b0102790 0x7f95b01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:41.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.545+0000 7f95b5430640 1 --2- 172.21.15.22:0/2867867016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b0101de0 0x7f95b01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.545+0000 7f95b5430640 1 -- 172.21.15.22:0/2867867016 >> 172.21.15.22:0/2867867016 conn(0x7f95b00fd8c0 msgr2=0x7f95b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.545+0000 7f95b5430640 1 -- 172.21.15.22:0/2867867016 shutdown_connections 2024-09-10T08:07:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.545+0000 7f95b5430640 1 -- 172.21.15.22:0/2867867016 wait complete. 2024-09-10T08:07:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.545+0000 7f95b5430640 1 Processor -- start 2024-09-10T08:07:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.545+0000 7f95b5430640 1 -- start start 2024-09-10T08:07:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95b5430640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b0101de0 0x7f95b01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95b5430640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95b0102790 0x7f95b0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95b5430640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95b0106f10 0x7f95b019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95b5430640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f95b0111f70 con 0x7f95b0106f10 2024-09-10T08:07:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95b5430640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f95b0111df0 con 0x7f95b0101de0 2024-09-10T08:07:41.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95b5430640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95b01120f0 con 0x7f95b0102790 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95b0106f10 0x7f95b019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95af7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95b0106f10 0x7f95b019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50146/0 (socket says 172.21.15.22:50146) 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95af7fe640 1 -- 172.21.15.22:0/270535419 learned_addr learned my addr 172.21.15.22:0/270535419 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95aeffd640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b0101de0 0x7f95b01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95ae7fc640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95b0102790 0x7f95b0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95af7fe640 1 -- 172.21.15.22:0/270535419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95b0102790 msgr2=0x7f95b0198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95af7fe640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95b0102790 0x7f95b0198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95af7fe640 1 -- 172.21.15.22:0/270535419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b0101de0 msgr2=0x7f95b01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95af7fe640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b0101de0 0x7f95b01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95af7fe640 1 -- 172.21.15.22:0/270535419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b019d3a0 con 0x7f95b0106f10 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95af7fe640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95b0106f10 0x7f95b019ccc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95a8031a60 tx=0x7f95a8031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f9597fff640 1 -- 172.21.15.22:0/270535419 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8003b70 con 0x7f95b0106f10 2024-09-10T08:07:41.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f9597fff640 1 -- 172.21.15.22:0/270535419 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95a8003d10 con 0x7f95b0106f10 2024-09-10T08:07:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.546+0000 7f95b5430640 1 -- 172.21.15.22:0/270535419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b019d630 con 0x7f95b0106f10 2024-09-10T08:07:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.547+0000 7f9597fff640 1 -- 172.21.15.22:0/270535419 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8004770 con 0x7f95b0106f10 2024-09-10T08:07:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.547+0000 7f95b5430640 1 -- 172.21.15.22:0/270535419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b01a4f70 con 0x7f95b0106f10 2024-09-10T08:07:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.548+0000 7f95b5430640 1 -- 172.21.15.22:0/270535419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95b0062900 con 0x7f95b0106f10 2024-09-10T08:07:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.549+0000 7f9597fff640 1 -- 172.21.15.22:0/270535419 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f95a802f790 con 0x7f95b0106f10 2024-09-10T08:07:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.549+0000 7f9597fff640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f95980a2c90 0x7f95980a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.550+0000 7f95aeffd640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f95980a2c90 0x7f95980a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.550+0000 7f9597fff640 1 -- 172.21.15.22:0/270535419 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f95a80f0590 con 0x7f95b0106f10 2024-09-10T08:07:41.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.550+0000 7f9597fff640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941] conn(0x7f95980ac790 0x7f95980aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.550+0000 7f9597fff640 1 -- 172.21.15.22:0/270535419 --> [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95980af300 con 0x7f95980ac790 2024-09-10T08:07:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.550+0000 7f9597fff640 1 -- 172.21.15.22:0/270535419 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f95a80f0940 con 0x7f95b0106f10 2024-09-10T08:07:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.550+0000 7f95aeffd640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f95980a2c90 0x7f95980a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f95a000abe0 tx=0x7f95a000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.550+0000 7f95ae7fc640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941] conn(0x7f95980ac790 0x7f95980aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.551+0000 7f95ae7fc640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941] conn(0x7f95980ac790 0x7f95980aec30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.551+0000 7f9597fff640 1 -- 172.21.15.22:0/270535419 <== osd.8 v2:172.21.15.153:6816/1153053941 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95980af300 con 0x7f95980ac790 2024-09-10T08:07:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.565+0000 7f95b5430640 1 -- 172.21.15.22:0/270535419 --> [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f95b0062d00 con 0x7f95980ac790 2024-09-10T08:07:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.566+0000 7f9597fff640 1 -- 172.21.15.22:0/270535419 <== osd.8 v2:172.21.15.153:6816/1153053941 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f95b0062d00 con 0x7f95980ac790 2024-09-10T08:07:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.567+0000 7f95b5430640 1 -- 172.21.15.22:0/270535419 >> [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941] conn(0x7f95980ac790 msgr2=0x7f95980aec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.567+0000 7f95b5430640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941] conn(0x7f95980ac790 0x7f95980aec30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.567+0000 7f95b5430640 1 -- 172.21.15.22:0/270535419 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f95980a2c90 msgr2=0x7f95980a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:41.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.567+0000 7f95b5430640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f95980a2c90 0x7f95980a5150 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f95a000abe0 tx=0x7f95a000a2d0 comp rx=0 tx=0).stop 2024-09-10T08:07:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.567+0000 7f95b5430640 1 -- 172.21.15.22:0/270535419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95b0106f10 msgr2=0x7f95b019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.567+0000 7f95b5430640 1 --2- 172.21.15.22:0/270535419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f95b0106f10 0x7f95b019ccc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f95a8031a60 tx=0x7f95a8031a90 comp rx=0 tx=0).stop 2024-09-10T08:07:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.567+0000 7f95af7fe640 1 -- 172.21.15.22:0/270535419 reap_dead start 2024-09-10T08:07:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.567+0000 7f95b5430640 1 -- 172.21.15.22:0/270535419 shutdown_connections 2024-09-10T08:07:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.567+0000 7f95b5430640 1 -- 172.21.15.22:0/270535419 >> 172.21.15.22:0/270535419 conn(0x7f95b00fd8c0 msgr2=0x7f95b00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.567+0000 7f95b5430640 1 -- 172.21.15.22:0/270535419 shutdown_connections 2024-09-10T08:07:41.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:38.567+0000 7f95b5430640 1 -- 172.21.15.22:0/270535419 wait complete. 2024-09-10T08:07:42.422 INFO:teuthology.orchestra.run.smithi022.stdout:240518168614 2024-09-10T08:07:42.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T08:07:42.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:42 smithi022 ceph-mon[30854]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-10T08:07:42.816 INFO:teuthology.orchestra.run.smithi022.stdout:210453397545 2024-09-10T08:07:42.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T08:07:42.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:42 smithi100 ceph-mon[35102]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-10T08:07:42.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:42 smithi153 ceph-mon[35609]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-10T08:07:43.290 INFO:teuthology.orchestra.run.smithi022.stdout:34359738446 2024-09-10T08:07:43.290 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T08:07:43.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.087+0000 7f06bd3c4640 1 -- 172.21.15.22:0/841602997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b8106f10 msgr2=0x7f06b810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:43.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.087+0000 7f06bd3c4640 1 --2- 172.21.15.22:0/841602997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b8106f10 0x7f06b810ea90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009ca0 tx=0x7f06b002a8c0 comp rx=0 tx=0).stop 2024-09-10T08:07:43.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.087+0000 7f06bd3c4640 1 -- 172.21.15.22:0/841602997 shutdown_connections 2024-09-10T08:07:43.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.087+0000 7f06bd3c4640 1 --2- 172.21.15.22:0/841602997 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b8106f10 0x7f06b810ea90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:43.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.087+0000 7f06bd3c4640 1 --2- 172.21.15.22:0/841602997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06b8102790 0x7f06b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:43.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.087+0000 7f06bd3c4640 1 --2- 172.21.15.22:0/841602997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b8101de0 0x7f06b81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:43.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.087+0000 7f06bd3c4640 1 -- 172.21.15.22:0/841602997 >> 172.21.15.22:0/841602997 conn(0x7f06b80fd8c0 msgr2=0x7f06b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.088+0000 7f06bd3c4640 1 -- 172.21.15.22:0/841602997 shutdown_connections 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.088+0000 7f06bd3c4640 1 -- 172.21.15.22:0/841602997 wait complete. 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.088+0000 7f06bd3c4640 1 Processor -- start 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.088+0000 7f06bd3c4640 1 -- start start 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06bd3c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06b8101de0 0x7f06b81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06bd3c4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b8102790 0x7f06b81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06bd3c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b8106f10 0x7f06b819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06bd3c4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f06b8111f70 con 0x7f06b8106f10 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06bd3c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f06b8111df0 con 0x7f06b8101de0 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06bd3c4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f06b81120f0 con 0x7f06b8102790 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06b77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b8106f10 0x7f06b819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06b77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b8106f10 0x7f06b819cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50198/0 (socket says 172.21.15.22:50198) 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06b77fe640 1 -- 172.21.15.22:0/279207398 learned_addr learned my addr 172.21.15.22:0/279207398 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:43.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06b6ffd640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06b8101de0 0x7f06b81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:43.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06affff640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b8102790 0x7f06b81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:43.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06b77fe640 1 -- 172.21.15.22:0/279207398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b8102790 msgr2=0x7f06b81988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:43.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06b77fe640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06b8102790 0x7f06b81988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:43.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06b77fe640 1 -- 172.21.15.22:0/279207398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06b8101de0 msgr2=0x7f06b81983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:43.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06b77fe640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06b8101de0 0x7f06b81983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:43.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06b77fe640 1 -- 172.21.15.22:0/279207398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b819d350 con 0x7f06b8106f10 2024-09-10T08:07:43.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06b6ffd640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06b8101de0 0x7f06b81983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:07:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.089+0000 7f06b77fe640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b8106f10 0x7f06b819cc70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06b0031a20 tx=0x7f06b0031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.090+0000 7f06b4ff9640 1 -- 172.21.15.22:0/279207398 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b0003b70 con 0x7f06b8106f10 2024-09-10T08:07:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.090+0000 7f06b4ff9640 1 -- 172.21.15.22:0/279207398 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06b0003d10 con 0x7f06b8106f10 2024-09-10T08:07:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.090+0000 7f06bd3c4640 1 -- 172.21.15.22:0/279207398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b819d5e0 con 0x7f06b8106f10 2024-09-10T08:07:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.090+0000 7f06b4ff9640 1 -- 172.21.15.22:0/279207398 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b002fc40 con 0x7f06b8106f10 2024-09-10T08:07:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.090+0000 7f06bd3c4640 1 -- 172.21.15.22:0/279207398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b81a4f20 con 0x7f06b8106f10 2024-09-10T08:07:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.091+0000 7f06bd3c4640 1 -- 172.21.15.22:0/279207398 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f06b8062980 con 0x7f06b8106f10 2024-09-10T08:07:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.092+0000 7f06b4ff9640 1 -- 172.21.15.22:0/279207398 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f06b0004050 con 0x7f06b8106f10 2024-09-10T08:07:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.093+0000 7f06b4ff9640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f06a40a2c10 0x7f06a40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.093+0000 7f06b6ffd640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f06a40a2c10 0x7f06a40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.093+0000 7f06b4ff9640 1 -- 172.21.15.22:0/279207398 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f06b00f01d0 con 0x7f06b8106f10 2024-09-10T08:07:43.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.093+0000 7f06b4ff9640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783] conn(0x7f06a40ac840 0x7f06a40aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.093+0000 7f06b4ff9640 1 -- 172.21.15.22:0/279207398 --> [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06b004ee50 con 0x7f06a40ac840 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.093+0000 7f06b4ff9640 1 -- 172.21.15.22:0/279207398 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f06b00f7050 con 0x7f06b8106f10 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.094+0000 7f06b6ffd640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f06a40a2c10 0x7f06a40a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009fc0 tx=0x7f06a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.094+0000 7f06affff640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783] conn(0x7f06a40ac840 0x7f06a40aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.094+0000 7f06affff640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783] conn(0x7f06a40ac840 0x7f06a40aece0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.095+0000 7f06b4ff9640 1 -- 172.21.15.22:0/279207398 <== osd.11 v2:172.21.15.153:6824/2245781783 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f06b004ee50 con 0x7f06a40ac840 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.109+0000 7f06bd3c4640 1 -- 172.21.15.22:0/279207398 --> [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f06b8062e00 con 0x7f06a40ac840 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.110+0000 7f06b4ff9640 1 -- 172.21.15.22:0/279207398 <== osd.11 v2:172.21.15.153:6824/2245781783 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f06b8062e00 con 0x7f06a40ac840 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.110+0000 7f06bd3c4640 1 -- 172.21.15.22:0/279207398 >> [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783] conn(0x7f06a40ac840 msgr2=0x7f06a40aece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.110+0000 7f06bd3c4640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783] conn(0x7f06a40ac840 0x7f06a40aece0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.111+0000 7f06bd3c4640 1 -- 172.21.15.22:0/279207398 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f06a40a2c10 msgr2=0x7f06a40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.111+0000 7f06bd3c4640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f06a40a2c10 0x7f06a40a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009fc0 tx=0x7f06a8005f90 comp rx=0 tx=0).stop 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.111+0000 7f06bd3c4640 1 -- 172.21.15.22:0/279207398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b8106f10 msgr2=0x7f06b819cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:43.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.111+0000 7f06bd3c4640 1 --2- 172.21.15.22:0/279207398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b8106f10 0x7f06b819cc70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06b0031a20 tx=0x7f06b0031a50 comp rx=0 tx=0).stop 2024-09-10T08:07:43.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.111+0000 7f06b77fe640 1 -- 172.21.15.22:0/279207398 reap_dead start 2024-09-10T08:07:43.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.111+0000 7f06bd3c4640 1 -- 172.21.15.22:0/279207398 shutdown_connections 2024-09-10T08:07:43.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.111+0000 7f06bd3c4640 1 -- 172.21.15.22:0/279207398 >> 172.21.15.22:0/279207398 conn(0x7f06b80fd8c0 msgr2=0x7f06b80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:43.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.111+0000 7f06bd3c4640 1 -- 172.21.15.22:0/279207398 shutdown_connections 2024-09-10T08:07:43.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:41.111+0000 7f06bd3c4640 1 -- 172.21.15.22:0/279207398 wait complete. 2024-09-10T08:07:44.046 INFO:teuthology.orchestra.run.smithi022.stdout:322122547223 2024-09-10T08:07:44.047 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T08:07:44.135 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:44.136 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:44.136 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:44.142 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:44.868 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:44 smithi022 ceph-mon[30854]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:07:44.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:44 smithi100 ceph-mon[35102]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:07:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.876+0000 7f8569a7e640 1 -- 172.21.15.22:0/3746951530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8564103660 msgr2=0x7f856410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.876+0000 7f8569a7e640 1 --2- 172.21.15.22:0/3746951530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8564103660 0x7f856410bb50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8558009900 tx=0x7f855802a480 comp rx=0 tx=0).stop 2024-09-10T08:07:44.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.876+0000 7f8569a7e640 1 -- 172.21.15.22:0/3746951530 shutdown_connections 2024-09-10T08:07:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.876+0000 7f8569a7e640 1 --2- 172.21.15.22:0/3746951530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f856410c170 0x7f856410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.876+0000 7f8569a7e640 1 --2- 172.21.15.22:0/3746951530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8564103660 0x7f856410bb50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.876+0000 7f8569a7e640 1 --2- 172.21.15.22:0/3746951530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8564102d40 0x7f8564103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.876+0000 7f8569a7e640 1 -- 172.21.15.22:0/3746951530 >> 172.21.15.22:0/3746951530 conn(0x7f85640fc7a0 msgr2=0x7f85640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.876+0000 7f8569a7e640 1 -- 172.21.15.22:0/3746951530 shutdown_connections 2024-09-10T08:07:44.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.876+0000 7f8569a7e640 1 -- 172.21.15.22:0/3746951530 wait complete. 2024-09-10T08:07:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.877+0000 7f8569a7e640 1 Processor -- start 2024-09-10T08:07:44.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.877+0000 7f8569a7e640 1 -- start start 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.877+0000 7f8569a7e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8564102d40 0x7f8564198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.877+0000 7f8569a7e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8564103660 0x7f8564198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.877+0000 7f8569a7e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f856410c170 0x7f856419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.877+0000 7f8569a7e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8564111f70 con 0x7f856410c170 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.877+0000 7f8569a7e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8564111df0 con 0x7f8564103660 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.877+0000 7f8569a7e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f85641120f0 con 0x7f8564102d40 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.877+0000 7f8563fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f856410c170 0x7f856419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.877+0000 7f8563fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f856410c170 0x7f856419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53070/0 (socket says 172.21.15.22:53070) 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.877+0000 7f8563fff640 1 -- 172.21.15.22:0/1114049000 learned_addr learned my addr 172.21.15.22:0/1114049000 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.877+0000 7f85637fe640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8564102d40 0x7f8564198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8562ffd640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8564103660 0x7f8564198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8563fff640 1 -- 172.21.15.22:0/1114049000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8564102d40 msgr2=0x7f8564198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:44.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8563fff640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8564102d40 0x7f8564198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8563fff640 1 -- 172.21.15.22:0/1114049000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8564103660 msgr2=0x7f8564198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8563fff640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8564103660 0x7f8564198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8563fff640 1 -- 172.21.15.22:0/1114049000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856419d3e0 con 0x7f856410c170 2024-09-10T08:07:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8562ffd640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8564103660 0x7f8564198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8563fff640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f856410c170 0x7f856419cd00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f855c00eaa0 tx=0x7f855c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8560ff9640 1 -- 172.21.15.22:0/1114049000 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c00cdb0 con 0x7f856410c170 2024-09-10T08:07:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8560ff9640 1 -- 172.21.15.22:0/1114049000 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c005020 con 0x7f856410c170 2024-09-10T08:07:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8569a7e640 1 -- 172.21.15.22:0/1114049000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856419d6d0 con 0x7f856410c170 2024-09-10T08:07:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8560ff9640 1 -- 172.21.15.22:0/1114049000 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0116b0 con 0x7f856410c170 2024-09-10T08:07:44.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.878+0000 7f8569a7e640 1 -- 172.21.15.22:0/1114049000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85641a4fb0 con 0x7f856410c170 2024-09-10T08:07:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.879+0000 7f8569a7e640 1 -- 172.21.15.22:0/1114049000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8564103120 con 0x7f856410c170 2024-09-10T08:07:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.880+0000 7f8560ff9640 1 -- 172.21.15.22:0/1114049000 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f855c005560 con 0x7f856410c170 2024-09-10T08:07:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.881+0000 7f8560ff9640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f854c0a2c10 0x7f854c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.881+0000 7f85637fe640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f854c0a2c10 0x7f854c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:44.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.881+0000 7f8560ff9640 1 -- 172.21.15.22:0/1114049000 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f855c0cf390 con 0x7f856410c170 2024-09-10T08:07:44.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.882+0000 7f85637fe640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f854c0a2c10 0x7f854c0a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f85540058c0 tx=0x7f855400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:44.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:44.885+0000 7f8560ff9640 1 -- 172.21.15.22:0/1114049000 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f855c016030 con 0x7f856410c170 2024-09-10T08:07:44.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:44 smithi153 ceph-mon[35609]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:07:45.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.067+0000 7f8569a7e640 1 -- 172.21.15.22:0/1114049000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f856402d7c0 con 0x7f856410c170 2024-09-10T08:07:45.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.071+0000 7f8560ff9640 1 -- 172.21.15.22:0/1114049000 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f855c09c190 con 0x7f856410c170 2024-09-10T08:07:45.070 INFO:teuthology.orchestra.run.smithi022.stdout:107374182463 2024-09-10T08:07:45.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.073+0000 7f8569a7e640 1 -- 172.21.15.22:0/1114049000 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f854c0a2c10 msgr2=0x7f854c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:45.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.073+0000 7f8569a7e640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f854c0a2c10 0x7f854c0a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f85540058c0 tx=0x7f855400a2d0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.073+0000 7f8569a7e640 1 -- 172.21.15.22:0/1114049000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f856410c170 msgr2=0x7f856419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:45.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.073+0000 7f8569a7e640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f856410c170 0x7f856419cd00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f855c00eaa0 tx=0x7f855c00ef60 comp rx=0 tx=0).stop 2024-09-10T08:07:45.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.073+0000 7f8569a7e640 1 -- 172.21.15.22:0/1114049000 shutdown_connections 2024-09-10T08:07:45.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.073+0000 7f8569a7e640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f854c0a2c10 0x7f854c0a50d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.073+0000 7f8569a7e640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f856410c170 0x7f856419cd00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.073+0000 7f8569a7e640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8564103660 0x7f8564198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.073+0000 7f8569a7e640 1 --2- 172.21.15.22:0/1114049000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8564102d40 0x7f8564198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.073+0000 7f8569a7e640 1 -- 172.21.15.22:0/1114049000 >> 172.21.15.22:0/1114049000 conn(0x7f85640fc7a0 msgr2=0x7f85640fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:45.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.073+0000 7f8569a7e640 1 -- 172.21.15.22:0/1114049000 shutdown_connections 2024-09-10T08:07:45.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.073+0000 7f8569a7e640 1 -- 172.21.15.22:0/1114049000 wait complete. 2024-09-10T08:07:45.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.641+0000 7f5abf8f1640 1 -- 172.21.15.22:0/2135995704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab8100a80 msgr2=0x7f5ab8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:45.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.641+0000 7f5abf8f1640 1 --2- 172.21.15.22:0/2135995704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab8100a80 0x7f5ab8100ee0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009930 tx=0x7f5aa802a420 comp rx=0 tx=0).stop 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.641+0000 7f5abf8f1640 1 -- 172.21.15.22:0/2135995704 shutdown_connections 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.641+0000 7f5abf8f1640 1 --2- 172.21.15.22:0/2135995704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ab8101420 0x7f5ab810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.641+0000 7f5abf8f1640 1 --2- 172.21.15.22:0/2135995704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab8100a80 0x7f5ab8100ee0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.641+0000 7f5abf8f1640 1 --2- 172.21.15.22:0/2135995704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab8106a80 0x7f5ab8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.641+0000 7f5abf8f1640 1 -- 172.21.15.22:0/2135995704 >> 172.21.15.22:0/2135995704 conn(0x7f5ab80fc7a0 msgr2=0x7f5ab80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.641+0000 7f5abf8f1640 1 -- 172.21.15.22:0/2135995704 shutdown_connections 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.641+0000 7f5abf8f1640 1 -- 172.21.15.22:0/2135995704 wait complete. 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.642+0000 7f5abf8f1640 1 Processor -- start 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.642+0000 7f5abf8f1640 1 -- start start 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.642+0000 7f5abf8f1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab8100a80 0x7f5ab80fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.642+0000 7f5abf8f1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab8101420 0x7f5ab80fd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.642+0000 7f5abf8f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ab8106a80 0x7f5ab80fd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:45.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.642+0000 7f5abf8f1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab8110e80 con 0x7f5ab8100a80 2024-09-10T08:07:45.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.642+0000 7f5abf8f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab8110d00 con 0x7f5ab8106a80 2024-09-10T08:07:45.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.642+0000 7f5abf8f1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab8111000 con 0x7f5ab8101420 2024-09-10T08:07:45.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.642+0000 7f5abd68d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab8100a80 0x7f5ab80fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:45.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.642+0000 7f5abd68d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab8100a80 0x7f5ab80fcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53114/0 (socket says 172.21.15.22:53114) 2024-09-10T08:07:45.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.642+0000 7f5abd68d640 1 -- 172.21.15.22:0/1801501640 learned_addr learned my addr 172.21.15.22:0/1801501640 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:45.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5abce8c640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab8101420 0x7f5ab80fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:45.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5abd68d640 1 -- 172.21.15.22:0/1801501640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab8101420 msgr2=0x7f5ab80fd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:45.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5abd68d640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab8101420 0x7f5ab80fd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5abde8e640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ab8106a80 0x7f5ab80fd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:45.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5abd68d640 1 -- 172.21.15.22:0/1801501640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ab8106a80 msgr2=0x7f5ab80fd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:45.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5abd68d640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ab8106a80 0x7f5ab80fd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5abd68d640 1 -- 172.21.15.22:0/1801501640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab81a6980 con 0x7f5ab8100a80 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5abd68d640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab8100a80 0x7f5ab80fcda0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400d770 tx=0x7f5ab400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5aae7fc640 1 -- 172.21.15.22:0/1801501640 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4017070 con 0x7f5ab8100a80 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5aae7fc640 1 -- 172.21.15.22:0/1801501640 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ab4005500 con 0x7f5ab8100a80 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5aae7fc640 1 -- 172.21.15.22:0/1801501640 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4004e00 con 0x7f5ab8100a80 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5abf8f1640 1 -- 172.21.15.22:0/1801501640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab81a6c70 con 0x7f5ab8100a80 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.643+0000 7f5abf8f1640 1 -- 172.21.15.22:0/1801501640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab81a7130 con 0x7f5ab8100a80 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.644+0000 7f5abf8f1640 1 -- 172.21.15.22:0/1801501640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab8100ee0 con 0x7f5ab8100a80 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.646+0000 7f5aae7fc640 1 -- 172.21.15.22:0/1801501640 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5ab4004fa0 con 0x7f5ab8100a80 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.647+0000 7f5aae7fc640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f5aa40a2c10 0x7f5aa40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.647+0000 7f5abce8c640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f5aa40a2c10 0x7f5aa40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.647+0000 7f5aae7fc640 1 -- 172.21.15.22:0/1801501640 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5ab40cf0c0 con 0x7f5ab8100a80 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.647+0000 7f5abce8c640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f5aa40a2c10 0x7f5aa40a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8000c00 tx=0x7f5aa8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:45.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.650+0000 7f5aae7fc640 1 -- 172.21.15.22:0/1801501640 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ab409be80 con 0x7f5ab8100a80 2024-09-10T08:07:45.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:45 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1114049000' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T08:07:45.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:45 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3745734438' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T08:07:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.826+0000 7f5abf8f1640 1 -- 172.21.15.22:0/1801501640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5ab810a030 con 0x7f5ab8100a80 2024-09-10T08:07:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.827+0000 7f5aae7fc640 1 -- 172.21.15.22:0/1801501640 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ab409b780 con 0x7f5ab8100a80 2024-09-10T08:07:45.826 INFO:teuthology.orchestra.run.smithi022.stdout:77309411398 2024-09-10T08:07:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.829+0000 7f5abf8f1640 1 -- 172.21.15.22:0/1801501640 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f5aa40a2c10 msgr2=0x7f5aa40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.829+0000 7f5abf8f1640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f5aa40a2c10 0x7f5aa40a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8000c00 tx=0x7f5aa8005a20 comp rx=0 tx=0).stop 2024-09-10T08:07:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.829+0000 7f5abf8f1640 1 -- 172.21.15.22:0/1801501640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab8100a80 msgr2=0x7f5ab80fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.829+0000 7f5abf8f1640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab8100a80 0x7f5ab80fcda0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400d770 tx=0x7f5ab400dc30 comp rx=0 tx=0).stop 2024-09-10T08:07:45.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.829+0000 7f5abf8f1640 1 -- 172.21.15.22:0/1801501640 shutdown_connections 2024-09-10T08:07:45.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.829+0000 7f5abf8f1640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f5aa40a2c10 0x7f5aa40a50d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.829+0000 7f5abf8f1640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ab8106a80 0x7f5ab80fd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.829+0000 7f5abf8f1640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ab8101420 0x7f5ab80fd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.829+0000 7f5abf8f1640 1 --2- 172.21.15.22:0/1801501640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ab8100a80 0x7f5ab80fcda0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:45.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.829+0000 7f5abf8f1640 1 -- 172.21.15.22:0/1801501640 >> 172.21.15.22:0/1801501640 conn(0x7f5ab80fc7a0 msgr2=0x7f5ab806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:45.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.829+0000 7f5abf8f1640 1 -- 172.21.15.22:0/1801501640 shutdown_connections 2024-09-10T08:07:45.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.829+0000 7f5abf8f1640 1 -- 172.21.15.22:0/1801501640 wait complete. 2024-09-10T08:07:45.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:45 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1114049000' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T08:07:45.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:45 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3745734438' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T08:07:45.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:45 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1114049000' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-10T08:07:45.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:45 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3745734438' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-10T08:07:45.982 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182462 got 107374182463 for osd.3 2024-09-10T08:07:45.982 DEBUG:teuthology.parallel:result is None 2024-09-10T08:07:46.616 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:46 smithi022 ceph-mon[30854]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:07:46.617 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:46 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1801501640' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T08:07:46.618 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411398 for osd.2 2024-09-10T08:07:46.618 DEBUG:teuthology.parallel:result is None 2024-09-10T08:07:46.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.060+0000 7f806b6ae640 1 -- 172.21.15.22:0/257064885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8064102570 msgr2=0x7f80641029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:46.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.060+0000 7f806b6ae640 1 --2- 172.21.15.22:0/257064885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8064102570 0x7f80641029b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8054009900 tx=0x7f805402a480 comp rx=0 tx=0).stop 2024-09-10T08:07:46.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.060+0000 7f806b6ae640 1 -- 172.21.15.22:0/257064885 shutdown_connections 2024-09-10T08:07:46.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.060+0000 7f806b6ae640 1 --2- 172.21.15.22:0/257064885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8064102ef0 0x7f806410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:46.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.060+0000 7f806b6ae640 1 --2- 172.21.15.22:0/257064885 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8064102570 0x7f80641029b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:46.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.060+0000 7f806b6ae640 1 --2- 172.21.15.22:0/257064885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8064100e20 0x7f8064101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:46.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.060+0000 7f806b6ae640 1 -- 172.21.15.22:0/257064885 >> 172.21.15.22:0/257064885 conn(0x7f80640fc7d0 msgr2=0x7f80640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:46.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.060+0000 7f806b6ae640 1 -- 172.21.15.22:0/257064885 shutdown_connections 2024-09-10T08:07:46.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.060+0000 7f806b6ae640 1 -- 172.21.15.22:0/257064885 wait complete. 2024-09-10T08:07:46.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.061+0000 7f806b6ae640 1 Processor -- start 2024-09-10T08:07:46.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.061+0000 7f806b6ae640 1 -- start start 2024-09-10T08:07:46.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.061+0000 7f806b6ae640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8064100e20 0x7f8064199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:46.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.061+0000 7f806b6ae640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8064102570 0x7f80641998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:46.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.061+0000 7f806b6ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8064102ef0 0x7f80641a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:46.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.061+0000 7f806b6ae640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8064110f80 con 0x7f8064102570 2024-09-10T08:07:46.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.061+0000 7f806b6ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8064110e00 con 0x7f8064102ef0 2024-09-10T08:07:46.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.061+0000 7f806b6ae640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8064111100 con 0x7f8064100e20 2024-09-10T08:07:46.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.061+0000 7f8068c49640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8064102570 0x7f80641998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:46.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.061+0000 7f8068c49640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8064102570 0x7f80641998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53102/0 (socket says 172.21.15.22:53102) 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.061+0000 7f8068c49640 1 -- 172.21.15.22:0/3745734438 learned_addr learned my addr 172.21.15.22:0/3745734438 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f806944a640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8064100e20 0x7f8064199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f8069c4b640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8064102ef0 0x7f80641a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f8068c49640 1 -- 172.21.15.22:0/3745734438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8064100e20 msgr2=0x7f8064199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f8068c49640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8064100e20 0x7f8064199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f8068c49640 1 -- 172.21.15.22:0/3745734438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8064102ef0 msgr2=0x7f80641a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f8068c49640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8064102ef0 0x7f80641a4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f8068c49640 1 -- 172.21.15.22:0/3745734438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80641a4940 con 0x7f8064102570 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f8068c49640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8064102570 0x7f80641998c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8054006010 tx=0x7f8054003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f805a7fc640 1 -- 172.21.15.22:0/3745734438 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805403f070 con 0x7f8064102570 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f806b6ae640 1 -- 172.21.15.22:0/3745734438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80641a4b10 con 0x7f8064102570 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f805a7fc640 1 -- 172.21.15.22:0/3745734438 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8054031c30 con 0x7f8064102570 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f805a7fc640 1 -- 172.21.15.22:0/3745734438 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8054035030 con 0x7f8064102570 2024-09-10T08:07:46.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.062+0000 7f806b6ae640 1 -- 172.21.15.22:0/3745734438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80641a4f60 con 0x7f8064102570 2024-09-10T08:07:46.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.063+0000 7f806b6ae640 1 -- 172.21.15.22:0/3745734438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8064101200 con 0x7f8064102570 2024-09-10T08:07:46.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.065+0000 7f805a7fc640 1 -- 172.21.15.22:0/3745734438 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8054042070 con 0x7f8064102570 2024-09-10T08:07:46.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.066+0000 7f805a7fc640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f80500a2c10 0x7f80500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:46.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.066+0000 7f805a7fc640 1 -- 172.21.15.22:0/3745734438 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f80540ef7c0 con 0x7f8064102570 2024-09-10T08:07:46.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.066+0000 7f806944a640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f80500a2c10 0x7f80500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:46.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.067+0000 7f806944a640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f80500a2c10 0x7f80500a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8060005fd0 tx=0x7f8060005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:46.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.071+0000 7f805a7fc640 1 -- 172.21.15.22:0/3745734438 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8054031de0 con 0x7f8064102570 2024-09-10T08:07:46.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.256+0000 7f806b6ae640 1 -- 172.21.15.22:0/3745734438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8064109090 con 0x7f8064102570 2024-09-10T08:07:46.720 INFO:teuthology.orchestra.run.smithi022.stdout:210453397547 2024-09-10T08:07:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.256+0000 7f805a7fc640 1 -- 172.21.15.22:0/3745734438 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f80540bc5c0 con 0x7f8064102570 2024-09-10T08:07:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.258+0000 7f806b6ae640 1 -- 172.21.15.22:0/3745734438 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f80500a2c10 msgr2=0x7f80500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.258+0000 7f806b6ae640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f80500a2c10 0x7f80500a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8060005fd0 tx=0x7f8060005850 comp rx=0 tx=0).stop 2024-09-10T08:07:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.258+0000 7f806b6ae640 1 -- 172.21.15.22:0/3745734438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8064102570 msgr2=0x7f80641998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.258+0000 7f806b6ae640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8064102570 0x7f80641998c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8054006010 tx=0x7f8054003c10 comp rx=0 tx=0).stop 2024-09-10T08:07:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.258+0000 7f806b6ae640 1 -- 172.21.15.22:0/3745734438 shutdown_connections 2024-09-10T08:07:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.258+0000 7f806b6ae640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f80500a2c10 0x7f80500a50d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.258+0000 7f806b6ae640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8064102ef0 0x7f80641a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.258+0000 7f806b6ae640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8064102570 0x7f80641998c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:46.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.258+0000 7f806b6ae640 1 --2- 172.21.15.22:0/3745734438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8064100e20 0x7f8064199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:46.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.258+0000 7f806b6ae640 1 -- 172.21.15.22:0/3745734438 >> 172.21.15.22:0/3745734438 conn(0x7f80640fc7d0 msgr2=0x7f80640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:46.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.258+0000 7f806b6ae640 1 -- 172.21.15.22:0/3745734438 shutdown_connections 2024-09-10T08:07:46.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:45.258+0000 7f806b6ae640 1 -- 172.21.15.22:0/3745734438 wait complete. 2024-09-10T08:07:46.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:46 smithi100 ceph-mon[35102]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:07:46.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:46 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1801501640' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T08:07:46.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:46 smithi153 ceph-mon[35609]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:07:46.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:46 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1801501640' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-10T08:07:47.605 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397545 got 210453397547 for osd.7 2024-09-10T08:07:47.605 DEBUG:teuthology.parallel:result is None 2024-09-10T08:07:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.139+0000 7f60901b5640 1 -- 172.21.15.22:0/4023992867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60881082a0 msgr2=0x7f608810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.139+0000 7f60901b5640 1 --2- 172.21.15.22:0/4023992867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60881082a0 0x7f608810ec40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6080009cd0 tx=0x7f608002a8e0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.139+0000 7f60901b5640 1 -- 172.21.15.22:0/4023992867 shutdown_connections 2024-09-10T08:07:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.139+0000 7f60901b5640 1 --2- 172.21.15.22:0/4023992867 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60881082a0 0x7f608810ec40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.139+0000 7f60901b5640 1 --2- 172.21.15.22:0/4023992867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f60881036e0 0x7f6088107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.139+0000 7f60901b5640 1 --2- 172.21.15.22:0/4023992867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6088102d30 0x7f6088103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.139+0000 7f60901b5640 1 -- 172.21.15.22:0/4023992867 >> 172.21.15.22:0/4023992867 conn(0x7f60880fc7d0 msgr2=0x7f60880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.139+0000 7f60901b5640 1 -- 172.21.15.22:0/4023992867 shutdown_connections 2024-09-10T08:07:48.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.139+0000 7f60901b5640 1 -- 172.21.15.22:0/4023992867 wait complete. 2024-09-10T08:07:48.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.140+0000 7f60901b5640 1 Processor -- start 2024-09-10T08:07:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.141+0000 7f60901b5640 1 -- start start 2024-09-10T08:07:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.141+0000 7f60901b5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6088102d30 0x7f6088100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.141+0000 7f60901b5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60881036e0 0x7f6088100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.141+0000 7f608df51640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6088102d30 0x7f6088100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:48.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.141+0000 7f608d750640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60881036e0 0x7f6088100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.141+0000 7f60901b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60881082a0 0x7f6088101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.142+0000 7f60901b5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f60881120a0 con 0x7f60881036e0 2024-09-10T08:07:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.142+0000 7f608d750640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60881036e0 0x7f6088100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53146/0 (socket says 172.21.15.22:53146) 2024-09-10T08:07:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.142+0000 7f608d750640 1 -- 172.21.15.22:0/432881119 learned_addr learned my addr 172.21.15.22:0/432881119 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.142+0000 7f60901b5640 1 -- 172.21.15.22:0/432881119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6088111f20 con 0x7f60881082a0 2024-09-10T08:07:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.142+0000 7f60901b5640 1 -- 172.21.15.22:0/432881119 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6088112220 con 0x7f6088102d30 2024-09-10T08:07:48.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.142+0000 7f608e752640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60881082a0 0x7f6088101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.142+0000 7f608e752640 1 -- 172.21.15.22:0/432881119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6088102d30 msgr2=0x7f6088100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.142+0000 7f608e752640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6088102d30 0x7f6088100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.142+0000 7f608e752640 1 -- 172.21.15.22:0/432881119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60881036e0 msgr2=0x7f6088100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.142+0000 7f608e752640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60881036e0 0x7f6088100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.142+0000 7f608e752640 1 -- 172.21.15.22:0/432881119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60881aaef0 con 0x7f60881082a0 2024-09-10T08:07:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.142+0000 7f608d750640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60881036e0 0x7f6088100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:07:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.143+0000 7f608e752640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60881082a0 0x7f6088101410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6080009bf0 tx=0x7f6080003970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:48.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.143+0000 7f607effd640 1 -- 172.21.15.22:0/432881119 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080004040 con 0x7f60881082a0 2024-09-10T08:07:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.143+0000 7f607effd640 1 -- 172.21.15.22:0/432881119 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f60800046c0 con 0x7f60881082a0 2024-09-10T08:07:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.143+0000 7f60901b5640 1 -- 172.21.15.22:0/432881119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60881ab120 con 0x7f60881082a0 2024-09-10T08:07:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.143+0000 7f607effd640 1 -- 172.21.15.22:0/432881119 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080046480 con 0x7f60881082a0 2024-09-10T08:07:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.143+0000 7f60901b5640 1 -- 172.21.15.22:0/432881119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60881ab5a0 con 0x7f60881082a0 2024-09-10T08:07:48.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.145+0000 7f60901b5640 1 -- 172.21.15.22:0/432881119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f608806a850 con 0x7f60881082a0 2024-09-10T08:07:48.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.146+0000 7f607effd640 1 -- 172.21.15.22:0/432881119 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f60800041e0 con 0x7f60881082a0 2024-09-10T08:07:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.146+0000 7f607effd640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f60740a2c60 0x7f60740a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.147+0000 7f608df51640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f60740a2c60 0x7f60740a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:48.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.147+0000 7f607effd640 1 -- 172.21.15.22:0/432881119 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f608002e030 con 0x7f60881082a0 2024-09-10T08:07:48.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.147+0000 7f608df51640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f60740a2c60 0x7f60740a5120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6084009b60 tx=0x7f6084005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:48.147 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:48.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.151+0000 7f607effd640 1 -- 172.21.15.22:0/432881119 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f608004b060 con 0x7f60881082a0 2024-09-10T08:07:48.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.039+0000 7f9a91aa4640 1 -- 172.21.15.22:0/212573878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c102790 msgr2=0x7f9a8c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.039+0000 7f9a91aa4640 1 --2- 172.21.15.22:0/212573878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c102790 0x7f9a8c1067e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009900 tx=0x7f9a8002a410 comp rx=0 tx=0).stop 2024-09-10T08:07:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.039+0000 7f9a91aa4640 1 -- 172.21.15.22:0/212573878 shutdown_connections 2024-09-10T08:07:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.039+0000 7f9a91aa4640 1 --2- 172.21.15.22:0/212573878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a8c106f10 0x7f9a8c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.039+0000 7f9a91aa4640 1 --2- 172.21.15.22:0/212573878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c102790 0x7f9a8c1067e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.039+0000 7f9a91aa4640 1 --2- 172.21.15.22:0/212573878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c101de0 0x7f9a8c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.039+0000 7f9a91aa4640 1 -- 172.21.15.22:0/212573878 >> 172.21.15.22:0/212573878 conn(0x7f9a8c0fd8c0 msgr2=0x7f9a8c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:48.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.039+0000 7f9a91aa4640 1 -- 172.21.15.22:0/212573878 shutdown_connections 2024-09-10T08:07:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.039+0000 7f9a91aa4640 1 -- 172.21.15.22:0/212573878 wait complete. 2024-09-10T08:07:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.040+0000 7f9a91aa4640 1 Processor -- start 2024-09-10T08:07:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.040+0000 7f9a91aa4640 1 -- start start 2024-09-10T08:07:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.040+0000 7f9a91aa4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a8c101de0 0x7f9a8c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.040+0000 7f9a91aa4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c102790 0x7f9a8c198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.040+0000 7f9a91aa4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c106f10 0x7f9a8c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.040+0000 7f9a91aa4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c111fc0 con 0x7f9a8c102790 2024-09-10T08:07:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.040+0000 7f9a91aa4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c111e40 con 0x7f9a8c106f10 2024-09-10T08:07:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.040+0000 7f9a91aa4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c112140 con 0x7f9a8c101de0 2024-09-10T08:07:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.040+0000 7f9a8affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c102790 0x7f9a8c198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.040+0000 7f9a8affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c102790 0x7f9a8c198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53128/0 (socket says 172.21.15.22:53128) 2024-09-10T08:07:48.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.040+0000 7f9a8affd640 1 -- 172.21.15.22:0/2143109601 learned_addr learned my addr 172.21.15.22:0/2143109601 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a8affd640 1 -- 172.21.15.22:0/2143109601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a8c101de0 msgr2=0x7f9a8c1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a8b7fe640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a8c101de0 0x7f9a8c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a8affd640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a8c101de0 0x7f9a8c1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a8bfff640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c106f10 0x7f9a8c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a8affd640 1 -- 172.21.15.22:0/2143109601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c106f10 msgr2=0x7f9a8c19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a8affd640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c106f10 0x7f9a8c19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a8affd640 1 -- 172.21.15.22:0/2143109601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c19d370 con 0x7f9a8c102790 2024-09-10T08:07:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a8b7fe640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a8c101de0 0x7f9a8c1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:48.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a8bfff640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c106f10 0x7f9a8c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a8affd640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c102790 0x7f9a8c198900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9a80004770 tx=0x7f9a80003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a88ff9640 1 -- 172.21.15.22:0/2143109601 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8003f070 con 0x7f9a8c102790 2024-09-10T08:07:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a88ff9640 1 -- 172.21.15.22:0/2143109601 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a80031ca0 con 0x7f9a8c102790 2024-09-10T08:07:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a91aa4640 1 -- 172.21.15.22:0/2143109601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8c19d600 con 0x7f9a8c102790 2024-09-10T08:07:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a88ff9640 1 -- 172.21.15.22:0/2143109601 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80035030 con 0x7f9a8c102790 2024-09-10T08:07:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.041+0000 7f9a91aa4640 1 -- 172.21.15.22:0/2143109601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8c1a4f40 con 0x7f9a8c102790 2024-09-10T08:07:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.042+0000 7f9a91aa4640 1 -- 172.21.15.22:0/2143109601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a8c1021c0 con 0x7f9a8c102790 2024-09-10T08:07:48.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.043+0000 7f9a88ff9640 1 -- 172.21.15.22:0/2143109601 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9a80042070 con 0x7f9a8c102790 2024-09-10T08:07:48.283 INFO:teuthology.orchestra.run.smithi022.stdout:55834574922 2024-09-10T08:07:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.044+0000 7f9a88ff9640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9a740a2c90 0x7f9a740a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.044+0000 7f9a88ff9640 1 -- 172.21.15.22:0/2143109601 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f9a800efd90 con 0x7f9a8c102790 2024-09-10T08:07:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.044+0000 7f9a8b7fe640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9a740a2c90 0x7f9a740a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.045+0000 7f9a8b7fe640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9a740a2c90 0x7f9a740a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c009b40 tx=0x7f9a7c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.048+0000 7f9a88ff9640 1 -- 172.21.15.22:0/2143109601 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9a800bcca0 con 0x7f9a8c102790 2024-09-10T08:07:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.234+0000 7f9a91aa4640 1 -- 172.21.15.22:0/2143109601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9a8c10a180 con 0x7f9a8c102790 2024-09-10T08:07:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.234+0000 7f9a88ff9640 1 -- 172.21.15.22:0/2143109601 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a800bc5a0 con 0x7f9a8c102790 2024-09-10T08:07:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.236+0000 7f9a91aa4640 1 -- 172.21.15.22:0/2143109601 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9a740a2c90 msgr2=0x7f9a740a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:48.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.236+0000 7f9a91aa4640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9a740a2c90 0x7f9a740a5150 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c009b40 tx=0x7f9a7c005e50 comp rx=0 tx=0).stop 2024-09-10T08:07:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.236+0000 7f9a91aa4640 1 -- 172.21.15.22:0/2143109601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c102790 msgr2=0x7f9a8c198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.236+0000 7f9a91aa4640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c102790 0x7f9a8c198900 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9a80004770 tx=0x7f9a80003c10 comp rx=0 tx=0).stop 2024-09-10T08:07:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.236+0000 7f9a91aa4640 1 -- 172.21.15.22:0/2143109601 shutdown_connections 2024-09-10T08:07:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.236+0000 7f9a91aa4640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f9a740a2c90 0x7f9a740a5150 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.236+0000 7f9a91aa4640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9a8c106f10 0x7f9a8c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.236+0000 7f9a91aa4640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c102790 0x7f9a8c198900 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.236+0000 7f9a91aa4640 1 --2- 172.21.15.22:0/2143109601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a8c101de0 0x7f9a8c1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.236+0000 7f9a91aa4640 1 -- 172.21.15.22:0/2143109601 >> 172.21.15.22:0/2143109601 conn(0x7f9a8c0fd8c0 msgr2=0x7f9a8c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.236+0000 7f9a91aa4640 1 -- 172.21.15.22:0/2143109601 shutdown_connections 2024-09-10T08:07:48.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.236+0000 7f9a91aa4640 1 -- 172.21.15.22:0/2143109601 wait complete. 2024-09-10T08:07:48.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.344+0000 7f60901b5640 1 -- 172.21.15.22:0/432881119 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6088103110 con 0x7f60881082a0 2024-09-10T08:07:48.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.345+0000 7f607effd640 1 -- 172.21.15.22:0/432881119 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6088103110 con 0x7f60881082a0 2024-09-10T08:07:48.344 INFO:teuthology.orchestra.run.smithi022.stdout:137438953531 2024-09-10T08:07:48.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.347+0000 7f60901b5640 1 -- 172.21.15.22:0/432881119 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f60740a2c60 msgr2=0x7f60740a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:48.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.347+0000 7f60901b5640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f60740a2c60 0x7f60740a5120 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6084009b60 tx=0x7f6084005f90 comp rx=0 tx=0).stop 2024-09-10T08:07:48.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.347+0000 7f60901b5640 1 -- 172.21.15.22:0/432881119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60881082a0 msgr2=0x7f6088101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:48.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.347+0000 7f60901b5640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60881082a0 0x7f6088101410 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6080009bf0 tx=0x7f6080003970 comp rx=0 tx=0).stop 2024-09-10T08:07:48.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.347+0000 7f60901b5640 1 -- 172.21.15.22:0/432881119 shutdown_connections 2024-09-10T08:07:48.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.347+0000 7f60901b5640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f60740a2c60 0x7f60740a5120 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.347+0000 7f60901b5640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f60881082a0 0x7f6088101410 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.347+0000 7f60901b5640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60881036e0 0x7f6088100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.347+0000 7f60901b5640 1 --2- 172.21.15.22:0/432881119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6088102d30 0x7f6088100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:48.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.347+0000 7f60901b5640 1 -- 172.21.15.22:0/432881119 >> 172.21.15.22:0/432881119 conn(0x7f60880fc7d0 msgr2=0x7f6088105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:48.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.347+0000 7f60901b5640 1 -- 172.21.15.22:0/432881119 shutdown_connections 2024-09-10T08:07:48.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:48.347+0000 7f60901b5640 1 -- 172.21.15.22:0/432881119 wait complete. 2024-09-10T08:07:48.469 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:48.696 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:48 smithi022 ceph-mon[30854]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-10T08:07:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:48 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2143109601' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T08:07:48.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:48 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/432881119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T08:07:48.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:48 smithi100 ceph-mon[35102]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-10T08:07:48.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:48 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2143109601' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T08:07:48.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:48 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/432881119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T08:07:48.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:48 smithi153 ceph-mon[35609]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-09-10T08:07:48.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:48 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2143109601' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-10T08:07:48.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:48 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/432881119' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-10T08:07:49.079 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953529 got 137438953531 for osd.4 2024-09-10T08:07:49.080 DEBUG:teuthology.parallel:result is None 2024-09-10T08:07:49.829 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:49 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:07:49.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:49 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:07:49.893 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:49 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:07:49.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.987+0000 7ff229ed6640 1 -- 172.21.15.22:0/730926663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff224102ef0 msgr2=0x7ff22410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:49.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.987+0000 7ff229ed6640 1 --2- 172.21.15.22:0/730926663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff224102ef0 0x7ff22410da40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009ca0 tx=0x7ff21c02a950 comp rx=0 tx=0).stop 2024-09-10T08:07:49.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.987+0000 7ff229ed6640 1 -- 172.21.15.22:0/730926663 shutdown_connections 2024-09-10T08:07:49.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.987+0000 7ff229ed6640 1 --2- 172.21.15.22:0/730926663 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff224102ef0 0x7ff22410da40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:49.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.987+0000 7ff229ed6640 1 --2- 172.21.15.22:0/730926663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff224102570 0x7ff2241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:49.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.987+0000 7ff229ed6640 1 --2- 172.21.15.22:0/730926663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff224100e20 0x7ff224101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:49.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.987+0000 7ff229ed6640 1 -- 172.21.15.22:0/730926663 >> 172.21.15.22:0/730926663 conn(0x7ff2240fc7d0 msgr2=0x7ff2240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:49.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.987+0000 7ff229ed6640 1 -- 172.21.15.22:0/730926663 shutdown_connections 2024-09-10T08:07:49.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.987+0000 7ff229ed6640 1 -- 172.21.15.22:0/730926663 wait complete. 2024-09-10T08:07:49.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff229ed6640 1 Processor -- start 2024-09-10T08:07:49.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff229ed6640 1 -- start start 2024-09-10T08:07:49.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff229ed6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff224100e20 0x7ff22419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:49.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff229ed6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff224102570 0x7ff22419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff229ed6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff224102ef0 0x7ff22419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff229ed6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff224110f80 con 0x7ff224100e20 2024-09-10T08:07:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff229ed6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff224110e00 con 0x7ff224102ef0 2024-09-10T08:07:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff229ed6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff224111100 con 0x7ff224102570 2024-09-10T08:07:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff2237fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff224100e20 0x7ff22419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff2237fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff224100e20 0x7ff22419a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53162/0 (socket says 172.21.15.22:53162) 2024-09-10T08:07:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff2237fe640 1 -- 172.21.15.22:0/2546582385 learned_addr learned my addr 172.21.15.22:0/2546582385 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff222ffd640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff224102570 0x7ff22419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.988+0000 7ff223fff640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff224102ef0 0x7ff22419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.989+0000 7ff2237fe640 1 -- 172.21.15.22:0/2546582385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff224102570 msgr2=0x7ff22419abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.989+0000 7ff2237fe640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff224102570 0x7ff22419abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:49.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.989+0000 7ff2237fe640 1 -- 172.21.15.22:0/2546582385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff224102ef0 msgr2=0x7ff22419ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.989+0000 7ff2237fe640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff224102ef0 0x7ff22419ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.989+0000 7ff2237fe640 1 -- 172.21.15.22:0/2546582385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22419f630 con 0x7ff224100e20 2024-09-10T08:07:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.989+0000 7ff223fff640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff224102ef0 0x7ff22419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:07:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.989+0000 7ff2237fe640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff224100e20 0x7ff22419a680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff21400e9f0 tx=0x7ff21400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.989+0000 7ff220ff9640 1 -- 172.21.15.22:0/2546582385 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21400cd80 con 0x7ff224100e20 2024-09-10T08:07:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.989+0000 7ff220ff9640 1 -- 172.21.15.22:0/2546582385 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff214005500 con 0x7ff224100e20 2024-09-10T08:07:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.989+0000 7ff229ed6640 1 -- 172.21.15.22:0/2546582385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22419f920 con 0x7ff224100e20 2024-09-10T08:07:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.989+0000 7ff220ff9640 1 -- 172.21.15.22:0/2546582385 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214010690 con 0x7ff224100e20 2024-09-10T08:07:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.989+0000 7ff229ed6640 1 -- 172.21.15.22:0/2546582385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2241a7200 con 0x7ff224100e20 2024-09-10T08:07:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.990+0000 7ff229ed6640 1 -- 172.21.15.22:0/2546582385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff224101200 con 0x7ff224100e20 2024-09-10T08:07:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.991+0000 7ff220ff9640 1 -- 172.21.15.22:0/2546582385 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7ff2140046c0 con 0x7ff224100e20 2024-09-10T08:07:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.992+0000 7ff220ff9640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff20c0a2c10 0x7ff20c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.993+0000 7ff222ffd640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff20c0a2c10 0x7ff20c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.993+0000 7ff220ff9640 1 -- 172.21.15.22:0/2546582385 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff2140cf660 con 0x7ff224100e20 2024-09-10T08:07:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.993+0000 7ff222ffd640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff20c0a2c10 0x7ff20c0a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff2180095f0 tx=0x7ff218005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:49.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:49.997+0000 7ff220ff9640 1 -- 172.21.15.22:0/2546582385 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff21409c460 con 0x7ff224100e20 2024-09-10T08:07:50.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.177+0000 7ff229ed6640 1 -- 172.21.15.22:0/2546582385 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7ff2241a73d0 con 0x7ff224100e20 2024-09-10T08:07:50.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.177+0000 7ff220ff9640 1 -- 172.21.15.22:0/2546582385 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7ff21409bd60 con 0x7ff224100e20 2024-09-10T08:07:50.177 INFO:teuthology.orchestra.run.smithi022.stdout:292057776157 2024-09-10T08:07:50.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.180+0000 7ff229ed6640 1 -- 172.21.15.22:0/2546582385 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff20c0a2c10 msgr2=0x7ff20c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:50.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.180+0000 7ff229ed6640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff20c0a2c10 0x7ff20c0a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff2180095f0 tx=0x7ff218005f90 comp rx=0 tx=0).stop 2024-09-10T08:07:50.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.180+0000 7ff229ed6640 1 -- 172.21.15.22:0/2546582385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff224100e20 msgr2=0x7ff22419a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:50.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.180+0000 7ff229ed6640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff224100e20 0x7ff22419a680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff21400e9f0 tx=0x7ff21400edf0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.180+0000 7ff229ed6640 1 -- 172.21.15.22:0/2546582385 shutdown_connections 2024-09-10T08:07:50.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.180+0000 7ff229ed6640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff20c0a2c10 0x7ff20c0a50d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.180+0000 7ff229ed6640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff224102ef0 0x7ff22419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.180+0000 7ff229ed6640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff224102570 0x7ff22419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.180+0000 7ff229ed6640 1 --2- 172.21.15.22:0/2546582385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff224100e20 0x7ff22419a680 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.180+0000 7ff229ed6640 1 -- 172.21.15.22:0/2546582385 >> 172.21.15.22:0/2546582385 conn(0x7ff2240fc7d0 msgr2=0x7ff224069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:50.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.180+0000 7ff229ed6640 1 -- 172.21.15.22:0/2546582385 shutdown_connections 2024-09-10T08:07:50.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.180+0000 7ff229ed6640 1 -- 172.21.15.22:0/2546582385 wait complete. 2024-09-10T08:07:50.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.197+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1476165082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b641036b0 msgr2=0x7f8b6410bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:50.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.197+0000 7f8b6bee4640 1 --2- 172.21.15.22:0/1476165082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b641036b0 0x7f8b6410bba0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009900 tx=0x7f8b5402a480 comp rx=0 tx=0).stop 2024-09-10T08:07:50.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.197+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1476165082 shutdown_connections 2024-09-10T08:07:50.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.197+0000 7f8b6bee4640 1 --2- 172.21.15.22:0/1476165082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b6410c170 0x7f8b6410e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.197+0000 7f8b6bee4640 1 --2- 172.21.15.22:0/1476165082 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b641036b0 0x7f8b6410bba0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.197+0000 7f8b6bee4640 1 --2- 172.21.15.22:0/1476165082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b64102d90 0x7f8b64103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.197+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1476165082 >> 172.21.15.22:0/1476165082 conn(0x7f8b640fc790 msgr2=0x7f8b640febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:50.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.197+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1476165082 shutdown_connections 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.197+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1476165082 wait complete. 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.198+0000 7f8b6bee4640 1 Processor -- start 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.198+0000 7f8b6bee4640 1 -- start start 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.198+0000 7f8b6bee4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b64102d90 0x7f8b64198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.198+0000 7f8b6bee4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b641036b0 0x7f8b64198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.198+0000 7f8b6bee4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b6410c170 0x7f8b6419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.198+0000 7f8b6bee4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64111f50 con 0x7f8b641036b0 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.198+0000 7f8b6bee4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64111dd0 con 0x7f8b64102d90 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.198+0000 7f8b6bee4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641120d0 con 0x7f8b6410c170 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b6947f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b641036b0 0x7f8b64198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b6947f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b641036b0 0x7f8b64198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53180/0 (socket says 172.21.15.22:53180) 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b6947f640 1 -- 172.21.15.22:0/1903651913 learned_addr learned my addr 172.21.15.22:0/1903651913 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:50.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b6a481640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b6410c170 0x7f8b6419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b69c80640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b64102d90 0x7f8b64198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b6947f640 1 -- 172.21.15.22:0/1903651913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b6410c170 msgr2=0x7f8b6419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b6947f640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b6410c170 0x7f8b6419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b6947f640 1 -- 172.21.15.22:0/1903651913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b64102d90 msgr2=0x7f8b64198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b6947f640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b64102d90 0x7f8b64198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b6947f640 1 -- 172.21.15.22:0/1903651913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6419d3e0 con 0x7f8b641036b0 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b6a481640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b6410c170 0x7f8b6419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b6947f640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b641036b0 0x7f8b64198970 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8b54006010 tx=0x7f8b54004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b5affd640 1 -- 172.21.15.22:0/1903651913 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5403f030 con 0x7f8b641036b0 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1903651913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6419d670 con 0x7f8b641036b0 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b5affd640 1 -- 172.21.15.22:0/1903651913 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b54004440 con 0x7f8b641036b0 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.199+0000 7f8b5affd640 1 -- 172.21.15.22:0/1903651913 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54035070 con 0x7f8b641036b0 2024-09-10T08:07:50.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.200+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1903651913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b641a4fb0 con 0x7f8b641036b0 2024-09-10T08:07:50.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.201+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1903651913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b64103170 con 0x7f8b641036b0 2024-09-10T08:07:50.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.202+0000 7f8b5affd640 1 -- 172.21.15.22:0/1903651913 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8b54042030 con 0x7f8b641036b0 2024-09-10T08:07:50.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.203+0000 7f8b5affd640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b500a2c10 0x7f8b500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:50.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.203+0000 7f8b5affd640 1 -- 172.21.15.22:0/1903651913 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8b540ef570 con 0x7f8b641036b0 2024-09-10T08:07:50.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.203+0000 7f8b69c80640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b500a2c10 0x7f8b500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:50.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.204+0000 7f8b69c80640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b500a2c10 0x7f8b500a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005fd0 tx=0x7f8b60009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:50.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.207+0000 7f8b5affd640 1 -- 172.21.15.22:0/1903651913 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b540bbce0 con 0x7f8b641036b0 2024-09-10T08:07:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.388+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1903651913 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8b641071b0 con 0x7f8b641036b0 2024-09-10T08:07:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.388+0000 7f8b5affd640 1 -- 172.21.15.22:0/1903651913 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8b540bffe0 con 0x7f8b641036b0 2024-09-10T08:07:50.388 INFO:teuthology.orchestra.run.smithi022.stdout:158913790006 2024-09-10T08:07:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.390+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1903651913 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b500a2c10 msgr2=0x7f8b500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.390+0000 7f8b6bee4640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b500a2c10 0x7f8b500a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8b60005fd0 tx=0x7f8b60009500 comp rx=0 tx=0).stop 2024-09-10T08:07:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.390+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1903651913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b641036b0 msgr2=0x7f8b64198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.390+0000 7f8b6bee4640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b641036b0 0x7f8b64198970 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8b54006010 tx=0x7f8b54004040 comp rx=0 tx=0).stop 2024-09-10T08:07:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.390+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1903651913 shutdown_connections 2024-09-10T08:07:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.390+0000 7f8b6bee4640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b500a2c10 0x7f8b500a50d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.390+0000 7f8b6bee4640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b6410c170 0x7f8b6419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.390+0000 7f8b6bee4640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b641036b0 0x7f8b64198970 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.390+0000 7f8b6bee4640 1 --2- 172.21.15.22:0/1903651913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b64102d90 0x7f8b64198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.390+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1903651913 >> 172.21.15.22:0/1903651913 conn(0x7f8b640fc790 msgr2=0x7f8b640fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.390+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1903651913 shutdown_connections 2024-09-10T08:07:50.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:50.390+0000 7f8b6bee4640 1 -- 172.21.15.22:0/1903651913 wait complete. 2024-09-10T08:07:50.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:50 smithi022 ceph-mon[30854]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-10T08:07:50.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:50 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2546582385' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T08:07:50.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:50 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1903651913' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T08:07:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:50 smithi100 ceph-mon[35102]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-10T08:07:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:50 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2546582385' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T08:07:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:50 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1903651913' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T08:07:50.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:50 smithi153 ceph-mon[35609]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-09-10T08:07:50.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:50 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2546582385' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-10T08:07:50.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:50 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1903651913' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-10T08:07:51.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.136+0000 7f0e34a7d640 1 -- 172.21.15.22:0/3555732935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e30100e20 msgr2=0x7f0e30101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:51.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.136+0000 7f0e34a7d640 1 --2- 172.21.15.22:0/3555732935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e30100e20 0x7f0e30101200 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009900 tx=0x7f0e2002a480 comp rx=0 tx=0).stop 2024-09-10T08:07:51.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.136+0000 7f0e34a7d640 1 -- 172.21.15.22:0/3555732935 shutdown_connections 2024-09-10T08:07:51.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.136+0000 7f0e34a7d640 1 --2- 172.21.15.22:0/3555732935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e30102ef0 0x7f0e3010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:51.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.136+0000 7f0e34a7d640 1 --2- 172.21.15.22:0/3555732935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e30102570 0x7f0e301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:51.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.136+0000 7f0e34a7d640 1 --2- 172.21.15.22:0/3555732935 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e30100e20 0x7f0e30101200 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:51.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.136+0000 7f0e34a7d640 1 -- 172.21.15.22:0/3555732935 >> 172.21.15.22:0/3555732935 conn(0x7f0e300fc7d0 msgr2=0x7f0e300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:51.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.136+0000 7f0e34a7d640 1 -- 172.21.15.22:0/3555732935 shutdown_connections 2024-09-10T08:07:51.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.136+0000 7f0e34a7d640 1 -- 172.21.15.22:0/3555732935 wait complete. 2024-09-10T08:07:51.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.137+0000 7f0e34a7d640 1 Processor -- start 2024-09-10T08:07:51.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.137+0000 7f0e34a7d640 1 -- start start 2024-09-10T08:07:51.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.137+0000 7f0e34a7d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e30100e20 0x7f0e30199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.137+0000 7f0e34a7d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e30102570 0x7f0e301998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.137+0000 7f0e34a7d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e30102ef0 0x7f0e301a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.137+0000 7f0e34a7d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0e30110fa0 con 0x7f0e30100e20 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.137+0000 7f0e34a7d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0e30110e20 con 0x7f0e30102ef0 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.137+0000 7f0e34a7d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0e30111120 con 0x7f0e30102570 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.138+0000 7f0e2e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e30100e20 0x7f0e30199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.138+0000 7f0e2e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e30100e20 0x7f0e30199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53196/0 (socket says 172.21.15.22:53196) 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.138+0000 7f0e2e59c640 1 -- 172.21.15.22:0/1251154251 learned_addr learned my addr 172.21.15.22:0/1251154251 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.138+0000 7f0e2ed9d640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e30102ef0 0x7f0e301a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.138+0000 7f0e27fff640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e30102570 0x7f0e301998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.138+0000 7f0e2e59c640 1 -- 172.21.15.22:0/1251154251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e30102570 msgr2=0x7f0e301998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.138+0000 7f0e2e59c640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e30102570 0x7f0e301998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.138+0000 7f0e2e59c640 1 -- 172.21.15.22:0/1251154251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e30102ef0 msgr2=0x7f0e301a4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.138+0000 7f0e2e59c640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e30102ef0 0x7f0e301a4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.138+0000 7f0e2e59c640 1 -- 172.21.15.22:0/1251154251 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e301a4950 con 0x7f0e30100e20 2024-09-10T08:07:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.138+0000 7f0e2e59c640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e30100e20 0x7f0e30199390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0e20006010 tx=0x7f0e20003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.138+0000 7f0e277fe640 1 -- 172.21.15.22:0/1251154251 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2003f070 con 0x7f0e30100e20 2024-09-10T08:07:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.139+0000 7f0e277fe640 1 -- 172.21.15.22:0/1251154251 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e20031c30 con 0x7f0e30100e20 2024-09-10T08:07:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.139+0000 7f0e34a7d640 1 -- 172.21.15.22:0/1251154251 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e30197180 con 0x7f0e30100e20 2024-09-10T08:07:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.139+0000 7f0e34a7d640 1 -- 172.21.15.22:0/1251154251 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e301976b0 con 0x7f0e30100e20 2024-09-10T08:07:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.139+0000 7f0e277fe640 1 -- 172.21.15.22:0/1251154251 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20035030 con 0x7f0e30100e20 2024-09-10T08:07:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.140+0000 7f0e34a7d640 1 -- 172.21.15.22:0/1251154251 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e10005290 con 0x7f0e30100e20 2024-09-10T08:07:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.141+0000 7f0e277fe640 1 -- 172.21.15.22:0/1251154251 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0e20042070 con 0x7f0e30100e20 2024-09-10T08:07:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.142+0000 7f0e277fe640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0e1c0a2c90 0x7f0e1c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.142+0000 7f0e27fff640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0e1c0a2c90 0x7f0e1c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.142+0000 7f0e277fe640 1 -- 172.21.15.22:0/1251154251 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f0e200efc10 con 0x7f0e30100e20 2024-09-10T08:07:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.142+0000 7f0e27fff640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0e1c0a2c90 0x7f0e1c0a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0e3006aac0 tx=0x7f0e1800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:51.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.145+0000 7f0e277fe640 1 -- 172.21.15.22:0/1251154251 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e20031de0 con 0x7f0e30100e20 2024-09-10T08:07:51.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.328+0000 7f0e34a7d640 1 -- 172.21.15.22:0/1251154251 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0e10005850 con 0x7f0e30100e20 2024-09-10T08:07:51.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.328+0000 7f0e277fe640 1 -- 172.21.15.22:0/1251154251 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0e200bc480 con 0x7f0e30100e20 2024-09-10T08:07:51.328 INFO:teuthology.orchestra.run.smithi022.stdout:188978561074 2024-09-10T08:07:51.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.330+0000 7f0e34a7d640 1 -- 172.21.15.22:0/1251154251 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0e1c0a2c90 msgr2=0x7f0e1c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:51.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.330+0000 7f0e34a7d640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0e1c0a2c90 0x7f0e1c0a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0e3006aac0 tx=0x7f0e1800b390 comp rx=0 tx=0).stop 2024-09-10T08:07:51.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.330+0000 7f0e34a7d640 1 -- 172.21.15.22:0/1251154251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e30100e20 msgr2=0x7f0e30199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:51.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.330+0000 7f0e34a7d640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e30100e20 0x7f0e30199390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0e20006010 tx=0x7f0e20003c10 comp rx=0 tx=0).stop 2024-09-10T08:07:51.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.330+0000 7f0e34a7d640 1 -- 172.21.15.22:0/1251154251 shutdown_connections 2024-09-10T08:07:51.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.331+0000 7f0e34a7d640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0e1c0a2c90 0x7f0e1c0a5150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:51.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.331+0000 7f0e34a7d640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e30102ef0 0x7f0e301a4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:51.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.331+0000 7f0e34a7d640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e30102570 0x7f0e301998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:51.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.331+0000 7f0e34a7d640 1 --2- 172.21.15.22:0/1251154251 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e30100e20 0x7f0e30199390 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:51.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.331+0000 7f0e34a7d640 1 -- 172.21.15.22:0/1251154251 >> 172.21.15.22:0/1251154251 conn(0x7f0e300fc7d0 msgr2=0x7f0e300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:51.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.331+0000 7f0e34a7d640 1 -- 172.21.15.22:0/1251154251 shutdown_connections 2024-09-10T08:07:51.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:51.331+0000 7f0e34a7d640 1 -- 172.21.15.22:0/1251154251 wait complete. 2024-09-10T08:07:51.684 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:51.684 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:52.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:07:52.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:07:52.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:07:52.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:51 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:07:52.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:51 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1251154251' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T08:07:52.115 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574922 for osd.1 2024-09-10T08:07:52.116 DEBUG:teuthology.parallel:result is None 2024-09-10T08:07:52.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:07:52.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:07:52.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:07:52.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:51 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:07:52.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:51 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1251154251' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T08:07:52.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:07:52.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:07:52.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:07:52.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:51 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:07:52.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:51 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1251154251' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-10T08:07:52.634 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561072 got 188978561074 for osd.6 2024-09-10T08:07:52.635 DEBUG:teuthology.parallel:result is None 2024-09-10T08:07:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.766+0000 7f568fe1a640 1 -- 172.21.15.22:0/3799830874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56881036e0 msgr2=0x7f5688107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.766+0000 7f568fe1a640 1 --2- 172.21.15.22:0/3799830874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56881036e0 0x7f5688107b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5678009930 tx=0x7f567802a420 comp rx=0 tx=0).stop 2024-09-10T08:07:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.766+0000 7f568fe1a640 1 -- 172.21.15.22:0/3799830874 shutdown_connections 2024-09-10T08:07:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.766+0000 7f568fe1a640 1 --2- 172.21.15.22:0/3799830874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56881082a0 0x7f568810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.766+0000 7f568fe1a640 1 --2- 172.21.15.22:0/3799830874 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56881036e0 0x7f5688107b90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.766+0000 7f568fe1a640 1 --2- 172.21.15.22:0/3799830874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5688102d30 0x7f5688103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.766+0000 7f568fe1a640 1 -- 172.21.15.22:0/3799830874 >> 172.21.15.22:0/3799830874 conn(0x7f56880fc7d0 msgr2=0x7f56880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.766+0000 7f568fe1a640 1 -- 172.21.15.22:0/3799830874 shutdown_connections 2024-09-10T08:07:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.766+0000 7f568fe1a640 1 -- 172.21.15.22:0/3799830874 wait complete. 2024-09-10T08:07:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568fe1a640 1 Processor -- start 2024-09-10T08:07:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568fe1a640 1 -- start start 2024-09-10T08:07:52.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568fe1a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5688102d30 0x7f56881985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:52.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568fe1a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56881036e0 0x7f5688198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:52.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568fe1a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56881082a0 0x7f568819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:52.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568fe1a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5688112090 con 0x7f56881082a0 2024-09-10T08:07:52.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568fe1a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5688111f10 con 0x7f5688102d30 2024-09-10T08:07:52.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568fe1a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5688112210 con 0x7f56881036e0 2024-09-10T08:07:52.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568e3b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56881082a0 0x7f568819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:52.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568e3b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56881082a0 0x7f568819cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53238/0 (socket says 172.21.15.22:53238) 2024-09-10T08:07:52.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568e3b7640 1 -- 172.21.15.22:0/3224070620 learned_addr learned my addr 172.21.15.22:0/3224070620 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:52.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568d3b5640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56881036e0 0x7f5688198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:52.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568dbb6640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5688102d30 0x7f56881985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:52.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568e3b7640 1 -- 172.21.15.22:0/3224070620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56881036e0 msgr2=0x7f5688198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:52.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568e3b7640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56881036e0 0x7f5688198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568e3b7640 1 -- 172.21.15.22:0/3224070620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5688102d30 msgr2=0x7f56881985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568e3b7640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5688102d30 0x7f56881985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.767+0000 7f568e3b7640 1 -- 172.21.15.22:0/3224070620 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568819d580 con 0x7f56881082a0 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.768+0000 7f568e3b7640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56881082a0 0x7f568819cea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5680009fd0 tx=0x7f568000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.768+0000 7f567effd640 1 -- 172.21.15.22:0/3224070620 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5680017070 con 0x7f56881082a0 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.768+0000 7f567effd640 1 -- 172.21.15.22:0/3224070620 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5680003e50 con 0x7f56881082a0 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.768+0000 7f568fe1a640 1 -- 172.21.15.22:0/3224070620 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568819d870 con 0x7f56881082a0 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.768+0000 7f567effd640 1 -- 172.21.15.22:0/3224070620 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56800106c0 con 0x7f56881082a0 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.768+0000 7f568fe1a640 1 -- 172.21.15.22:0/3224070620 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56881a5150 con 0x7f56881082a0 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.769+0000 7f568fe1a640 1 -- 172.21.15.22:0/3224070620 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5688103110 con 0x7f56881082a0 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.770+0000 7f567effd640 1 -- 172.21.15.22:0/3224070620 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5680003970 con 0x7f56881082a0 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.771+0000 7f567effd640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f56740a2c10 0x7f56740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.771+0000 7f568dbb6640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f56740a2c10 0x7f56740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:52.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.771+0000 7f567effd640 1 -- 172.21.15.22:0/3224070620 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f56800cee30 con 0x7f56881082a0 2024-09-10T08:07:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.771+0000 7f568dbb6640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f56740a2c10 0x7f56740a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5684005d00 tx=0x7f568400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:52.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.774+0000 7f567effd640 1 -- 172.21.15.22:0/3224070620 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f568009b5e0 con 0x7f56881082a0 2024-09-10T08:07:52.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.954+0000 7f568fe1a640 1 -- 172.21.15.22:0/3224070620 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f568810a2b0 con 0x7f56881082a0 2024-09-10T08:07:52.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.954+0000 7f567effd640 1 -- 172.21.15.22:0/3224070620 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f568009f8e0 con 0x7f56881082a0 2024-09-10T08:07:52.954 INFO:teuthology.orchestra.run.smithi022.stdout:240518168616 2024-09-10T08:07:52.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.956+0000 7f568fe1a640 1 -- 172.21.15.22:0/3224070620 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f56740a2c10 msgr2=0x7f56740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:52.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.956+0000 7f568fe1a640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f56740a2c10 0x7f56740a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5684005d00 tx=0x7f568400b410 comp rx=0 tx=0).stop 2024-09-10T08:07:52.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.956+0000 7f568fe1a640 1 -- 172.21.15.22:0/3224070620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56881082a0 msgr2=0x7f568819cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:52.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.956+0000 7f568fe1a640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56881082a0 0x7f568819cea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5680009fd0 tx=0x7f568000b260 comp rx=0 tx=0).stop 2024-09-10T08:07:52.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.956+0000 7f568fe1a640 1 -- 172.21.15.22:0/3224070620 shutdown_connections 2024-09-10T08:07:52.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.956+0000 7f568fe1a640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f56740a2c10 0x7f56740a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:52.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.956+0000 7f568fe1a640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f56881082a0 0x7f568819cea0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:52.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.956+0000 7f568fe1a640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f56881036e0 0x7f5688198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:52.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.956+0000 7f568fe1a640 1 --2- 172.21.15.22:0/3224070620 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5688102d30 0x7f56881985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:52.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.956+0000 7f568fe1a640 1 -- 172.21.15.22:0/3224070620 >> 172.21.15.22:0/3224070620 conn(0x7f56880fc7d0 msgr2=0x7f5688105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:52.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.956+0000 7f568fe1a640 1 -- 172.21.15.22:0/3224070620 shutdown_connections 2024-09-10T08:07:52.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.956+0000 7f568fe1a640 1 -- 172.21.15.22:0/3224070620 wait complete. 2024-09-10T08:07:53.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:52 smithi022 ceph-mon[30854]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:07:53.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:52 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1739469869' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T08:07:53.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:52 smithi100 ceph-mon[35102]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:07:53.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:52 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1739469869' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T08:07:53.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:52 smithi153 ceph-mon[35609]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:07:53.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:52 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1739469869' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-10T08:07:53.272 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776154 got 292057776157 for osd.10 2024-09-10T08:07:53.272 DEBUG:teuthology.parallel:result is None 2024-09-10T08:07:54.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:53 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3224070620' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T08:07:54.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:53 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3224070620' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T08:07:54.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:53 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3224070620' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-10T08:07:54.477 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790003 got 158913790006 for osd.5 2024-09-10T08:07:54.477 DEBUG:teuthology.parallel:result is None 2024-09-10T08:07:54.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.117+0000 7fc54a666640 1 -- 172.21.15.22:0/3599533730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc544102790 msgr2=0x7fc5441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:54.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.117+0000 7fc54a666640 1 --2- 172.21.15.22:0/3599533730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc544102790 0x7fc5441067e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc538009900 tx=0x7fc53802a410 comp rx=0 tx=0).stop 2024-09-10T08:07:54.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.117+0000 7fc54a666640 1 -- 172.21.15.22:0/3599533730 shutdown_connections 2024-09-10T08:07:54.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.117+0000 7fc54a666640 1 --2- 172.21.15.22:0/3599533730 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc544106f10 0x7fc54410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:54.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.117+0000 7fc54a666640 1 --2- 172.21.15.22:0/3599533730 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc544102790 0x7fc5441067e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:54.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.117+0000 7fc54a666640 1 --2- 172.21.15.22:0/3599533730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc544101de0 0x7fc5441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:54.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.117+0000 7fc54a666640 1 -- 172.21.15.22:0/3599533730 >> 172.21.15.22:0/3599533730 conn(0x7fc5440fd8c0 msgr2=0x7fc5440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:54.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.117+0000 7fc54a666640 1 -- 172.21.15.22:0/3599533730 shutdown_connections 2024-09-10T08:07:54.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.117+0000 7fc54a666640 1 -- 172.21.15.22:0/3599533730 wait complete. 2024-09-10T08:07:54.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.118+0000 7fc54a666640 1 Processor -- start 2024-09-10T08:07:54.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.118+0000 7fc54a666640 1 -- start start 2024-09-10T08:07:54.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.118+0000 7fc54a666640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc544101de0 0x7fc544198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:54.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.118+0000 7fc54a666640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc544102790 0x7fc544198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:54.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.118+0000 7fc54a666640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc544106f10 0x7fc54419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:54.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.118+0000 7fc54a666640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc544111f70 con 0x7fc544102790 2024-09-10T08:07:54.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.118+0000 7fc54a666640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc544111df0 con 0x7fc544101de0 2024-09-10T08:07:54.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.118+0000 7fc54a666640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc5441120f0 con 0x7fc544106f10 2024-09-10T08:07:54.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.118+0000 7fc5437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc544102790 0x7fc544198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:54.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.118+0000 7fc5437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc544102790 0x7fc544198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49532/0 (socket says 172.21.15.22:49532) 2024-09-10T08:07:54.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.118+0000 7fc5437fe640 1 -- 172.21.15.22:0/1163342947 learned_addr learned my addr 172.21.15.22:0/1163342947 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:54.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.118+0000 7fc543fff640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc544101de0 0x7fc544198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:54.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.119+0000 7fc5437fe640 1 -- 172.21.15.22:0/1163342947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc544106f10 msgr2=0x7fc54419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:54.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.119+0000 7fc5437fe640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc544106f10 0x7fc54419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:54.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.119+0000 7fc5437fe640 1 -- 172.21.15.22:0/1163342947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc544101de0 msgr2=0x7fc544198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:54.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.119+0000 7fc5437fe640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc544101de0 0x7fc544198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:54.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.119+0000 7fc5437fe640 1 -- 172.21.15.22:0/1163342947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54419d400 con 0x7fc544102790 2024-09-10T08:07:54.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.119+0000 7fc543fff640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc544101de0 0x7fc544198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.119+0000 7fc5437fe640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc544102790 0x7fc544198990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc538005ab0 tx=0x7fc5380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.119+0000 7fc5417fa640 1 -- 172.21.15.22:0/1163342947 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53803f030 con 0x7fc544102790 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.119+0000 7fc5417fa640 1 -- 172.21.15.22:0/1163342947 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc538003ce0 con 0x7fc544102790 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.119+0000 7fc54a666640 1 -- 172.21.15.22:0/1163342947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54419d690 con 0x7fc544102790 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.119+0000 7fc5417fa640 1 -- 172.21.15.22:0/1163342947 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc538035070 con 0x7fc544102790 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.119+0000 7fc54a666640 1 -- 172.21.15.22:0/1163342947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5441a4fd0 con 0x7fc544102790 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.120+0000 7fc54a666640 1 -- 172.21.15.22:0/1163342947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5441021c0 con 0x7fc544102790 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.121+0000 7fc5417fa640 1 -- 172.21.15.22:0/1163342947 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc538042030 con 0x7fc544102790 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.122+0000 7fc5417fa640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc52c0a2c90 0x7fc52c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.122+0000 7fc543fff640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc52c0a2c90 0x7fc52c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.122+0000 7fc5417fa640 1 -- 172.21.15.22:0/1163342947 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc5380efb10 con 0x7fc544102790 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.122+0000 7fc543fff640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc52c0a2c90 0x7fc52c0a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc5340058c0 tx=0x7fc534005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:54.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.126+0000 7fc5417fa640 1 -- 172.21.15.22:0/1163342947 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5380bc910 con 0x7fc544102790 2024-09-10T08:07:54.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.303+0000 7fc54a666640 1 -- 172.21.15.22:0/1163342947 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc544109bc0 con 0x7fc544102790 2024-09-10T08:07:54.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.303+0000 7fc5417fa640 1 -- 172.21.15.22:0/1163342947 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc5380bc210 con 0x7fc544102790 2024-09-10T08:07:54.562 INFO:teuthology.orchestra.run.smithi022.stdout:34359738449 2024-09-10T08:07:54.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.305+0000 7fc54a666640 1 -- 172.21.15.22:0/1163342947 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc52c0a2c90 msgr2=0x7fc52c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:54.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.305+0000 7fc54a666640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc52c0a2c90 0x7fc52c0a5150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc5340058c0 tx=0x7fc534005d30 comp rx=0 tx=0).stop 2024-09-10T08:07:54.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.305+0000 7fc54a666640 1 -- 172.21.15.22:0/1163342947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc544102790 msgr2=0x7fc544198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:54.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.305+0000 7fc54a666640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc544102790 0x7fc544198990 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc538005ab0 tx=0x7fc5380042f0 comp rx=0 tx=0).stop 2024-09-10T08:07:54.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.306+0000 7fc54a666640 1 -- 172.21.15.22:0/1163342947 shutdown_connections 2024-09-10T08:07:54.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.306+0000 7fc54a666640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc52c0a2c90 0x7fc52c0a5150 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:54.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.306+0000 7fc54a666640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc544106f10 0x7fc54419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:54.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.306+0000 7fc54a666640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc544102790 0x7fc544198990 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:54.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.306+0000 7fc54a666640 1 --2- 172.21.15.22:0/1163342947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc544101de0 0x7fc544198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:54.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.306+0000 7fc54a666640 1 -- 172.21.15.22:0/1163342947 >> 172.21.15.22:0/1163342947 conn(0x7fc5440fd8c0 msgr2=0x7fc5440feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:54.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.306+0000 7fc54a666640 1 -- 172.21.15.22:0/1163342947 shutdown_connections 2024-09-10T08:07:54.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:54.306+0000 7fc54a666640 1 -- 172.21.15.22:0/1163342947 wait complete. 2024-09-10T08:07:54.920 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:54 smithi022 ceph-mon[30854]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-10T08:07:54.921 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:54 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1163342947' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T08:07:55.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:54 smithi100 ceph-mon[35102]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-10T08:07:55.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:54 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1163342947' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T08:07:55.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:54 smithi153 ceph-mon[35609]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s 2024-09-10T08:07:55.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:54 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1163342947' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-10T08:07:55.262 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738449 for osd.0 2024-09-10T08:07:55.262 DEBUG:teuthology.parallel:result is None 2024-09-10T08:07:55.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.296+0000 7fe50c5a4640 1 -- 172.21.15.22:0/724524831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe504103660 msgr2=0x7fe50410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:55.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.296+0000 7fe50c5a4640 1 --2- 172.21.15.22:0/724524831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe504103660 0x7fe50410bb50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4009900 tx=0x7fe4f402a480 comp rx=0 tx=0).stop 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.296+0000 7fe50c5a4640 1 -- 172.21.15.22:0/724524831 shutdown_connections 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.296+0000 7fe50c5a4640 1 --2- 172.21.15.22:0/724524831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe50410c170 0x7fe50410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.297+0000 7fe50c5a4640 1 --2- 172.21.15.22:0/724524831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe504103660 0x7fe50410bb50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.297+0000 7fe50c5a4640 1 --2- 172.21.15.22:0/724524831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe504102d40 0x7fe504103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.297+0000 7fe50c5a4640 1 -- 172.21.15.22:0/724524831 >> 172.21.15.22:0/724524831 conn(0x7fe5040fc7a0 msgr2=0x7fe5040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.297+0000 7fe50c5a4640 1 -- 172.21.15.22:0/724524831 shutdown_connections 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.297+0000 7fe50c5a4640 1 -- 172.21.15.22:0/724524831 wait complete. 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.297+0000 7fe50c5a4640 1 Processor -- start 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.297+0000 7fe50c5a4640 1 -- start start 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.297+0000 7fe50c5a4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe504102d40 0x7fe5041009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50c5a4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe504103660 0x7fe504100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50c5a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe50410c170 0x7fe504101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:55.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50c5a4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe504111f70 con 0x7fe504102d40 2024-09-10T08:07:55.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50c5a4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe504111df0 con 0x7fe50410c170 2024-09-10T08:07:55.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50c5a4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe5041120f0 con 0x7fe504103660 2024-09-10T08:07:55.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50a340640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe504102d40 0x7fe5041009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:55.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50a340640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe504102d40 0x7fe5041009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53208/0 (socket says 172.21.15.22:53208) 2024-09-10T08:07:55.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50a340640 1 -- 172.21.15.22:0/1739469869 learned_addr learned my addr 172.21.15.22:0/1739469869 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:55.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50ab41640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe50410c170 0x7fe504101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:55.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe509b3f640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe504103660 0x7fe504100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:55.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50a340640 1 -- 172.21.15.22:0/1739469869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe504103660 msgr2=0x7fe504100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:55.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50a340640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe504103660 0x7fe504100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:55.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50a340640 1 -- 172.21.15.22:0/1739469869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe50410c170 msgr2=0x7fe504101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:55.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50a340640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe50410c170 0x7fe504101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:55.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50a340640 1 -- 172.21.15.22:0/1739469869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5041a68a0 con 0x7fe504102d40 2024-09-10T08:07:55.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50ab41640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe50410c170 0x7fe504101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:07:55.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50a340640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe504102d40 0x7fe5041009a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe50000c920 tx=0x7fe50000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:55.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe4fb7fe640 1 -- 172.21.15.22:0/1739469869 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500007c70 con 0x7fe504102d40 2024-09-10T08:07:55.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50c5a4640 1 -- 172.21.15.22:0/1739469869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5041a6b90 con 0x7fe504102d40 2024-09-10T08:07:55.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe4fb7fe640 1 -- 172.21.15.22:0/1739469869 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe500007e10 con 0x7fe504102d40 2024-09-10T08:07:55.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe4fb7fe640 1 -- 172.21.15.22:0/1739469869 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500018890 con 0x7fe504102d40 2024-09-10T08:07:55.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.298+0000 7fe50c5a4640 1 -- 172.21.15.22:0/1739469869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5041a70d0 con 0x7fe504102d40 2024-09-10T08:07:55.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.300+0000 7fe50c5a4640 1 -- 172.21.15.22:0/1739469869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe504103120 con 0x7fe504102d40 2024-09-10T08:07:55.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.301+0000 7fe4fb7fe640 1 -- 172.21.15.22:0/1739469869 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe500018a50 con 0x7fe504102d40 2024-09-10T08:07:55.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.302+0000 7fe4fb7fe640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe4f00a2c10 0x7fe4f00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:55.441 INFO:teuthology.orchestra.run.smithi022.stdout:270582939683 2024-09-10T08:07:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.302+0000 7fe4fb7fe640 1 -- 172.21.15.22:0/1739469869 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe5000cf600 con 0x7fe504102d40 2024-09-10T08:07:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.302+0000 7fe509b3f640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe4f00a2c10 0x7fe4f00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.303+0000 7fe509b3f640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe4f00a2c10 0x7fe4f00a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe504102430 tx=0x7fe4f4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.306+0000 7fe4fb7fe640 1 -- 172.21.15.22:0/1739469869 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe500014030 con 0x7fe504102d40 2024-09-10T08:07:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.483+0000 7fe50c5a4640 1 -- 172.21.15.22:0/1739469869 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fe504101ed0 con 0x7fe504102d40 2024-09-10T08:07:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.483+0000 7fe4fb7fe640 1 -- 172.21.15.22:0/1739469869 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe50009c490 con 0x7fe504102d40 2024-09-10T08:07:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.486+0000 7fe50c5a4640 1 -- 172.21.15.22:0/1739469869 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe4f00a2c10 msgr2=0x7fe4f00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.486+0000 7fe50c5a4640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe4f00a2c10 0x7fe4f00a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe504102430 tx=0x7fe4f4005a20 comp rx=0 tx=0).stop 2024-09-10T08:07:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.486+0000 7fe50c5a4640 1 -- 172.21.15.22:0/1739469869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe504102d40 msgr2=0x7fe5041009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.486+0000 7fe50c5a4640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe504102d40 0x7fe5041009a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe50000c920 tx=0x7fe50000cde0 comp rx=0 tx=0).stop 2024-09-10T08:07:55.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.486+0000 7fe50c5a4640 1 -- 172.21.15.22:0/1739469869 shutdown_connections 2024-09-10T08:07:55.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.486+0000 7fe50c5a4640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe4f00a2c10 0x7fe4f00a50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:55.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.486+0000 7fe50c5a4640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe50410c170 0x7fe504101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:55.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.486+0000 7fe50c5a4640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe504103660 0x7fe504100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:55.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.486+0000 7fe50c5a4640 1 --2- 172.21.15.22:0/1739469869 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe504102d40 0x7fe5041009a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:55.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.486+0000 7fe50c5a4640 1 -- 172.21.15.22:0/1739469869 >> 172.21.15.22:0/1739469869 conn(0x7fe5040fc7a0 msgr2=0x7fe5040fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:55.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.486+0000 7fe50c5a4640 1 -- 172.21.15.22:0/1739469869 shutdown_connections 2024-09-10T08:07:55.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:52.486+0000 7fe50c5a4640 1 -- 172.21.15.22:0/1739469869 wait complete. 2024-09-10T08:07:56.046 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939679 got 270582939683 for osd.9 2024-09-10T08:07:56.046 DEBUG:teuthology.parallel:result is None 2024-09-10T08:07:56.458 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168614 got 240518168616 for osd.8 2024-09-10T08:07:56.459 DEBUG:teuthology.parallel:result is None 2024-09-10T08:07:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.640+0000 7f42f55d7640 1 -- 172.21.15.22:0/4249279930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f010e450 msgr2=0x7f42f0110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.640+0000 7f42f55d7640 1 --2- 172.21.15.22:0/4249279930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f010e450 0x7f42f0110840 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f42e0009ca0 tx=0x7f42e002a950 comp rx=0 tx=0).stop 2024-09-10T08:07:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.640+0000 7f42f55d7640 1 -- 172.21.15.22:0/4249279930 shutdown_connections 2024-09-10T08:07:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.640+0000 7f42f55d7640 1 --2- 172.21.15.22:0/4249279930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f010e450 0x7f42f0110840 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.640+0000 7f42f55d7640 1 --2- 172.21.15.22:0/4249279930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42f0074e30 0x7f42f010df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.640+0000 7f42f55d7640 1 --2- 172.21.15.22:0/4249279930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42f0074510 0x7f42f00748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:56.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.640+0000 7f42f55d7640 1 -- 172.21.15.22:0/4249279930 >> 172.21.15.22:0/4249279930 conn(0x7f42f00fd8f0 msgr2=0x7f42f00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:56.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.640+0000 7f42f55d7640 1 -- 172.21.15.22:0/4249279930 shutdown_connections 2024-09-10T08:07:56.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.640+0000 7f42f55d7640 1 -- 172.21.15.22:0/4249279930 wait complete. 2024-09-10T08:07:56.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42f55d7640 1 Processor -- start 2024-09-10T08:07:56.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42f55d7640 1 -- start start 2024-09-10T08:07:56.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42f55d7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42f0074510 0x7f42f019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:56.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42f55d7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f0074e30 0x7f42f019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:56.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42f55d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42f010e450 0x7f42f019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:56.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42f55d7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f42f0114170 con 0x7f42f0074e30 2024-09-10T08:07:56.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42f55d7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f42f0113ff0 con 0x7f42f010e450 2024-09-10T08:07:56.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42f55d7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f42f01142f0 con 0x7f42f0074510 2024-09-10T08:07:56.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42ee7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f0074e30 0x7f42f019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42ee7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f0074e30 0x7f42f019ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49546/0 (socket says 172.21.15.22:49546) 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42ee7fc640 1 -- 172.21.15.22:0/2776438004 learned_addr learned my addr 172.21.15.22:0/2776438004 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42eeffd640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42f0074510 0x7f42f019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.641+0000 7f42ef7fe640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42f010e450 0x7f42f019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.642+0000 7f42ee7fc640 1 -- 172.21.15.22:0/2776438004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42f0074510 msgr2=0x7f42f019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.642+0000 7f42ee7fc640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42f0074510 0x7f42f019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.642+0000 7f42ee7fc640 1 -- 172.21.15.22:0/2776438004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42f010e450 msgr2=0x7f42f019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.642+0000 7f42ee7fc640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42f010e450 0x7f42f019f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.642+0000 7f42ee7fc640 1 -- 172.21.15.22:0/2776438004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f019f6e0 con 0x7f42f0074e30 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.642+0000 7f42ee7fc640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f0074e30 0x7f42f019ac70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f42d800c920 tx=0x7f42d800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.642+0000 7f42e7fff640 1 -- 172.21.15.22:0/2776438004 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d8007c70 con 0x7f42f0074e30 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.642+0000 7f42e7fff640 1 -- 172.21.15.22:0/2776438004 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42d8007e10 con 0x7f42f0074e30 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.642+0000 7f42f55d7640 1 -- 172.21.15.22:0/2776438004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f019f9d0 con 0x7f42f0074e30 2024-09-10T08:07:56.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.642+0000 7f42e7fff640 1 -- 172.21.15.22:0/2776438004 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d8018890 con 0x7f42f0074e30 2024-09-10T08:07:56.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.642+0000 7f42f55d7640 1 -- 172.21.15.22:0/2776438004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f01a72b0 con 0x7f42f0074e30 2024-09-10T08:07:56.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.643+0000 7f42f55d7640 1 -- 172.21.15.22:0/2776438004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f00748f0 con 0x7f42f0074e30 2024-09-10T08:07:56.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.645+0000 7f42e7fff640 1 -- 172.21.15.22:0/2776438004 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f42d8018a70 con 0x7f42f0074e30 2024-09-10T08:07:56.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.646+0000 7f42e7fff640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f42dc0a2c90 0x7f42dc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:56.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.646+0000 7f42eeffd640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f42dc0a2c90 0x7f42dc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:56.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.646+0000 7f42e7fff640 1 -- 172.21.15.22:0/2776438004 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f42d80cf4c0 con 0x7f42f0074e30 2024-09-10T08:07:56.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.647+0000 7f42eeffd640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f42dc0a2c90 0x7f42dc0a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f42e8005fd0 tx=0x7f42e800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:56.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.650+0000 7f42e7fff640 1 -- 172.21.15.22:0/2776438004 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42d8014030 con 0x7f42f0074e30 2024-09-10T08:07:56.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.849+0000 7f42f55d7640 1 -- 172.21.15.22:0/2776438004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f42f019ba90 con 0x7f42f0074e30 2024-09-10T08:07:56.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.850+0000 7f42e7fff640 1 -- 172.21.15.22:0/2776438004 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f42f019ba90 con 0x7f42f0074e30 2024-09-10T08:07:56.849 INFO:teuthology.orchestra.run.smithi022.stdout:322122547226 2024-09-10T08:07:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.852+0000 7f42f55d7640 1 -- 172.21.15.22:0/2776438004 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f42dc0a2c90 msgr2=0x7f42dc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.852+0000 7f42f55d7640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f42dc0a2c90 0x7f42dc0a5150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f42e8005fd0 tx=0x7f42e800b390 comp rx=0 tx=0).stop 2024-09-10T08:07:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.852+0000 7f42f55d7640 1 -- 172.21.15.22:0/2776438004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f0074e30 msgr2=0x7f42f019ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:56.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.852+0000 7f42f55d7640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f0074e30 0x7f42f019ac70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f42d800c920 tx=0x7f42d800cde0 comp rx=0 tx=0).stop 2024-09-10T08:07:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.852+0000 7f42f55d7640 1 -- 172.21.15.22:0/2776438004 shutdown_connections 2024-09-10T08:07:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.852+0000 7f42f55d7640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f42dc0a2c90 0x7f42dc0a5150 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.852+0000 7f42f55d7640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42f010e450 0x7f42f019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.852+0000 7f42f55d7640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42f0074e30 0x7f42f019ac70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.852+0000 7f42f55d7640 1 --2- 172.21.15.22:0/2776438004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42f0074510 0x7f42f019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.852+0000 7f42f55d7640 1 -- 172.21.15.22:0/2776438004 >> 172.21.15.22:0/2776438004 conn(0x7f42f00fd8f0 msgr2=0x7f42f00fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.852+0000 7f42f55d7640 1 -- 172.21.15.22:0/2776438004 shutdown_connections 2024-09-10T08:07:56.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:56.852+0000 7f42f55d7640 1 -- 172.21.15.22:0/2776438004 wait complete. 2024-09-10T08:07:57.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:56 smithi022 ceph-mon[30854]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:07:57.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:56 smithi100 ceph-mon[35102]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:07:57.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:56 smithi153 ceph-mon[35609]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:07:58.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:57 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2776438004' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T08:07:58.036 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547223 got 322122547226 for osd.11 2024-09-10T08:07:58.036 DEBUG:teuthology.parallel:result is None 2024-09-10T08:07:58.036 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T08:07:58.037 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T08:07:58.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:57 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2776438004' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T08:07:58.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:57 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2776438004' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-10T08:07:58.329 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:07:58.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.825+0000 7fc21e255640 1 -- 172.21.15.22:0/139754170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc218102df0 msgr2=0x7fc2181031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:58.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.825+0000 7fc21e255640 1 --2- 172.21.15.22:0/139754170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc218102df0 0x7fc2181031d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc208009ca0 tx=0x7fc20802a8e0 comp rx=0 tx=0).stop 2024-09-10T08:07:58.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.825+0000 7fc21e255640 1 -- 172.21.15.22:0/139754170 shutdown_connections 2024-09-10T08:07:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.825+0000 7fc21e255640 1 --2- 172.21.15.22:0/139754170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21810c2f0 0x7fc21810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.825+0000 7fc21e255640 1 --2- 172.21.15.22:0/139754170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2181037a0 0x7fc21810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.825+0000 7fc21e255640 1 --2- 172.21.15.22:0/139754170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc218102df0 0x7fc2181031d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.825+0000 7fc21e255640 1 -- 172.21.15.22:0/139754170 >> 172.21.15.22:0/139754170 conn(0x7fc2180fc7d0 msgr2=0x7fc2180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.825+0000 7fc21e255640 1 -- 172.21.15.22:0/139754170 shutdown_connections 2024-09-10T08:07:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.826+0000 7fc21e255640 1 -- 172.21.15.22:0/139754170 wait complete. 2024-09-10T08:07:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.826+0000 7fc21e255640 1 Processor -- start 2024-09-10T08:07:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc21e255640 1 -- start start 2024-09-10T08:07:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc21e255640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc218102df0 0x7fc2181986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc21e255640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2181037a0 0x7fc218198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:58.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc21e255640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21810c2f0 0x7fc21819cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc21e255640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc2181121d0 con 0x7fc218102df0 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc21e255640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc218112050 con 0x7fc2181037a0 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc21e255640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc218112350 con 0x7fc21810c2f0 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc2177fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc218102df0 0x7fc2181986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc2177fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc218102df0 0x7fc2181986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49566/0 (socket says 172.21.15.22:49566) 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc2177fe640 1 -- 172.21.15.22:0/251937456 learned_addr learned my addr 172.21.15.22:0/251937456 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc216ffd640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2181037a0 0x7fc218198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc2177fe640 1 -- 172.21.15.22:0/251937456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21810c2f0 msgr2=0x7fc21819cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc217fff640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21810c2f0 0x7fc21819cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc2177fe640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21810c2f0 0x7fc21819cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc2177fe640 1 -- 172.21.15.22:0/251937456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2181037a0 msgr2=0x7fc218198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc2177fe640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2181037a0 0x7fc218198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:58.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc2177fe640 1 -- 172.21.15.22:0/251937456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21819d680 con 0x7fc218102df0 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.827+0000 7fc217fff640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21810c2f0 0x7fc21819cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.828+0000 7fc2177fe640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc218102df0 0x7fc2181986d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc20802ae00 tx=0x7fc208003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.828+0000 7fc214ff9640 1 -- 172.21.15.22:0/251937456 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208004040 con 0x7fc218102df0 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.828+0000 7fc214ff9640 1 -- 172.21.15.22:0/251937456 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2080046c0 con 0x7fc218102df0 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.828+0000 7fc21e255640 1 -- 172.21.15.22:0/251937456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21819d910 con 0x7fc218102df0 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.828+0000 7fc214ff9640 1 -- 172.21.15.22:0/251937456 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208030de0 con 0x7fc218102df0 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.828+0000 7fc21e255640 1 -- 172.21.15.22:0/251937456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2181a5250 con 0x7fc218102df0 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.829+0000 7fc21e255640 1 -- 172.21.15.22:0/251937456 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2181031d0 con 0x7fc218102df0 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.830+0000 7fc214ff9640 1 -- 172.21.15.22:0/251937456 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc2080305e0 con 0x7fc218102df0 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.831+0000 7fc214ff9640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc2000a2c10 0x7fc2000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.831+0000 7fc214ff9640 1 -- 172.21.15.22:0/251937456 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc2080f0760 con 0x7fc218102df0 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.831+0000 7fc216ffd640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc2000a2c10 0x7fc2000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:07:58.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.832+0000 7fc216ffd640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc2000a2c10 0x7fc2000a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc21810d740 tx=0x7fc20c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:07:58.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:58.834+0000 7fc214ff9640 1 -- 172.21.15.22:0/251937456 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc20803ae60 con 0x7fc218102df0 2024-09-10T08:07:59.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:58 smithi022 ceph-mon[30854]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:07:59.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.014+0000 7fc21e255640 1 -- 172.21.15.22:0/251937456 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc218062630 con 0x7fc2000a2c10 2024-09-10T08:07:59.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.021+0000 7fc214ff9640 1 -- 172.21.15.22:0/251937456 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259010 (secure 0 0 0) 0x7fc218062630 con 0x7fc2000a2c10 2024-09-10T08:07:59.023 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:07:59.024 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-10T08:07:59.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.025+0000 7fc21e255640 1 -- 172.21.15.22:0/251937456 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc2000a2c10 msgr2=0x7fc2000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:59.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.025+0000 7fc21e255640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc2000a2c10 0x7fc2000a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc21810d740 tx=0x7fc20c009110 comp rx=0 tx=0).stop 2024-09-10T08:07:59.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.025+0000 7fc21e255640 1 -- 172.21.15.22:0/251937456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc218102df0 msgr2=0x7fc2181986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:07:59.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.025+0000 7fc21e255640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc218102df0 0x7fc2181986d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc20802ae00 tx=0x7fc208003ba0 comp rx=0 tx=0).stop 2024-09-10T08:07:59.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.025+0000 7fc21e255640 1 -- 172.21.15.22:0/251937456 shutdown_connections 2024-09-10T08:07:59.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.025+0000 7fc21e255640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc2000a2c10 0x7fc2000a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:59.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.025+0000 7fc21e255640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21810c2f0 0x7fc21819cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:59.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.025+0000 7fc21e255640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2181037a0 0x7fc218198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:59.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.025+0000 7fc21e255640 1 --2- 172.21.15.22:0/251937456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc218102df0 0x7fc2181986d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:07:59.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.025+0000 7fc21e255640 1 -- 172.21.15.22:0/251937456 >> 172.21.15.22:0/251937456 conn(0x7fc2180fc7d0 msgr2=0x7fc2180fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:07:59.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.025+0000 7fc21e255640 1 -- 172.21.15.22:0/251937456 shutdown_connections 2024-09-10T08:07:59.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:07:59.025+0000 7fc21e255640 1 -- 172.21.15.22:0/251937456 wait complete. 2024-09-10T08:07:59.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:58 smithi100 ceph-mon[35102]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:07:59.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:58 smithi153 ceph-mon[35609]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:07:59.705 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-10T08:07:58.957938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658616,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":706,"num_read_kb":481,"num_write":422,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360440,"kb_used_data":11184,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581384,"statfs":{"total":1151940427776,"available":1151571337216,"internally_reserved":0,"allocated":11452416,"data_stored":7213140,"data_compressed":178551,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002969"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.410188+0000","last_change":"2024-09-10T08:06:53.919814+0000","last_active":"2024-09-10T08:07:02.410188+0000","last_peered":"2024-09-10T08:07:02.410188+0000","last_clean":"2024-09-10T08:07:02.410188+0000","last_became_active":"2024-09-10T08:06:53.919460+0000","last_became_peered":"2024-09-10T08:06:53.919460+0000","last_unstale":"2024-09-10T08:07:02.410188+0000","last_undegraded":"2024-09-10T08:07:02.410188+0000","last_fullsized":"2024-09-10T08:07:02.410188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:39.027064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408512+0000","last_change":"2024-09-10T08:06:53.921645+0000","last_active":"2024-09-10T08:07:02.408512+0000","last_peered":"2024-09-10T08:07:02.408512+0000","last_clean":"2024-09-10T08:07:02.408512+0000","last_became_active":"2024-09-10T08:06:53.921346+0000","last_became_peered":"2024-09-10T08:06:53.921346+0000","last_unstale":"2024-09-10T08:07:02.408512+0000","last_undegraded":"2024-09-10T08:07:02.408512+0000","last_fullsized":"2024-09-10T08:07:02.408512+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:48.830824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408729+0000","last_change":"2024-09-10T08:06:53.920736+0000","last_active":"2024-09-10T08:07:02.408729+0000","last_peered":"2024-09-10T08:07:02.408729+0000","last_clean":"2024-09-10T08:07:02.408729+0000","last_became_active":"2024-09-10T08:06:53.920422+0000","last_became_peered":"2024-09-10T08:06:53.920422+0000","last_unstale":"2024-09-10T08:07:02.408729+0000","last_undegraded":"2024-09-10T08:07:02.408729+0000","last_fullsized":"2024-09-10T08:07:02.408729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:32.025610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.413898+0000","last_change":"2024-09-10T08:07:02.413480+0000","last_active":"2024-09-10T08:07:02.413898+0000","last_peered":"2024-09-10T08:07:02.413898+0000","last_clean":"2024-09-10T08:07:02.413898+0000","last_became_active":"2024-09-10T08:07:02.413146+0000","last_became_peered":"2024-09-10T08:07:02.413146+0000","last_unstale":"2024-09-10T08:07:02.413898+0000","last_undegraded":"2024-09-10T08:07:02.413898+0000","last_fullsized":"2024-09-10T08:07:02.413898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:47.348670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411798+0000","last_change":"2024-09-10T08:06:53.915703+0000","last_active":"2024-09-10T08:07:02.411798+0000","last_peered":"2024-09-10T08:07:02.411798+0000","last_clean":"2024-09-10T08:07:02.411798+0000","last_became_active":"2024-09-10T08:06:53.915375+0000","last_became_peered":"2024-09-10T08:06:53.915375+0000","last_unstale":"2024-09-10T08:07:02.411798+0000","last_undegraded":"2024-09-10T08:07:02.411798+0000","last_fullsized":"2024-09-10T08:07:02.411798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:40.425133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427232+0000","last_change":"2024-09-10T08:06:53.927711+0000","last_active":"2024-09-10T08:07:02.427232+0000","last_peered":"2024-09-10T08:07:02.427232+0000","last_clean":"2024-09-10T08:07:02.427232+0000","last_became_active":"2024-09-10T08:06:53.927398+0000","last_became_peered":"2024-09-10T08:06:53.927398+0000","last_unstale":"2024-09-10T08:07:02.427232+0000","last_undegraded":"2024-09-10T08:07:02.427232+0000","last_fullsized":"2024-09-10T08:07:02.427232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:00.614829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409283+0000","last_change":"2024-09-10T08:06:53.924069+0000","last_active":"2024-09-10T08:07:02.409283+0000","last_peered":"2024-09-10T08:07:02.409283+0000","last_clean":"2024-09-10T08:07:02.409283+0000","last_became_active":"2024-09-10T08:06:53.923743+0000","last_became_peered":"2024-09-10T08:06:53.923743+0000","last_unstale":"2024-09-10T08:07:02.409283+0000","last_undegraded":"2024-09-10T08:07:02.409283+0000","last_fullsized":"2024-09-10T08:07:02.409283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:18.943432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428903+0000","last_change":"2024-09-10T08:06:53.921446+0000","last_active":"2024-09-10T08:07:02.428903+0000","last_peered":"2024-09-10T08:07:02.428903+0000","last_clean":"2024-09-10T08:07:02.428903+0000","last_became_active":"2024-09-10T08:06:53.921141+0000","last_became_peered":"2024-09-10T08:06:53.921141+0000","last_unstale":"2024-09-10T08:07:02.428903+0000","last_undegraded":"2024-09-10T08:07:02.428903+0000","last_fullsized":"2024-09-10T08:07:02.428903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:58.255095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428152+0000","last_change":"2024-09-10T08:06:53.919967+0000","last_active":"2024-09-10T08:07:02.428152+0000","last_peered":"2024-09-10T08:07:02.428152+0000","last_clean":"2024-09-10T08:07:02.428152+0000","last_became_active":"2024-09-10T08:06:53.919600+0000","last_became_peered":"2024-09-10T08:06:53.919600+0000","last_unstale":"2024-09-10T08:07:02.428152+0000","last_undegraded":"2024-09-10T08:07:02.428152+0000","last_fullsized":"2024-09-10T08:07:02.428152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:32.298128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428189+0000","last_change":"2024-09-10T08:06:53.925851+0000","last_active":"2024-09-10T08:07:02.428189+0000","last_peered":"2024-09-10T08:07:02.428189+0000","last_clean":"2024-09-10T08:07:02.428189+0000","last_became_active":"2024-09-10T08:06:53.925548+0000","last_became_peered":"2024-09-10T08:06:53.925548+0000","last_unstale":"2024-09-10T08:07:02.428189+0000","last_undegraded":"2024-09-10T08:07:02.428189+0000","last_fullsized":"2024-09-10T08:07:02.428189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:11.231320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409681+0000","last_change":"2024-09-10T08:06:53.935162+0000","last_active":"2024-09-10T08:07:02.409681+0000","last_peered":"2024-09-10T08:07:02.409681+0000","last_clean":"2024-09-10T08:07:02.409681+0000","last_became_active":"2024-09-10T08:06:53.934790+0000","last_became_peered":"2024-09-10T08:06:53.934790+0000","last_unstale":"2024-09-10T08:07:02.409681+0000","last_undegraded":"2024-09-10T08:07:02.409681+0000","last_fullsized":"2024-09-10T08:07:02.409681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:10.729869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407066+0000","last_change":"2024-09-10T08:06:53.926420+0000","last_active":"2024-09-10T08:07:02.407066+0000","last_peered":"2024-09-10T08:07:02.407066+0000","last_clean":"2024-09-10T08:07:02.407066+0000","last_became_active":"2024-09-10T08:06:53.925016+0000","last_became_peered":"2024-09-10T08:06:53.925016+0000","last_unstale":"2024-09-10T08:07:02.407066+0000","last_undegraded":"2024-09-10T08:07:02.407066+0000","last_fullsized":"2024-09-10T08:07:02.407066+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:07.459413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428465+0000","last_change":"2024-09-10T08:06:53.922632+0000","last_active":"2024-09-10T08:07:02.428465+0000","last_peered":"2024-09-10T08:07:02.428465+0000","last_clean":"2024-09-10T08:07:02.428465+0000","last_became_active":"2024-09-10T08:06:53.922328+0000","last_became_peered":"2024-09-10T08:06:53.922328+0000","last_unstale":"2024-09-10T08:07:02.428465+0000","last_undegraded":"2024-09-10T08:07:02.428465+0000","last_fullsized":"2024-09-10T08:07:02.428465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:14.136508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408385+0000","last_change":"2024-09-10T08:06:53.922697+0000","last_active":"2024-09-10T08:07:02.408385+0000","last_peered":"2024-09-10T08:07:02.408385+0000","last_clean":"2024-09-10T08:07:02.408385+0000","last_became_active":"2024-09-10T08:06:53.922392+0000","last_became_peered":"2024-09-10T08:06:53.922392+0000","last_unstale":"2024-09-10T08:07:02.408385+0000","last_undegraded":"2024-09-10T08:07:02.408385+0000","last_fullsized":"2024-09-10T08:07:02.408385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:24.823244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408339+0000","last_change":"2024-09-10T08:06:53.926966+0000","last_active":"2024-09-10T08:07:02.408339+0000","last_peered":"2024-09-10T08:07:02.408339+0000","last_clean":"2024-09-10T08:07:02.408339+0000","last_became_active":"2024-09-10T08:06:53.926611+0000","last_became_peered":"2024-09-10T08:06:53.926611+0000","last_unstale":"2024-09-10T08:07:02.408339+0000","last_undegraded":"2024-09-10T08:07:02.408339+0000","last_fullsized":"2024-09-10T08:07:02.408339+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:20.810104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428439+0000","last_change":"2024-09-10T08:06:53.928443+0000","last_active":"2024-09-10T08:07:02.428439+0000","last_peered":"2024-09-10T08:07:02.428439+0000","last_clean":"2024-09-10T08:07:02.428439+0000","last_became_active":"2024-09-10T08:06:53.926742+0000","last_became_peered":"2024-09-10T08:06:53.926742+0000","last_unstale":"2024-09-10T08:07:02.428439+0000","last_undegraded":"2024-09-10T08:07:02.428439+0000","last_fullsized":"2024-09-10T08:07:02.428439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:46.056335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.410219+0000","last_change":"2024-09-10T08:06:53.922295+0000","last_active":"2024-09-10T08:07:02.410219+0000","last_peered":"2024-09-10T08:07:02.410219+0000","last_clean":"2024-09-10T08:07:02.410219+0000","last_became_active":"2024-09-10T08:06:53.921920+0000","last_became_peered":"2024-09-10T08:06:53.921920+0000","last_unstale":"2024-09-10T08:07:02.410219+0000","last_undegraded":"2024-09-10T08:07:02.410219+0000","last_fullsized":"2024-09-10T08:07:02.410219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:41.005973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.406177+0000","last_change":"2024-09-10T08:06:53.926107+0000","last_active":"2024-09-10T08:07:02.406177+0000","last_peered":"2024-09-10T08:07:02.406177+0000","last_clean":"2024-09-10T08:07:02.406177+0000","last_became_active":"2024-09-10T08:06:53.925763+0000","last_became_peered":"2024-09-10T08:06:53.925763+0000","last_unstale":"2024-09-10T08:07:02.406177+0000","last_undegraded":"2024-09-10T08:07:02.406177+0000","last_fullsized":"2024-09-10T08:07:02.406177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:25.756418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407360+0000","last_change":"2024-09-10T08:06:53.917946+0000","last_active":"2024-09-10T08:07:02.407360+0000","last_peered":"2024-09-10T08:07:02.407360+0000","last_clean":"2024-09-10T08:07:02.407360+0000","last_became_active":"2024-09-10T08:06:53.917597+0000","last_became_peered":"2024-09-10T08:06:53.917597+0000","last_unstale":"2024-09-10T08:07:02.407360+0000","last_undegraded":"2024-09-10T08:07:02.407360+0000","last_fullsized":"2024-09-10T08:07:02.407360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:36.218971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409658+0000","last_change":"2024-09-10T08:06:53.926365+0000","last_active":"2024-09-10T08:07:02.409658+0000","last_peered":"2024-09-10T08:07:02.409658+0000","last_clean":"2024-09-10T08:07:02.409658+0000","last_became_active":"2024-09-10T08:06:53.926045+0000","last_became_peered":"2024-09-10T08:06:53.926045+0000","last_unstale":"2024-09-10T08:07:02.409658+0000","last_undegraded":"2024-09-10T08:07:02.409658+0000","last_fullsized":"2024-09-10T08:07:02.409658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:31.300495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428586+0000","last_change":"2024-09-10T08:06:53.924758+0000","last_active":"2024-09-10T08:07:02.428586+0000","last_peered":"2024-09-10T08:07:02.428586+0000","last_clean":"2024-09-10T08:07:02.428586+0000","last_became_active":"2024-09-10T08:06:53.924456+0000","last_became_peered":"2024-09-10T08:06:53.924456+0000","last_unstale":"2024-09-10T08:07:02.428586+0000","last_undegraded":"2024-09-10T08:07:02.428586+0000","last_fullsized":"2024-09-10T08:07:02.428586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:23.912453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427744+0000","last_change":"2024-09-10T08:06:53.929854+0000","last_active":"2024-09-10T08:07:02.427744+0000","last_peered":"2024-09-10T08:07:02.427744+0000","last_clean":"2024-09-10T08:07:02.427744+0000","last_became_active":"2024-09-10T08:06:53.929537+0000","last_became_peered":"2024-09-10T08:06:53.929537+0000","last_unstale":"2024-09-10T08:07:02.427744+0000","last_undegraded":"2024-09-10T08:07:02.427744+0000","last_fullsized":"2024-09-10T08:07:02.427744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:42.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.412582+0000","last_change":"2024-09-10T08:07:02.412169+0000","last_active":"2024-09-10T08:07:02.412582+0000","last_peered":"2024-09-10T08:07:02.412582+0000","last_clean":"2024-09-10T08:07:02.412582+0000","last_became_active":"2024-09-10T08:07:02.411592+0000","last_became_peered":"2024-09-10T08:07:02.411592+0000","last_unstale":"2024-09-10T08:07:02.412582+0000","last_undegraded":"2024-09-10T08:07:02.412582+0000","last_fullsized":"2024-09-10T08:07:02.412582+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:43.477920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.413886+0000","last_change":"2024-09-10T08:06:53.915136+0000","last_active":"2024-09-10T08:07:02.413886+0000","last_peered":"2024-09-10T08:07:02.413886+0000","last_clean":"2024-09-10T08:07:02.413886+0000","last_became_active":"2024-09-10T08:06:53.914825+0000","last_became_peered":"2024-09-10T08:06:53.914825+0000","last_unstale":"2024-09-10T08:07:02.413886+0000","last_undegraded":"2024-09-10T08:07:02.413886+0000","last_fullsized":"2024-09-10T08:07:02.413886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:17.619930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428479+0000","last_change":"2024-09-10T08:06:53.925991+0000","last_active":"2024-09-10T08:07:02.428479+0000","last_peered":"2024-09-10T08:07:02.428479+0000","last_clean":"2024-09-10T08:07:02.428479+0000","last_became_active":"2024-09-10T08:06:53.925657+0000","last_became_peered":"2024-09-10T08:06:53.925657+0000","last_unstale":"2024-09-10T08:07:02.428479+0000","last_undegraded":"2024-09-10T08:07:02.428479+0000","last_fullsized":"2024-09-10T08:07:02.428479+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:54.562209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407466+0000","last_change":"2024-09-10T08:06:53.931858+0000","last_active":"2024-09-10T08:07:02.407466+0000","last_peered":"2024-09-10T08:07:02.407466+0000","last_clean":"2024-09-10T08:07:02.407466+0000","last_became_active":"2024-09-10T08:06:53.931520+0000","last_became_peered":"2024-09-10T08:06:53.931520+0000","last_unstale":"2024-09-10T08:07:02.407466+0000","last_undegraded":"2024-09-10T08:07:02.407466+0000","last_fullsized":"2024-09-10T08:07:02.407466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:12.750769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409564+0000","last_change":"2024-09-10T08:06:53.915466+0000","last_active":"2024-09-10T08:07:02.409564+0000","last_peered":"2024-09-10T08:07:02.409564+0000","last_clean":"2024-09-10T08:07:02.409564+0000","last_became_active":"2024-09-10T08:06:53.915115+0000","last_became_peered":"2024-09-10T08:06:53.915115+0000","last_unstale":"2024-09-10T08:07:02.409564+0000","last_undegraded":"2024-09-10T08:07:02.409564+0000","last_fullsized":"2024-09-10T08:07:02.409564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:05.436530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428345+0000","last_change":"2024-09-10T08:06:53.928001+0000","last_active":"2024-09-10T08:07:02.428345+0000","last_peered":"2024-09-10T08:07:02.428345+0000","last_clean":"2024-09-10T08:07:02.428345+0000","last_became_active":"2024-09-10T08:06:53.927693+0000","last_became_peered":"2024-09-10T08:06:53.927693+0000","last_unstale":"2024-09-10T08:07:02.428345+0000","last_undegraded":"2024-09-10T08:07:02.428345+0000","last_fullsized":"2024-09-10T08:07:02.428345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:30.712600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408691+0000","last_change":"2024-09-10T08:06:53.927006+0000","last_active":"2024-09-10T08:07:02.408691+0000","last_peered":"2024-09-10T08:07:02.408691+0000","last_clean":"2024-09-10T08:07:02.408691+0000","last_became_active":"2024-09-10T08:06:53.925607+0000","last_became_peered":"2024-09-10T08:06:53.925607+0000","last_unstale":"2024-09-10T08:07:02.408691+0000","last_undegraded":"2024-09-10T08:07:02.408691+0000","last_fullsized":"2024-09-10T08:07:02.408691+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:31.640763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407216+0000","last_change":"2024-09-10T08:06:53.917197+0000","last_active":"2024-09-10T08:07:02.407216+0000","last_peered":"2024-09-10T08:07:02.407216+0000","last_clean":"2024-09-10T08:07:02.407216+0000","last_became_active":"2024-09-10T08:06:53.916830+0000","last_became_peered":"2024-09-10T08:06:53.916830+0000","last_unstale":"2024-09-10T08:07:02.407216+0000","last_undegraded":"2024-09-10T08:07:02.407216+0000","last_fullsized":"2024-09-10T08:07:02.407216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:00.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.416146+0000","last_change":"2024-09-10T08:07:02.416146+0000","last_active":"2024-09-10T08:07:02.416146+0000","last_peered":"2024-09-10T08:07:02.416146+0000","last_clean":"2024-09-10T08:07:02.416146+0000","last_became_active":"2024-09-10T08:07:02.415734+0000","last_became_peered":"2024-09-10T08:07:02.415734+0000","last_unstale":"2024-09-10T08:07:02.416146+0000","last_undegraded":"2024-09-10T08:07:02.416146+0000","last_fullsized":"2024-09-10T08:07:02.416146+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:26.811995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409617+0000","last_change":"2024-09-10T08:06:53.923406+0000","last_active":"2024-09-10T08:07:02.409617+0000","last_peered":"2024-09-10T08:07:02.409617+0000","last_clean":"2024-09-10T08:07:02.409617+0000","last_became_active":"2024-09-10T08:06:53.923012+0000","last_became_peered":"2024-09-10T08:06:53.923012+0000","last_unstale":"2024-09-10T08:07:02.409617+0000","last_undegraded":"2024-09-10T08:07:02.409617+0000","last_fullsized":"2024-09-10T08:07:02.409617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:39.426727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411368+0000","last_change":"2024-09-10T08:06:53.914764+0000","last_active":"2024-09-10T08:07:02.411368+0000","last_peered":"2024-09-10T08:07:02.411368+0000","last_clean":"2024-09-10T08:07:02.411368+0000","last_became_active":"2024-09-10T08:06:53.914431+0000","last_became_peered":"2024-09-10T08:06:53.914431+0000","last_unstale":"2024-09-10T08:07:02.411368+0000","last_undegraded":"2024-09-10T08:07:02.411368+0000","last_fullsized":"2024-09-10T08:07:02.411368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:29.703828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:53.537675+0000","last_change":"2024-09-10T08:06:51.854086+0000","last_active":"2024-09-10T08:07:53.537675+0000","last_peered":"2024-09-10T08:07:53.537675+0000","last_clean":"2024-09-10T08:07:53.537675+0000","last_became_active":"2024-09-10T08:06:51.853394+0000","last_became_peered":"2024-09-10T08:06:51.853394+0000","last_unstale":"2024-09-10T08:07:53.537675+0000","last_undegraded":"2024-09-10T08:07:53.537675+0000","last_fullsized":"2024-09-10T08:07:53.537675+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:33.688809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.414270+0000","last_change":"2024-09-10T08:06:53.927461+0000","last_active":"2024-09-10T08:07:02.414270+0000","last_peered":"2024-09-10T08:07:02.414270+0000","last_clean":"2024-09-10T08:07:02.414270+0000","last_became_active":"2024-09-10T08:06:53.927152+0000","last_became_peered":"2024-09-10T08:06:53.927152+0000","last_unstale":"2024-09-10T08:07:02.414270+0000","last_undegraded":"2024-09-10T08:07:02.414270+0000","last_fullsized":"2024-09-10T08:07:02.414270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:12.001671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.444057+0000","last_change":"2024-09-10T08:06:51.848621+0000","last_active":"2024-09-10T08:07:04.444057+0000","last_peered":"2024-09-10T08:07:04.444057+0000","last_clean":"2024-09-10T08:07:04.444057+0000","last_became_active":"2024-09-10T08:06:51.848239+0000","last_became_peered":"2024-09-10T08:06:51.848239+0000","last_unstale":"2024-09-10T08:07:04.444057+0000","last_undegraded":"2024-09-10T08:07:04.444057+0000","last_fullsized":"2024-09-10T08:07:04.444057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:00.816865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:03.436227+0000","last_change":"2024-09-10T08:06:51.844344+0000","last_active":"2024-09-10T08:07:03.436227+0000","last_peered":"2024-09-10T08:07:03.436227+0000","last_clean":"2024-09-10T08:07:03.436227+0000","last_became_active":"2024-09-10T08:06:51.844054+0000","last_became_peered":"2024-09-10T08:06:51.844054+0000","last_unstale":"2024-09-10T08:07:03.436227+0000","last_undegraded":"2024-09-10T08:07:03.436227+0000","last_fullsized":"2024-09-10T08:07:03.436227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:43.646632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428861+0000","last_change":"2024-09-10T08:06:53.914172+0000","last_active":"2024-09-10T08:07:02.428861+0000","last_peered":"2024-09-10T08:07:02.428861+0000","last_clean":"2024-09-10T08:07:02.428861+0000","last_became_active":"2024-09-10T08:06:53.913837+0000","last_became_peered":"2024-09-10T08:06:53.913837+0000","last_unstale":"2024-09-10T08:07:02.428861+0000","last_undegraded":"2024-09-10T08:07:02.428861+0000","last_fullsized":"2024-09-10T08:07:02.428861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:54.095685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.463531+0000","last_change":"2024-09-10T08:06:51.852474+0000","last_active":"2024-09-10T08:07:04.463531+0000","last_peered":"2024-09-10T08:07:04.463531+0000","last_clean":"2024-09-10T08:07:04.463531+0000","last_became_active":"2024-09-10T08:06:51.852097+0000","last_became_peered":"2024-09-10T08:06:51.852097+0000","last_unstale":"2024-09-10T08:07:04.463531+0000","last_undegraded":"2024-09-10T08:07:04.463531+0000","last_fullsized":"2024-09-10T08:07:04.463531+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:20.611988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.405898+0000","last_change":"2024-09-10T08:06:53.925345+0000","last_active":"2024-09-10T08:07:02.405898+0000","last_peered":"2024-09-10T08:07:02.405898+0000","last_clean":"2024-09-10T08:07:02.405898+0000","last_became_active":"2024-09-10T08:06:53.925017+0000","last_became_peered":"2024-09-10T08:06:53.925017+0000","last_unstale":"2024-09-10T08:07:02.405898+0000","last_undegraded":"2024-09-10T08:07:02.405898+0000","last_fullsized":"2024-09-10T08:07:02.405898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:22.692658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:57.542986+0000","last_change":"2024-09-10T08:06:51.849126+0000","last_active":"2024-09-10T08:07:57.542986+0000","last_peered":"2024-09-10T08:07:57.542986+0000","last_clean":"2024-09-10T08:07:57.542986+0000","last_became_active":"2024-09-10T08:06:51.848504+0000","last_became_peered":"2024-09-10T08:06:51.848504+0000","last_unstale":"2024-09-10T08:07:57.542986+0000","last_undegraded":"2024-09-10T08:07:57.542986+0000","last_fullsized":"2024-09-10T08:07:57.542986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:36.691846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428899+0000","last_change":"2024-09-10T08:06:53.930777+0000","last_active":"2024-09-10T08:07:02.428899+0000","last_peered":"2024-09-10T08:07:02.428899+0000","last_clean":"2024-09-10T08:07:02.428899+0000","last_became_active":"2024-09-10T08:06:53.929781+0000","last_became_peered":"2024-09-10T08:06:53.929781+0000","last_unstale":"2024-09-10T08:07:02.428899+0000","last_undegraded":"2024-09-10T08:07:02.428899+0000","last_fullsized":"2024-09-10T08:07:02.428899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:07.184254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.465673+0000","last_change":"2024-09-10T08:07:02.431452+0000","last_active":"2024-09-10T08:07:04.465673+0000","last_peered":"2024-09-10T08:07:04.465673+0000","last_clean":"2024-09-10T08:07:04.465673+0000","last_became_active":"2024-09-10T08:07:02.430794+0000","last_became_peered":"2024-09-10T08:07:02.430794+0000","last_unstale":"2024-09-10T08:07:04.465673+0000","last_undegraded":"2024-09-10T08:07:04.465673+0000","last_fullsized":"2024-09-10T08:07:04.465673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:48.313101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408754+0000","last_change":"2024-09-10T08:06:53.924896+0000","last_active":"2024-09-10T08:07:02.408754+0000","last_peered":"2024-09-10T08:07:02.408754+0000","last_clean":"2024-09-10T08:07:02.408754+0000","last_became_active":"2024-09-10T08:06:53.924593+0000","last_became_peered":"2024-09-10T08:06:53.924593+0000","last_unstale":"2024-09-10T08:07:02.408754+0000","last_undegraded":"2024-09-10T08:07:02.408754+0000","last_fullsized":"2024-09-10T08:07:02.408754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:49.802792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.444479+0000","last_change":"2024-09-10T08:06:52.045216+0000","last_active":"2024-09-10T08:07:04.444479+0000","last_peered":"2024-09-10T08:07:04.444479+0000","last_clean":"2024-09-10T08:07:04.444479+0000","last_became_active":"2024-09-10T08:06:52.044707+0000","last_became_peered":"2024-09-10T08:06:52.044707+0000","last_unstale":"2024-09-10T08:07:04.444479+0000","last_undegraded":"2024-09-10T08:07:04.444479+0000","last_fullsized":"2024-09-10T08:07:04.444479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:59.778427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427975+0000","last_change":"2024-09-10T08:06:53.932607+0000","last_active":"2024-09-10T08:07:02.427975+0000","last_peered":"2024-09-10T08:07:02.427975+0000","last_clean":"2024-09-10T08:07:02.427975+0000","last_became_active":"2024-09-10T08:06:53.932149+0000","last_became_peered":"2024-09-10T08:06:53.932149+0000","last_unstale":"2024-09-10T08:07:02.427975+0000","last_undegraded":"2024-09-10T08:07:02.427975+0000","last_fullsized":"2024-09-10T08:07:02.427975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:40.969547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":167,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:57.542979+0000","last_change":"2024-09-10T08:06:51.854321+0000","last_active":"2024-09-10T08:07:57.542979+0000","last_peered":"2024-09-10T08:07:57.542979+0000","last_clean":"2024-09-10T08:07:57.542979+0000","last_became_active":"2024-09-10T08:06:51.853931+0000","last_became_peered":"2024-09-10T08:06:51.853931+0000","last_unstale":"2024-09-10T08:07:57.542979+0000","last_undegraded":"2024-09-10T08:07:57.542979+0000","last_fullsized":"2024-09-10T08:07:57.542979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:30.930761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61199,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":117,"num_write":31,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411799+0000","last_change":"2024-09-10T08:06:53.924899+0000","last_active":"2024-09-10T08:07:02.411799+0000","last_peered":"2024-09-10T08:07:02.411799+0000","last_clean":"2024-09-10T08:07:02.411799+0000","last_became_active":"2024-09-10T08:06:53.924571+0000","last_became_peered":"2024-09-10T08:06:53.924571+0000","last_unstale":"2024-09-10T08:07:02.411799+0000","last_undegraded":"2024-09-10T08:07:02.411799+0000","last_fullsized":"2024-09-10T08:07:02.411799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:04.681689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.467171+0000","last_change":"2024-09-10T08:06:51.851860+0000","last_active":"2024-09-10T08:07:04.467171+0000","last_peered":"2024-09-10T08:07:04.467171+0000","last_clean":"2024-09-10T08:07:04.467171+0000","last_became_active":"2024-09-10T08:06:51.851520+0000","last_became_peered":"2024-09-10T08:06:51.851520+0000","last_unstale":"2024-09-10T08:07:04.467171+0000","last_undegraded":"2024-09-10T08:07:04.467171+0000","last_fullsized":"2024-09-10T08:07:04.467171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.182866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427983+0000","last_change":"2024-09-10T08:06:53.924888+0000","last_active":"2024-09-10T08:07:02.427983+0000","last_peered":"2024-09-10T08:07:02.427983+0000","last_clean":"2024-09-10T08:07:02.427983+0000","last_became_active":"2024-09-10T08:06:53.924572+0000","last_became_peered":"2024-09-10T08:06:53.924572+0000","last_unstale":"2024-09-10T08:07:02.427983+0000","last_undegraded":"2024-09-10T08:07:02.427983+0000","last_fullsized":"2024-09-10T08:07:02.427983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:19.446554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.465505+0000","last_change":"2024-09-10T08:06:51.848665+0000","last_active":"2024-09-10T08:07:04.465505+0000","last_peered":"2024-09-10T08:07:04.465505+0000","last_clean":"2024-09-10T08:07:04.465505+0000","last_became_active":"2024-09-10T08:06:51.848301+0000","last_became_peered":"2024-09-10T08:06:51.848301+0000","last_unstale":"2024-09-10T08:07:04.465505+0000","last_undegraded":"2024-09-10T08:07:04.465505+0000","last_fullsized":"2024-09-10T08:07:04.465505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:32.754470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409650+0000","last_change":"2024-09-10T08:06:53.933953+0000","last_active":"2024-09-10T08:07:02.409650+0000","last_peered":"2024-09-10T08:07:02.409650+0000","last_clean":"2024-09-10T08:07:02.409650+0000","last_became_active":"2024-09-10T08:06:53.933590+0000","last_became_peered":"2024-09-10T08:06:53.933590+0000","last_unstale":"2024-09-10T08:07:02.409650+0000","last_undegraded":"2024-09-10T08:07:02.409650+0000","last_fullsized":"2024-09-10T08:07:02.409650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:54.530660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:54.538210+0000","last_change":"2024-09-10T08:06:51.847673+0000","last_active":"2024-09-10T08:07:54.538210+0000","last_peered":"2024-09-10T08:07:54.538210+0000","last_clean":"2024-09-10T08:07:54.538210+0000","last_became_active":"2024-09-10T08:06:51.847324+0000","last_became_peered":"2024-09-10T08:06:51.847324+0000","last_unstale":"2024-09-10T08:07:54.538210+0000","last_undegraded":"2024-09-10T08:07:54.538210+0000","last_fullsized":"2024-09-10T08:07:54.538210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:24.962333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409220+0000","last_change":"2024-09-10T08:06:53.929884+0000","last_active":"2024-09-10T08:07:02.409220+0000","last_peered":"2024-09-10T08:07:02.409220+0000","last_clean":"2024-09-10T08:07:02.409220+0000","last_became_active":"2024-09-10T08:06:53.927766+0000","last_became_peered":"2024-09-10T08:06:53.927766+0000","last_unstale":"2024-09-10T08:07:02.409220+0000","last_undegraded":"2024-09-10T08:07:02.409220+0000","last_fullsized":"2024-09-10T08:07:02.409220+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:18.403993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.458590+0000","last_change":"2024-09-10T08:07:02.425907+0000","last_active":"2024-09-10T08:07:04.458590+0000","last_peered":"2024-09-10T08:07:04.458590+0000","last_clean":"2024-09-10T08:07:04.458590+0000","last_became_active":"2024-09-10T08:07:02.416949+0000","last_became_peered":"2024-09-10T08:07:02.416949+0000","last_unstale":"2024-09-10T08:07:04.458590+0000","last_undegraded":"2024-09-10T08:07:04.458590+0000","last_fullsized":"2024-09-10T08:07:04.458590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:01.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.413786+0000","last_change":"2024-09-10T08:06:53.927620+0000","last_active":"2024-09-10T08:07:02.413786+0000","last_peered":"2024-09-10T08:07:02.413786+0000","last_clean":"2024-09-10T08:07:02.413786+0000","last_became_active":"2024-09-10T08:06:53.926543+0000","last_became_peered":"2024-09-10T08:06:53.926543+0000","last_unstale":"2024-09-10T08:07:02.413786+0000","last_undegraded":"2024-09-10T08:07:02.413786+0000","last_fullsized":"2024-09-10T08:07:02.413786+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:18.210472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.432980+0000","last_change":"2024-09-10T08:07:02.430550+0000","last_active":"2024-09-10T08:07:04.432980+0000","last_peered":"2024-09-10T08:07:04.432980+0000","last_clean":"2024-09-10T08:07:04.432980+0000","last_became_active":"2024-09-10T08:07:02.416317+0000","last_became_peered":"2024-09-10T08:07:02.416317+0000","last_unstale":"2024-09-10T08:07:04.432980+0000","last_undegraded":"2024-09-10T08:07:04.432980+0000","last_fullsized":"2024-09-10T08:07:04.432980+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:10.317471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409840+0000","last_change":"2024-09-10T08:06:53.925598+0000","last_active":"2024-09-10T08:07:02.409840+0000","last_peered":"2024-09-10T08:07:02.409840+0000","last_clean":"2024-09-10T08:07:02.409840+0000","last_became_active":"2024-09-10T08:06:53.925253+0000","last_became_peered":"2024-09-10T08:06:53.925253+0000","last_unstale":"2024-09-10T08:07:02.409840+0000","last_undegraded":"2024-09-10T08:07:02.409840+0000","last_fullsized":"2024-09-10T08:07:02.409840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:29.662057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.465757+0000","last_change":"2024-09-10T08:06:51.851790+0000","last_active":"2024-09-10T08:07:04.465757+0000","last_peered":"2024-09-10T08:07:04.465757+0000","last_clean":"2024-09-10T08:07:04.465757+0000","last_became_active":"2024-09-10T08:06:51.851417+0000","last_became_peered":"2024-09-10T08:06:51.851417+0000","last_unstale":"2024-09-10T08:07:04.465757+0000","last_undegraded":"2024-09-10T08:07:04.465757+0000","last_fullsized":"2024-09-10T08:07:04.465757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:41.432728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409698+0000","last_change":"2024-09-10T08:06:53.926530+0000","last_active":"2024-09-10T08:07:02.409698+0000","last_peered":"2024-09-10T08:07:02.409698+0000","last_clean":"2024-09-10T08:07:02.409698+0000","last_became_active":"2024-09-10T08:06:53.926191+0000","last_became_peered":"2024-09-10T08:06:53.926191+0000","last_unstale":"2024-09-10T08:07:02.409698+0000","last_undegraded":"2024-09-10T08:07:02.409698+0000","last_fullsized":"2024-09-10T08:07:02.409698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:09.789763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.458396+0000","last_change":"2024-09-10T08:06:51.846679+0000","last_active":"2024-09-10T08:07:04.458396+0000","last_peered":"2024-09-10T08:07:04.458396+0000","last_clean":"2024-09-10T08:07:04.458396+0000","last_became_active":"2024-09-10T08:06:51.846328+0000","last_became_peered":"2024-09-10T08:06:51.846328+0000","last_unstale":"2024-09-10T08:07:04.458396+0000","last_undegraded":"2024-09-10T08:07:04.458396+0000","last_fullsized":"2024-09-10T08:07:04.458396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:09.207285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409613+0000","last_change":"2024-09-10T08:06:53.928316+0000","last_active":"2024-09-10T08:07:02.409613+0000","last_peered":"2024-09-10T08:07:02.409613+0000","last_clean":"2024-09-10T08:07:02.409613+0000","last_became_active":"2024-09-10T08:06:53.927974+0000","last_became_peered":"2024-09-10T08:06:53.927974+0000","last_unstale":"2024-09-10T08:07:02.409613+0000","last_undegraded":"2024-09-10T08:07:02.409613+0000","last_fullsized":"2024-09-10T08:07:02.409613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:06.875492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":86,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:57.543782+0000","last_change":"2024-09-10T08:06:52.151494+0000","last_active":"2024-09-10T08:07:57.543782+0000","last_peered":"2024-09-10T08:07:57.543782+0000","last_clean":"2024-09-10T08:07:57.543782+0000","last_became_active":"2024-09-10T08:06:52.151029+0000","last_became_peered":"2024-09-10T08:06:52.151029+0000","last_unstale":"2024-09-10T08:07:57.543782+0000","last_undegraded":"2024-09-10T08:07:57.543782+0000","last_fullsized":"2024-09-10T08:07:57.543782+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:23.632526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409767+0000","last_change":"2024-09-10T08:06:53.935415+0000","last_active":"2024-09-10T08:07:02.409767+0000","last_peered":"2024-09-10T08:07:02.409767+0000","last_clean":"2024-09-10T08:07:02.409767+0000","last_became_active":"2024-09-10T08:06:53.934855+0000","last_became_peered":"2024-09-10T08:06:53.934855+0000","last_unstale":"2024-09-10T08:07:02.409767+0000","last_undegraded":"2024-09-10T08:07:02.409767+0000","last_fullsized":"2024-09-10T08:07:02.409767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:08.799487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409575+0000","last_change":"2024-09-10T08:05:41.349856+0000","last_active":"2024-09-10T08:07:02.409575+0000","last_peered":"2024-09-10T08:07:02.409575+0000","last_clean":"2024-09-10T08:07:02.409575+0000","last_became_active":"2024-09-10T08:05:41.349403+0000","last_became_peered":"2024-09-10T08:05:41.349403+0000","last_unstale":"2024-09-10T08:07:02.409575+0000","last_undegraded":"2024-09-10T08:07:02.409575+0000","last_fullsized":"2024-09-10T08:07:02.409575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:02:15.710253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:02:15.710253+0000","last_clean_scrub_stamp":"2024-09-10T08:02:15.710253+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:43.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.466365+0000","last_change":"2024-09-10T08:06:51.846885+0000","last_active":"2024-09-10T08:07:04.466365+0000","last_peered":"2024-09-10T08:07:04.466365+0000","last_clean":"2024-09-10T08:07:04.466365+0000","last_became_active":"2024-09-10T08:06:51.846548+0000","last_became_peered":"2024-09-10T08:06:51.846548+0000","last_unstale":"2024-09-10T08:07:04.466365+0000","last_undegraded":"2024-09-10T08:07:04.466365+0000","last_fullsized":"2024-09-10T08:07:04.466365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:00.702987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428558+0000","last_change":"2024-09-10T08:06:53.916122+0000","last_active":"2024-09-10T08:07:02.428558+0000","last_peered":"2024-09-10T08:07:02.428558+0000","last_clean":"2024-09-10T08:07:02.428558+0000","last_became_active":"2024-09-10T08:06:53.915816+0000","last_became_peered":"2024-09-10T08:06:53.915816+0000","last_unstale":"2024-09-10T08:07:02.428558+0000","last_undegraded":"2024-09-10T08:07:02.428558+0000","last_fullsized":"2024-09-10T08:07:02.428558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:59.454276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:03.436486+0000","last_change":"2024-09-10T08:06:51.851031+0000","last_active":"2024-09-10T08:07:03.436486+0000","last_peered":"2024-09-10T08:07:03.436486+0000","last_clean":"2024-09-10T08:07:03.436486+0000","last_became_active":"2024-09-10T08:06:51.850518+0000","last_became_peered":"2024-09-10T08:06:51.850518+0000","last_unstale":"2024-09-10T08:07:03.436486+0000","last_undegraded":"2024-09-10T08:07:03.436486+0000","last_fullsized":"2024-09-10T08:07:03.436486+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:29.350976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427966+0000","last_change":"2024-09-10T08:06:53.923868+0000","last_active":"2024-09-10T08:07:02.427966+0000","last_peered":"2024-09-10T08:07:02.427966+0000","last_clean":"2024-09-10T08:07:02.427966+0000","last_became_active":"2024-09-10T08:06:53.923536+0000","last_became_peered":"2024-09-10T08:06:53.923536+0000","last_unstale":"2024-09-10T08:07:02.427966+0000","last_undegraded":"2024-09-10T08:07:02.427966+0000","last_fullsized":"2024-09-10T08:07:02.427966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:51.635192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:55.539132+0000","last_change":"2024-09-10T08:06:52.044706+0000","last_active":"2024-09-10T08:07:55.539132+0000","last_peered":"2024-09-10T08:07:55.539132+0000","last_clean":"2024-09-10T08:07:55.539132+0000","last_became_active":"2024-09-10T08:06:52.044363+0000","last_became_peered":"2024-09-10T08:06:52.044363+0000","last_unstale":"2024-09-10T08:07:55.539132+0000","last_undegraded":"2024-09-10T08:07:55.539132+0000","last_fullsized":"2024-09-10T08:07:55.539132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:34.190568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409680+0000","last_change":"2024-09-10T08:07:02.409349+0000","last_active":"2024-09-10T08:07:02.409680+0000","last_peered":"2024-09-10T08:07:02.409680+0000","last_clean":"2024-09-10T08:07:02.409680+0000","last_became_active":"2024-09-10T08:07:02.408940+0000","last_became_peered":"2024-09-10T08:07:02.408940+0000","last_unstale":"2024-09-10T08:07:02.409680+0000","last_undegraded":"2024-09-10T08:07:02.409680+0000","last_fullsized":"2024-09-10T08:07:02.409680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:10.702479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:54.550056+0000","last_change":"2024-09-10T08:06:51.851874+0000","last_active":"2024-09-10T08:07:54.550056+0000","last_peered":"2024-09-10T08:07:54.550056+0000","last_clean":"2024-09-10T08:07:54.550056+0000","last_became_active":"2024-09-10T08:06:51.851473+0000","last_became_peered":"2024-09-10T08:06:51.851473+0000","last_unstale":"2024-09-10T08:07:54.550056+0000","last_undegraded":"2024-09-10T08:07:54.550056+0000","last_fullsized":"2024-09-10T08:07:54.550056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:29.273643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427638+0000","last_change":"2024-09-10T08:06:53.925677+0000","last_active":"2024-09-10T08:07:02.427638+0000","last_peered":"2024-09-10T08:07:02.427638+0000","last_clean":"2024-09-10T08:07:02.427638+0000","last_became_active":"2024-09-10T08:06:53.925374+0000","last_became_peered":"2024-09-10T08:06:53.925374+0000","last_unstale":"2024-09-10T08:07:02.427638+0000","last_undegraded":"2024-09-10T08:07:02.427638+0000","last_fullsized":"2024-09-10T08:07:02.427638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:13.138156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.406100+0000","last_change":"2024-09-10T08:06:52.044960+0000","last_active":"2024-09-10T08:07:02.406100+0000","last_peered":"2024-09-10T08:07:02.406100+0000","last_clean":"2024-09-10T08:07:02.406100+0000","last_became_active":"2024-09-10T08:06:52.044606+0000","last_became_peered":"2024-09-10T08:06:52.044606+0000","last_unstale":"2024-09-10T08:07:02.406100+0000","last_undegraded":"2024-09-10T08:07:02.406100+0000","last_fullsized":"2024-09-10T08:07:02.406100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:53.165305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428241+0000","last_change":"2024-09-10T08:06:53.922433+0000","last_active":"2024-09-10T08:07:02.428241+0000","last_peered":"2024-09-10T08:07:02.428241+0000","last_clean":"2024-09-10T08:07:02.428241+0000","last_became_active":"2024-09-10T08:06:53.922071+0000","last_became_peered":"2024-09-10T08:06:53.922071+0000","last_unstale":"2024-09-10T08:07:02.428241+0000","last_undegraded":"2024-09-10T08:07:02.428241+0000","last_fullsized":"2024-09-10T08:07:02.428241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:50.971467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.458913+0000","last_change":"2024-09-10T08:06:52.045082+0000","last_active":"2024-09-10T08:07:04.458913+0000","last_peered":"2024-09-10T08:07:04.458913+0000","last_clean":"2024-09-10T08:07:04.458913+0000","last_became_active":"2024-09-10T08:06:52.044536+0000","last_became_peered":"2024-09-10T08:06:52.044536+0000","last_unstale":"2024-09-10T08:07:04.458913+0000","last_undegraded":"2024-09-10T08:07:04.458913+0000","last_fullsized":"2024-09-10T08:07:04.458913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:49.639035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428443+0000","last_change":"2024-09-10T08:06:53.923357+0000","last_active":"2024-09-10T08:07:02.428443+0000","last_peered":"2024-09-10T08:07:02.428443+0000","last_clean":"2024-09-10T08:07:02.428443+0000","last_became_active":"2024-09-10T08:06:53.923060+0000","last_became_peered":"2024-09-10T08:06:53.923060+0000","last_unstale":"2024-09-10T08:07:02.428443+0000","last_undegraded":"2024-09-10T08:07:02.428443+0000","last_fullsized":"2024-09-10T08:07:02.428443+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:28.242894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'14","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:19.382230+0000","last_change":"2024-09-10T08:06:51.846268+0000","last_active":"2024-09-10T08:07:19.382230+0000","last_peered":"2024-09-10T08:07:19.382230+0000","last_clean":"2024-09-10T08:07:19.382230+0000","last_became_active":"2024-09-10T08:06:51.845891+0000","last_became_peered":"2024-09-10T08:06:51.845891+0000","last_unstale":"2024-09-10T08:07:19.382230+0000","last_undegraded":"2024-09-10T08:07:19.382230+0000","last_fullsized":"2024-09-10T08:07:19.382230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:52.621019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428556+0000","last_change":"2024-09-10T08:06:53.927836+0000","last_active":"2024-09-10T08:07:02.428556+0000","last_peered":"2024-09-10T08:07:02.428556+0000","last_clean":"2024-09-10T08:07:02.428556+0000","last_became_active":"2024-09-10T08:06:53.927339+0000","last_became_peered":"2024-09-10T08:06:53.927339+0000","last_unstale":"2024-09-10T08:07:02.428556+0000","last_undegraded":"2024-09-10T08:07:02.428556+0000","last_fullsized":"2024-09-10T08:07:02.428556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:55.569050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.466698+0000","last_change":"2024-09-10T08:06:52.151335+0000","last_active":"2024-09-10T08:07:04.466698+0000","last_peered":"2024-09-10T08:07:04.466698+0000","last_clean":"2024-09-10T08:07:04.466698+0000","last_became_active":"2024-09-10T08:06:52.150965+0000","last_became_peered":"2024-09-10T08:06:52.150965+0000","last_unstale":"2024-09-10T08:07:04.466698+0000","last_undegraded":"2024-09-10T08:07:04.466698+0000","last_fullsized":"2024-09-10T08:07:04.466698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:43.933254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.431020+0000","last_change":"2024-09-10T08:07:02.431020+0000","last_active":"2024-09-10T08:07:02.431020+0000","last_peered":"2024-09-10T08:07:02.431020+0000","last_clean":"2024-09-10T08:07:02.431020+0000","last_became_active":"2024-09-10T08:07:02.429794+0000","last_became_peered":"2024-09-10T08:07:02.429794+0000","last_unstale":"2024-09-10T08:07:02.431020+0000","last_undegraded":"2024-09-10T08:07:02.431020+0000","last_fullsized":"2024-09-10T08:07:02.431020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:49.386164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.433054+0000","last_change":"2024-09-10T08:06:52.044739+0000","last_active":"2024-09-10T08:07:02.433054+0000","last_peered":"2024-09-10T08:07:02.433054+0000","last_clean":"2024-09-10T08:07:02.433054+0000","last_became_active":"2024-09-10T08:06:52.044424+0000","last_became_peered":"2024-09-10T08:06:52.044424+0000","last_unstale":"2024-09-10T08:07:02.433054+0000","last_undegraded":"2024-09-10T08:07:02.433054+0000","last_fullsized":"2024-09-10T08:07:02.433054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:01.279274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411626+0000","last_change":"2024-09-10T08:06:53.918245+0000","last_active":"2024-09-10T08:07:02.411626+0000","last_peered":"2024-09-10T08:07:02.411626+0000","last_clean":"2024-09-10T08:07:02.411626+0000","last_became_active":"2024-09-10T08:06:53.917857+0000","last_became_peered":"2024-09-10T08:06:53.917857+0000","last_unstale":"2024-09-10T08:07:02.411626+0000","last_undegraded":"2024-09-10T08:07:02.411626+0000","last_fullsized":"2024-09-10T08:07:02.411626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:53.762361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.466341+0000","last_change":"2024-09-10T08:06:51.845368+0000","last_active":"2024-09-10T08:07:04.466341+0000","last_peered":"2024-09-10T08:07:04.466341+0000","last_clean":"2024-09-10T08:07:04.466341+0000","last_became_active":"2024-09-10T08:06:51.845052+0000","last_became_peered":"2024-09-10T08:06:51.845052+0000","last_unstale":"2024-09-10T08:07:04.466341+0000","last_undegraded":"2024-09-10T08:07:04.466341+0000","last_fullsized":"2024-09-10T08:07:04.466341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:45.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409721+0000","last_change":"2024-09-10T08:06:53.923576+0000","last_active":"2024-09-10T08:07:02.409721+0000","last_peered":"2024-09-10T08:07:02.409721+0000","last_clean":"2024-09-10T08:07:02.409721+0000","last_became_active":"2024-09-10T08:06:53.922934+0000","last_became_peered":"2024-09-10T08:06:53.922934+0000","last_unstale":"2024-09-10T08:07:02.409721+0000","last_undegraded":"2024-09-10T08:07:02.409721+0000","last_fullsized":"2024-09-10T08:07:02.409721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:48:06.088145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.444804+0000","last_change":"2024-09-10T08:06:51.850535+0000","last_active":"2024-09-10T08:07:04.444804+0000","last_peered":"2024-09-10T08:07:04.444804+0000","last_clean":"2024-09-10T08:07:04.444804+0000","last_became_active":"2024-09-10T08:06:51.850146+0000","last_became_peered":"2024-09-10T08:06:51.850146+0000","last_unstale":"2024-09-10T08:07:04.444804+0000","last_undegraded":"2024-09-10T08:07:04.444804+0000","last_fullsized":"2024-09-10T08:07:04.444804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:28.327887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.429015+0000","last_change":"2024-09-10T08:06:53.922375+0000","last_active":"2024-09-10T08:07:02.429015+0000","last_peered":"2024-09-10T08:07:02.429015+0000","last_clean":"2024-09-10T08:07:02.429015+0000","last_became_active":"2024-09-10T08:06:53.922038+0000","last_became_peered":"2024-09-10T08:06:53.922038+0000","last_unstale":"2024-09-10T08:07:02.429015+0000","last_undegraded":"2024-09-10T08:07:02.429015+0000","last_fullsized":"2024-09-10T08:07:02.429015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:32.710083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:03.149639+0000","last_change":"2024-09-10T08:07:02.419694+0000","last_active":"2024-09-10T08:07:03.149639+0000","last_peered":"2024-09-10T08:07:03.149639+0000","last_clean":"2024-09-10T08:07:03.149639+0000","last_became_active":"2024-09-10T08:07:02.415181+0000","last_became_peered":"2024-09-10T08:07:02.415181+0000","last_unstale":"2024-09-10T08:07:03.149639+0000","last_undegraded":"2024-09-10T08:07:03.149639+0000","last_fullsized":"2024-09-10T08:07:03.149639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:01.023611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409406+0000","last_change":"2024-09-10T08:06:53.934546+0000","last_active":"2024-09-10T08:07:02.409406+0000","last_peered":"2024-09-10T08:07:02.409406+0000","last_clean":"2024-09-10T08:07:02.409406+0000","last_became_active":"2024-09-10T08:06:53.933883+0000","last_became_peered":"2024-09-10T08:06:53.933883+0000","last_unstale":"2024-09-10T08:07:02.409406+0000","last_undegraded":"2024-09-10T08:07:02.409406+0000","last_fullsized":"2024-09-10T08:07:02.409406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:09.396870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.414803+0000","last_change":"2024-09-10T08:06:53.925407+0000","last_active":"2024-09-10T08:07:02.414803+0000","last_peered":"2024-09-10T08:07:02.414803+0000","last_clean":"2024-09-10T08:07:02.414803+0000","last_became_active":"2024-09-10T08:06:53.925057+0000","last_became_peered":"2024-09-10T08:06:53.925057+0000","last_unstale":"2024-09-10T08:07:02.414803+0000","last_undegraded":"2024-09-10T08:07:02.414803+0000","last_fullsized":"2024-09-10T08:07:02.414803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:52.012219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.467437+0000","last_change":"2024-09-10T08:06:51.852922+0000","last_active":"2024-09-10T08:07:04.467437+0000","last_peered":"2024-09-10T08:07:04.467437+0000","last_clean":"2024-09-10T08:07:04.467437+0000","last_became_active":"2024-09-10T08:06:51.852354+0000","last_became_peered":"2024-09-10T08:06:51.852354+0000","last_unstale":"2024-09-10T08:07:04.467437+0000","last_undegraded":"2024-09-10T08:07:04.467437+0000","last_fullsized":"2024-09-10T08:07:04.467437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:21.559686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427871+0000","last_change":"2024-09-10T08:06:53.932155+0000","last_active":"2024-09-10T08:07:02.427871+0000","last_peered":"2024-09-10T08:07:02.427871+0000","last_clean":"2024-09-10T08:07:02.427871+0000","last_became_active":"2024-09-10T08:06:53.931688+0000","last_became_peered":"2024-09-10T08:06:53.931688+0000","last_unstale":"2024-09-10T08:07:02.427871+0000","last_undegraded":"2024-09-10T08:07:02.427871+0000","last_fullsized":"2024-09-10T08:07:02.427871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:58.481716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.467357+0000","last_change":"2024-09-10T08:06:51.851900+0000","last_active":"2024-09-10T08:07:04.467357+0000","last_peered":"2024-09-10T08:07:04.467357+0000","last_clean":"2024-09-10T08:07:04.467357+0000","last_became_active":"2024-09-10T08:06:51.851509+0000","last_became_peered":"2024-09-10T08:06:51.851509+0000","last_unstale":"2024-09-10T08:07:04.467357+0000","last_undegraded":"2024-09-10T08:07:04.467357+0000","last_fullsized":"2024-09-10T08:07:04.467357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:41.250995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408641+0000","last_change":"2024-09-10T08:06:53.917320+0000","last_active":"2024-09-10T08:07:02.408641+0000","last_peered":"2024-09-10T08:07:02.408641+0000","last_clean":"2024-09-10T08:07:02.408641+0000","last_became_active":"2024-09-10T08:06:53.917027+0000","last_became_peered":"2024-09-10T08:06:53.917027+0000","last_unstale":"2024-09-10T08:07:02.408641+0000","last_undegraded":"2024-09-10T08:07:02.408641+0000","last_fullsized":"2024-09-10T08:07:02.408641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:08.882036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428812+0000","last_change":"2024-09-10T08:06:52.046168+0000","last_active":"2024-09-10T08:07:02.428812+0000","last_peered":"2024-09-10T08:07:02.428812+0000","last_clean":"2024-09-10T08:07:02.428812+0000","last_became_active":"2024-09-10T08:06:52.045825+0000","last_became_peered":"2024-09-10T08:06:52.045825+0000","last_unstale":"2024-09-10T08:07:02.428812+0000","last_undegraded":"2024-09-10T08:07:02.428812+0000","last_fullsized":"2024-09-10T08:07:02.428812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:15.467875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428487+0000","last_change":"2024-09-10T08:06:53.922449+0000","last_active":"2024-09-10T08:07:02.428487+0000","last_peered":"2024-09-10T08:07:02.428487+0000","last_clean":"2024-09-10T08:07:02.428487+0000","last_became_active":"2024-09-10T08:06:53.922123+0000","last_became_peered":"2024-09-10T08:06:53.922123+0000","last_unstale":"2024-09-10T08:07:02.428487+0000","last_undegraded":"2024-09-10T08:07:02.428487+0000","last_fullsized":"2024-09-10T08:07:02.428487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:44.424257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":89,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:56.552257+0000","last_change":"2024-09-10T08:06:51.847689+0000","last_active":"2024-09-10T08:07:56.552257+0000","last_peered":"2024-09-10T08:07:56.552257+0000","last_clean":"2024-09-10T08:07:56.552257+0000","last_became_active":"2024-09-10T08:06:51.847394+0000","last_became_peered":"2024-09-10T08:06:51.847394+0000","last_unstale":"2024-09-10T08:07:56.552257+0000","last_undegraded":"2024-09-10T08:07:56.552257+0000","last_fullsized":"2024-09-10T08:07:56.552257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:58.581814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68014,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":570,"num_read_kb":362,"num_write":239,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285538,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547227,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":438048,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776159,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":1089861,"data_compressed":42108,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":437563,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168618,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":437919,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":1030068,"data_compressed":42108,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561076,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":437280,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":1029746,"data_compressed":42108,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":437253,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":437105,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":499893,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":499392,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":439012,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34671,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34671,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34671,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:07:59.709 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T08:07:59.967 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:00.259 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:59 smithi022 ceph-mon[30854]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T08:08:00.259 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:08:00.259 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:08:00.259 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:59 smithi022 ceph-mon[30854]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:08:00.260 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:08:00.260 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:08:00.260 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:07:59 smithi022 ceph-mon[30854]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:08:00.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:59 smithi100 ceph-mon[35102]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T08:08:00.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:08:00.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:08:00.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:59 smithi100 ceph-mon[35102]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:08:00.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:08:00.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:08:00.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:07:59 smithi100 ceph-mon[35102]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:08:00.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:59 smithi153 ceph-mon[35609]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T08:08:00.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:08:00.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:08:00.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:59 smithi153 ceph-mon[35609]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:08:00.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:08:00.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:08:00.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:07:59 smithi153 ceph-mon[35609]: from='mgr.14150 172.21.15.22:0/2347693439' entity='mgr.x' 2024-09-10T08:08:00.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.464+0000 7f6973bfe640 1 -- 172.21.15.22:0/3503919570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f696c101420 msgr2=0x7f696c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:00.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.464+0000 7f6973bfe640 1 --2- 172.21.15.22:0/3503919570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f696c101420 0x7f696c10d950 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6964009cd0 tx=0x7f696402a8e0 comp rx=0 tx=0).stop 2024-09-10T08:08:00.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.464+0000 7f6973bfe640 1 -- 172.21.15.22:0/3503919570 shutdown_connections 2024-09-10T08:08:00.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.464+0000 7f6973bfe640 1 --2- 172.21.15.22:0/3503919570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f696c101420 0x7f696c10d950 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:00.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.464+0000 7f6973bfe640 1 --2- 172.21.15.22:0/3503919570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696c100a80 0x7f696c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:00.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.464+0000 7f6973bfe640 1 --2- 172.21.15.22:0/3503919570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f696c106a80 0x7f696c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:00.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.464+0000 7f6973bfe640 1 -- 172.21.15.22:0/3503919570 >> 172.21.15.22:0/3503919570 conn(0x7f696c0fc7a0 msgr2=0x7f696c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:00.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.464+0000 7f6973bfe640 1 -- 172.21.15.22:0/3503919570 shutdown_connections 2024-09-10T08:08:00.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.464+0000 7f6973bfe640 1 -- 172.21.15.22:0/3503919570 wait complete. 2024-09-10T08:08:00.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.465+0000 7f6973bfe640 1 Processor -- start 2024-09-10T08:08:00.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.465+0000 7f6973bfe640 1 -- start start 2024-09-10T08:08:00.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.465+0000 7f6973bfe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f696c100a80 0x7f696c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:00.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.465+0000 7f6973bfe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696c101420 0x7f696c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:00.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.465+0000 7f6973bfe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f696c106a80 0x7f696c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:00.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.465+0000 7f6973bfe640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f696c110ea0 con 0x7f696c100a80 2024-09-10T08:08:00.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.465+0000 7f6973bfe640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f696c110d20 con 0x7f696c101420 2024-09-10T08:08:00.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.465+0000 7f6973bfe640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f696c111020 con 0x7f696c106a80 2024-09-10T08:08:00.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.465+0000 7f697199a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f696c100a80 0x7f696c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:00.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.465+0000 7f697199a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f696c100a80 0x7f696c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49572/0 (socket says 172.21.15.22:49572) 2024-09-10T08:08:00.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.465+0000 7f697199a640 1 -- 172.21.15.22:0/1219917637 learned_addr learned my addr 172.21.15.22:0/1219917637 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:00.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f697219b640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f696c106a80 0x7f696c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f6971199640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696c101420 0x7f696c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f697199a640 1 -- 172.21.15.22:0/1219917637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f696c106a80 msgr2=0x7f696c19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f697199a640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f696c106a80 0x7f696c19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f697199a640 1 -- 172.21.15.22:0/1219917637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696c101420 msgr2=0x7f696c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f697199a640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696c101420 0x7f696c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f697199a640 1 -- 172.21.15.22:0/1219917637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696c19d3e0 con 0x7f696c100a80 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f6971199640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696c101420 0x7f696c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f697199a640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f696c100a80 0x7f696c198430 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f696800b4a0 tx=0x7f696800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f6962ffd640 1 -- 172.21.15.22:0/1219917637 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968014070 con 0x7f696c100a80 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f6962ffd640 1 -- 172.21.15.22:0/1219917637 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6968010af0 con 0x7f696c100a80 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f6973bfe640 1 -- 172.21.15.22:0/1219917637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696c19d6d0 con 0x7f696c100a80 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f6962ffd640 1 -- 172.21.15.22:0/1219917637 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968017d10 con 0x7f696c100a80 2024-09-10T08:08:00.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.466+0000 7f6973bfe640 1 -- 172.21.15.22:0/1219917637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696c1a4fb0 con 0x7f696c100a80 2024-09-10T08:08:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.467+0000 7f6973bfe640 1 -- 172.21.15.22:0/1219917637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696c100ee0 con 0x7f696c100a80 2024-09-10T08:08:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.468+0000 7f6962ffd640 1 -- 172.21.15.22:0/1219917637 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6968017070 con 0x7f696c100a80 2024-09-10T08:08:00.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.469+0000 7f6962ffd640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f69580a2c90 0x7f69580a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:00.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.469+0000 7f6971199640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f69580a2c90 0x7f69580a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:00.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.469+0000 7f6962ffd640 1 -- 172.21.15.22:0/1219917637 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f69680ce510 con 0x7f696c100a80 2024-09-10T08:08:00.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.470+0000 7f6971199640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f69580a2c90 0x7f69580a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f696c0fec80 tx=0x7f695c005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:00.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.473+0000 7f6962ffd640 1 -- 172.21.15.22:0/1219917637 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f696809b3e0 con 0x7f696c100a80 2024-09-10T08:08:00.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.647+0000 7f6973bfe640 1 -- 172.21.15.22:0/1219917637 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f696c06af30 con 0x7f69580a2c90 2024-09-10T08:08:00.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.653+0000 7f6962ffd640 1 -- 172.21.15.22:0/1219917637 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259010 (secure 0 0 0) 0x7f696c06af30 con 0x7f69580a2c90 2024-09-10T08:08:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:00.655 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-10T08:08:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.656+0000 7f6973bfe640 1 -- 172.21.15.22:0/1219917637 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f69580a2c90 msgr2=0x7f69580a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.656+0000 7f6973bfe640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f69580a2c90 0x7f69580a5150 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f696c0fec80 tx=0x7f695c005e50 comp rx=0 tx=0).stop 2024-09-10T08:08:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.656+0000 7f6973bfe640 1 -- 172.21.15.22:0/1219917637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f696c100a80 msgr2=0x7f696c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:00.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.656+0000 7f6973bfe640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f696c100a80 0x7f696c198430 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f696800b4a0 tx=0x7f696800b960 comp rx=0 tx=0).stop 2024-09-10T08:08:00.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.656+0000 7f6973bfe640 1 -- 172.21.15.22:0/1219917637 shutdown_connections 2024-09-10T08:08:00.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.656+0000 7f6973bfe640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f69580a2c90 0x7f69580a5150 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:00.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.656+0000 7f6973bfe640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f696c106a80 0x7f696c19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:00.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.656+0000 7f6973bfe640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f696c101420 0x7f696c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:00.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.656+0000 7f6973bfe640 1 --2- 172.21.15.22:0/1219917637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f696c100a80 0x7f696c198430 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:00.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.656+0000 7f6973bfe640 1 -- 172.21.15.22:0/1219917637 >> 172.21.15.22:0/1219917637 conn(0x7f696c0fc7a0 msgr2=0x7f696c06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:00.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.656+0000 7f6973bfe640 1 -- 172.21.15.22:0/1219917637 shutdown_connections 2024-09-10T08:08:00.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:00.656+0000 7f6973bfe640 1 -- 172.21.15.22:0/1219917637 wait complete. 2024-09-10T08:08:01.211 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:00 smithi022 ceph-mon[30854]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:08:01.239 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-10T08:07:58.957938+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658616,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":706,"num_read_kb":481,"num_write":422,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360440,"kb_used_data":11184,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581384,"statfs":{"total":1151940427776,"available":1151571337216,"internally_reserved":0,"allocated":11452416,"data_stored":7213140,"data_compressed":178551,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19141,"internal_metadata":357414203},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002969"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.410188+0000","last_change":"2024-09-10T08:06:53.919814+0000","last_active":"2024-09-10T08:07:02.410188+0000","last_peered":"2024-09-10T08:07:02.410188+0000","last_clean":"2024-09-10T08:07:02.410188+0000","last_became_active":"2024-09-10T08:06:53.919460+0000","last_became_peered":"2024-09-10T08:06:53.919460+0000","last_unstale":"2024-09-10T08:07:02.410188+0000","last_undegraded":"2024-09-10T08:07:02.410188+0000","last_fullsized":"2024-09-10T08:07:02.410188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:39.027064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408512+0000","last_change":"2024-09-10T08:06:53.921645+0000","last_active":"2024-09-10T08:07:02.408512+0000","last_peered":"2024-09-10T08:07:02.408512+0000","last_clean":"2024-09-10T08:07:02.408512+0000","last_became_active":"2024-09-10T08:06:53.921346+0000","last_became_peered":"2024-09-10T08:06:53.921346+0000","last_unstale":"2024-09-10T08:07:02.408512+0000","last_undegraded":"2024-09-10T08:07:02.408512+0000","last_fullsized":"2024-09-10T08:07:02.408512+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:27:48.830824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408729+0000","last_change":"2024-09-10T08:06:53.920736+0000","last_active":"2024-09-10T08:07:02.408729+0000","last_peered":"2024-09-10T08:07:02.408729+0000","last_clean":"2024-09-10T08:07:02.408729+0000","last_became_active":"2024-09-10T08:06:53.920422+0000","last_became_peered":"2024-09-10T08:06:53.920422+0000","last_unstale":"2024-09-10T08:07:02.408729+0000","last_undegraded":"2024-09-10T08:07:02.408729+0000","last_fullsized":"2024-09-10T08:07:02.408729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:01:32.025610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.413898+0000","last_change":"2024-09-10T08:07:02.413480+0000","last_active":"2024-09-10T08:07:02.413898+0000","last_peered":"2024-09-10T08:07:02.413898+0000","last_clean":"2024-09-10T08:07:02.413898+0000","last_became_active":"2024-09-10T08:07:02.413146+0000","last_became_peered":"2024-09-10T08:07:02.413146+0000","last_unstale":"2024-09-10T08:07:02.413898+0000","last_undegraded":"2024-09-10T08:07:02.413898+0000","last_fullsized":"2024-09-10T08:07:02.413898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:47.348670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411798+0000","last_change":"2024-09-10T08:06:53.915703+0000","last_active":"2024-09-10T08:07:02.411798+0000","last_peered":"2024-09-10T08:07:02.411798+0000","last_clean":"2024-09-10T08:07:02.411798+0000","last_became_active":"2024-09-10T08:06:53.915375+0000","last_became_peered":"2024-09-10T08:06:53.915375+0000","last_unstale":"2024-09-10T08:07:02.411798+0000","last_undegraded":"2024-09-10T08:07:02.411798+0000","last_fullsized":"2024-09-10T08:07:02.411798+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:40.425133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427232+0000","last_change":"2024-09-10T08:06:53.927711+0000","last_active":"2024-09-10T08:07:02.427232+0000","last_peered":"2024-09-10T08:07:02.427232+0000","last_clean":"2024-09-10T08:07:02.427232+0000","last_became_active":"2024-09-10T08:06:53.927398+0000","last_became_peered":"2024-09-10T08:06:53.927398+0000","last_unstale":"2024-09-10T08:07:02.427232+0000","last_undegraded":"2024-09-10T08:07:02.427232+0000","last_fullsized":"2024-09-10T08:07:02.427232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:14:00.614829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409283+0000","last_change":"2024-09-10T08:06:53.924069+0000","last_active":"2024-09-10T08:07:02.409283+0000","last_peered":"2024-09-10T08:07:02.409283+0000","last_clean":"2024-09-10T08:07:02.409283+0000","last_became_active":"2024-09-10T08:06:53.923743+0000","last_became_peered":"2024-09-10T08:06:53.923743+0000","last_unstale":"2024-09-10T08:07:02.409283+0000","last_undegraded":"2024-09-10T08:07:02.409283+0000","last_fullsized":"2024-09-10T08:07:02.409283+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:16:18.943432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428903+0000","last_change":"2024-09-10T08:06:53.921446+0000","last_active":"2024-09-10T08:07:02.428903+0000","last_peered":"2024-09-10T08:07:02.428903+0000","last_clean":"2024-09-10T08:07:02.428903+0000","last_became_active":"2024-09-10T08:06:53.921141+0000","last_became_peered":"2024-09-10T08:06:53.921141+0000","last_unstale":"2024-09-10T08:07:02.428903+0000","last_undegraded":"2024-09-10T08:07:02.428903+0000","last_fullsized":"2024-09-10T08:07:02.428903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:58.255095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428152+0000","last_change":"2024-09-10T08:06:53.919967+0000","last_active":"2024-09-10T08:07:02.428152+0000","last_peered":"2024-09-10T08:07:02.428152+0000","last_clean":"2024-09-10T08:07:02.428152+0000","last_became_active":"2024-09-10T08:06:53.919600+0000","last_became_peered":"2024-09-10T08:06:53.919600+0000","last_unstale":"2024-09-10T08:07:02.428152+0000","last_undegraded":"2024-09-10T08:07:02.428152+0000","last_fullsized":"2024-09-10T08:07:02.428152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:22:32.298128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428189+0000","last_change":"2024-09-10T08:06:53.925851+0000","last_active":"2024-09-10T08:07:02.428189+0000","last_peered":"2024-09-10T08:07:02.428189+0000","last_clean":"2024-09-10T08:07:02.428189+0000","last_became_active":"2024-09-10T08:06:53.925548+0000","last_became_peered":"2024-09-10T08:06:53.925548+0000","last_unstale":"2024-09-10T08:07:02.428189+0000","last_undegraded":"2024-09-10T08:07:02.428189+0000","last_fullsized":"2024-09-10T08:07:02.428189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:59:11.231320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409681+0000","last_change":"2024-09-10T08:06:53.935162+0000","last_active":"2024-09-10T08:07:02.409681+0000","last_peered":"2024-09-10T08:07:02.409681+0000","last_clean":"2024-09-10T08:07:02.409681+0000","last_became_active":"2024-09-10T08:06:53.934790+0000","last_became_peered":"2024-09-10T08:06:53.934790+0000","last_unstale":"2024-09-10T08:07:02.409681+0000","last_undegraded":"2024-09-10T08:07:02.409681+0000","last_fullsized":"2024-09-10T08:07:02.409681+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:44:10.729869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407066+0000","last_change":"2024-09-10T08:06:53.926420+0000","last_active":"2024-09-10T08:07:02.407066+0000","last_peered":"2024-09-10T08:07:02.407066+0000","last_clean":"2024-09-10T08:07:02.407066+0000","last_became_active":"2024-09-10T08:06:53.925016+0000","last_became_peered":"2024-09-10T08:06:53.925016+0000","last_unstale":"2024-09-10T08:07:02.407066+0000","last_undegraded":"2024-09-10T08:07:02.407066+0000","last_fullsized":"2024-09-10T08:07:02.407066+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:29:07.459413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428465+0000","last_change":"2024-09-10T08:06:53.922632+0000","last_active":"2024-09-10T08:07:02.428465+0000","last_peered":"2024-09-10T08:07:02.428465+0000","last_clean":"2024-09-10T08:07:02.428465+0000","last_became_active":"2024-09-10T08:06:53.922328+0000","last_became_peered":"2024-09-10T08:06:53.922328+0000","last_unstale":"2024-09-10T08:07:02.428465+0000","last_undegraded":"2024-09-10T08:07:02.428465+0000","last_fullsized":"2024-09-10T08:07:02.428465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:14.136508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408385+0000","last_change":"2024-09-10T08:06:53.922697+0000","last_active":"2024-09-10T08:07:02.408385+0000","last_peered":"2024-09-10T08:07:02.408385+0000","last_clean":"2024-09-10T08:07:02.408385+0000","last_became_active":"2024-09-10T08:06:53.922392+0000","last_became_peered":"2024-09-10T08:06:53.922392+0000","last_unstale":"2024-09-10T08:07:02.408385+0000","last_undegraded":"2024-09-10T08:07:02.408385+0000","last_fullsized":"2024-09-10T08:07:02.408385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:04:24.823244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408339+0000","last_change":"2024-09-10T08:06:53.926966+0000","last_active":"2024-09-10T08:07:02.408339+0000","last_peered":"2024-09-10T08:07:02.408339+0000","last_clean":"2024-09-10T08:07:02.408339+0000","last_became_active":"2024-09-10T08:06:53.926611+0000","last_became_peered":"2024-09-10T08:06:53.926611+0000","last_unstale":"2024-09-10T08:07:02.408339+0000","last_undegraded":"2024-09-10T08:07:02.408339+0000","last_fullsized":"2024-09-10T08:07:02.408339+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:20.810104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428439+0000","last_change":"2024-09-10T08:06:53.928443+0000","last_active":"2024-09-10T08:07:02.428439+0000","last_peered":"2024-09-10T08:07:02.428439+0000","last_clean":"2024-09-10T08:07:02.428439+0000","last_became_active":"2024-09-10T08:06:53.926742+0000","last_became_peered":"2024-09-10T08:06:53.926742+0000","last_unstale":"2024-09-10T08:07:02.428439+0000","last_undegraded":"2024-09-10T08:07:02.428439+0000","last_fullsized":"2024-09-10T08:07:02.428439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:44:46.056335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.410219+0000","last_change":"2024-09-10T08:06:53.922295+0000","last_active":"2024-09-10T08:07:02.410219+0000","last_peered":"2024-09-10T08:07:02.410219+0000","last_clean":"2024-09-10T08:07:02.410219+0000","last_became_active":"2024-09-10T08:06:53.921920+0000","last_became_peered":"2024-09-10T08:06:53.921920+0000","last_unstale":"2024-09-10T08:07:02.410219+0000","last_undegraded":"2024-09-10T08:07:02.410219+0000","last_fullsized":"2024-09-10T08:07:02.410219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:41.005973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.406177+0000","last_change":"2024-09-10T08:06:53.926107+0000","last_active":"2024-09-10T08:07:02.406177+0000","last_peered":"2024-09-10T08:07:02.406177+0000","last_clean":"2024-09-10T08:07:02.406177+0000","last_became_active":"2024-09-10T08:06:53.925763+0000","last_became_peered":"2024-09-10T08:06:53.925763+0000","last_unstale":"2024-09-10T08:07:02.406177+0000","last_undegraded":"2024-09-10T08:07:02.406177+0000","last_fullsized":"2024-09-10T08:07:02.406177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:20:25.756418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407360+0000","last_change":"2024-09-10T08:06:53.917946+0000","last_active":"2024-09-10T08:07:02.407360+0000","last_peered":"2024-09-10T08:07:02.407360+0000","last_clean":"2024-09-10T08:07:02.407360+0000","last_became_active":"2024-09-10T08:06:53.917597+0000","last_became_peered":"2024-09-10T08:06:53.917597+0000","last_unstale":"2024-09-10T08:07:02.407360+0000","last_undegraded":"2024-09-10T08:07:02.407360+0000","last_fullsized":"2024-09-10T08:07:02.407360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:49:36.218971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409658+0000","last_change":"2024-09-10T08:06:53.926365+0000","last_active":"2024-09-10T08:07:02.409658+0000","last_peered":"2024-09-10T08:07:02.409658+0000","last_clean":"2024-09-10T08:07:02.409658+0000","last_became_active":"2024-09-10T08:06:53.926045+0000","last_became_peered":"2024-09-10T08:06:53.926045+0000","last_unstale":"2024-09-10T08:07:02.409658+0000","last_undegraded":"2024-09-10T08:07:02.409658+0000","last_fullsized":"2024-09-10T08:07:02.409658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:49:31.300495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428586+0000","last_change":"2024-09-10T08:06:53.924758+0000","last_active":"2024-09-10T08:07:02.428586+0000","last_peered":"2024-09-10T08:07:02.428586+0000","last_clean":"2024-09-10T08:07:02.428586+0000","last_became_active":"2024-09-10T08:06:53.924456+0000","last_became_peered":"2024-09-10T08:06:53.924456+0000","last_unstale":"2024-09-10T08:07:02.428586+0000","last_undegraded":"2024-09-10T08:07:02.428586+0000","last_fullsized":"2024-09-10T08:07:02.428586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:23.912453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427744+0000","last_change":"2024-09-10T08:06:53.929854+0000","last_active":"2024-09-10T08:07:02.427744+0000","last_peered":"2024-09-10T08:07:02.427744+0000","last_clean":"2024-09-10T08:07:02.427744+0000","last_became_active":"2024-09-10T08:06:53.929537+0000","last_became_peered":"2024-09-10T08:06:53.929537+0000","last_unstale":"2024-09-10T08:07:02.427744+0000","last_undegraded":"2024-09-10T08:07:02.427744+0000","last_fullsized":"2024-09-10T08:07:02.427744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:27:42.971321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.412582+0000","last_change":"2024-09-10T08:07:02.412169+0000","last_active":"2024-09-10T08:07:02.412582+0000","last_peered":"2024-09-10T08:07:02.412582+0000","last_clean":"2024-09-10T08:07:02.412582+0000","last_became_active":"2024-09-10T08:07:02.411592+0000","last_became_peered":"2024-09-10T08:07:02.411592+0000","last_unstale":"2024-09-10T08:07:02.412582+0000","last_undegraded":"2024-09-10T08:07:02.412582+0000","last_fullsized":"2024-09-10T08:07:02.412582+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:01:43.477920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.413886+0000","last_change":"2024-09-10T08:06:53.915136+0000","last_active":"2024-09-10T08:07:02.413886+0000","last_peered":"2024-09-10T08:07:02.413886+0000","last_clean":"2024-09-10T08:07:02.413886+0000","last_became_active":"2024-09-10T08:06:53.914825+0000","last_became_peered":"2024-09-10T08:06:53.914825+0000","last_unstale":"2024-09-10T08:07:02.413886+0000","last_undegraded":"2024-09-10T08:07:02.413886+0000","last_fullsized":"2024-09-10T08:07:02.413886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:23:17.619930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428479+0000","last_change":"2024-09-10T08:06:53.925991+0000","last_active":"2024-09-10T08:07:02.428479+0000","last_peered":"2024-09-10T08:07:02.428479+0000","last_clean":"2024-09-10T08:07:02.428479+0000","last_became_active":"2024-09-10T08:06:53.925657+0000","last_became_peered":"2024-09-10T08:06:53.925657+0000","last_unstale":"2024-09-10T08:07:02.428479+0000","last_undegraded":"2024-09-10T08:07:02.428479+0000","last_fullsized":"2024-09-10T08:07:02.428479+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:54.562209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407466+0000","last_change":"2024-09-10T08:06:53.931858+0000","last_active":"2024-09-10T08:07:02.407466+0000","last_peered":"2024-09-10T08:07:02.407466+0000","last_clean":"2024-09-10T08:07:02.407466+0000","last_became_active":"2024-09-10T08:06:53.931520+0000","last_became_peered":"2024-09-10T08:06:53.931520+0000","last_unstale":"2024-09-10T08:07:02.407466+0000","last_undegraded":"2024-09-10T08:07:02.407466+0000","last_fullsized":"2024-09-10T08:07:02.407466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:12.750769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409564+0000","last_change":"2024-09-10T08:06:53.915466+0000","last_active":"2024-09-10T08:07:02.409564+0000","last_peered":"2024-09-10T08:07:02.409564+0000","last_clean":"2024-09-10T08:07:02.409564+0000","last_became_active":"2024-09-10T08:06:53.915115+0000","last_became_peered":"2024-09-10T08:06:53.915115+0000","last_unstale":"2024-09-10T08:07:02.409564+0000","last_undegraded":"2024-09-10T08:07:02.409564+0000","last_fullsized":"2024-09-10T08:07:02.409564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:35:05.436530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428345+0000","last_change":"2024-09-10T08:06:53.928001+0000","last_active":"2024-09-10T08:07:02.428345+0000","last_peered":"2024-09-10T08:07:02.428345+0000","last_clean":"2024-09-10T08:07:02.428345+0000","last_became_active":"2024-09-10T08:06:53.927693+0000","last_became_peered":"2024-09-10T08:06:53.927693+0000","last_unstale":"2024-09-10T08:07:02.428345+0000","last_undegraded":"2024-09-10T08:07:02.428345+0000","last_fullsized":"2024-09-10T08:07:02.428345+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:59:30.712600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408691+0000","last_change":"2024-09-10T08:06:53.927006+0000","last_active":"2024-09-10T08:07:02.408691+0000","last_peered":"2024-09-10T08:07:02.408691+0000","last_clean":"2024-09-10T08:07:02.408691+0000","last_became_active":"2024-09-10T08:06:53.925607+0000","last_became_peered":"2024-09-10T08:06:53.925607+0000","last_unstale":"2024-09-10T08:07:02.408691+0000","last_undegraded":"2024-09-10T08:07:02.408691+0000","last_fullsized":"2024-09-10T08:07:02.408691+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:41:31.640763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.407216+0000","last_change":"2024-09-10T08:06:53.917197+0000","last_active":"2024-09-10T08:07:02.407216+0000","last_peered":"2024-09-10T08:07:02.407216+0000","last_clean":"2024-09-10T08:07:02.407216+0000","last_became_active":"2024-09-10T08:06:53.916830+0000","last_became_peered":"2024-09-10T08:06:53.916830+0000","last_unstale":"2024-09-10T08:07:02.407216+0000","last_undegraded":"2024-09-10T08:07:02.407216+0000","last_fullsized":"2024-09-10T08:07:02.407216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:00.887618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.416146+0000","last_change":"2024-09-10T08:07:02.416146+0000","last_active":"2024-09-10T08:07:02.416146+0000","last_peered":"2024-09-10T08:07:02.416146+0000","last_clean":"2024-09-10T08:07:02.416146+0000","last_became_active":"2024-09-10T08:07:02.415734+0000","last_became_peered":"2024-09-10T08:07:02.415734+0000","last_unstale":"2024-09-10T08:07:02.416146+0000","last_undegraded":"2024-09-10T08:07:02.416146+0000","last_fullsized":"2024-09-10T08:07:02.416146+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:21:26.811995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409617+0000","last_change":"2024-09-10T08:06:53.923406+0000","last_active":"2024-09-10T08:07:02.409617+0000","last_peered":"2024-09-10T08:07:02.409617+0000","last_clean":"2024-09-10T08:07:02.409617+0000","last_became_active":"2024-09-10T08:06:53.923012+0000","last_became_peered":"2024-09-10T08:06:53.923012+0000","last_unstale":"2024-09-10T08:07:02.409617+0000","last_undegraded":"2024-09-10T08:07:02.409617+0000","last_fullsized":"2024-09-10T08:07:02.409617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:39.426727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411368+0000","last_change":"2024-09-10T08:06:53.914764+0000","last_active":"2024-09-10T08:07:02.411368+0000","last_peered":"2024-09-10T08:07:02.411368+0000","last_clean":"2024-09-10T08:07:02.411368+0000","last_became_active":"2024-09-10T08:06:53.914431+0000","last_became_peered":"2024-09-10T08:06:53.914431+0000","last_unstale":"2024-09-10T08:07:02.411368+0000","last_undegraded":"2024-09-10T08:07:02.411368+0000","last_fullsized":"2024-09-10T08:07:02.411368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:00:29.703828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":80,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:53.537675+0000","last_change":"2024-09-10T08:06:51.854086+0000","last_active":"2024-09-10T08:07:53.537675+0000","last_peered":"2024-09-10T08:07:53.537675+0000","last_clean":"2024-09-10T08:07:53.537675+0000","last_became_active":"2024-09-10T08:06:51.853394+0000","last_became_peered":"2024-09-10T08:06:51.853394+0000","last_unstale":"2024-09-10T08:07:53.537675+0000","last_undegraded":"2024-09-10T08:07:53.537675+0000","last_fullsized":"2024-09-10T08:07:53.537675+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:58:33.688809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.414270+0000","last_change":"2024-09-10T08:06:53.927461+0000","last_active":"2024-09-10T08:07:02.414270+0000","last_peered":"2024-09-10T08:07:02.414270+0000","last_clean":"2024-09-10T08:07:02.414270+0000","last_became_active":"2024-09-10T08:06:53.927152+0000","last_became_peered":"2024-09-10T08:06:53.927152+0000","last_unstale":"2024-09-10T08:07:02.414270+0000","last_undegraded":"2024-09-10T08:07:02.414270+0000","last_fullsized":"2024-09-10T08:07:02.414270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:09:12.001671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.444057+0000","last_change":"2024-09-10T08:06:51.848621+0000","last_active":"2024-09-10T08:07:04.444057+0000","last_peered":"2024-09-10T08:07:04.444057+0000","last_clean":"2024-09-10T08:07:04.444057+0000","last_became_active":"2024-09-10T08:06:51.848239+0000","last_became_peered":"2024-09-10T08:06:51.848239+0000","last_unstale":"2024-09-10T08:07:04.444057+0000","last_undegraded":"2024-09-10T08:07:04.444057+0000","last_fullsized":"2024-09-10T08:07:04.444057+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:54:00.816865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:03.436227+0000","last_change":"2024-09-10T08:06:51.844344+0000","last_active":"2024-09-10T08:07:03.436227+0000","last_peered":"2024-09-10T08:07:03.436227+0000","last_clean":"2024-09-10T08:07:03.436227+0000","last_became_active":"2024-09-10T08:06:51.844054+0000","last_became_peered":"2024-09-10T08:06:51.844054+0000","last_unstale":"2024-09-10T08:07:03.436227+0000","last_undegraded":"2024-09-10T08:07:03.436227+0000","last_fullsized":"2024-09-10T08:07:03.436227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:10:43.646632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428861+0000","last_change":"2024-09-10T08:06:53.914172+0000","last_active":"2024-09-10T08:07:02.428861+0000","last_peered":"2024-09-10T08:07:02.428861+0000","last_clean":"2024-09-10T08:07:02.428861+0000","last_became_active":"2024-09-10T08:06:53.913837+0000","last_became_peered":"2024-09-10T08:06:53.913837+0000","last_unstale":"2024-09-10T08:07:02.428861+0000","last_undegraded":"2024-09-10T08:07:02.428861+0000","last_fullsized":"2024-09-10T08:07:02.428861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:37:54.095685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.463531+0000","last_change":"2024-09-10T08:06:51.852474+0000","last_active":"2024-09-10T08:07:04.463531+0000","last_peered":"2024-09-10T08:07:04.463531+0000","last_clean":"2024-09-10T08:07:04.463531+0000","last_became_active":"2024-09-10T08:06:51.852097+0000","last_became_peered":"2024-09-10T08:06:51.852097+0000","last_unstale":"2024-09-10T08:07:04.463531+0000","last_undegraded":"2024-09-10T08:07:04.463531+0000","last_fullsized":"2024-09-10T08:07:04.463531+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:31:20.611988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.405898+0000","last_change":"2024-09-10T08:06:53.925345+0000","last_active":"2024-09-10T08:07:02.405898+0000","last_peered":"2024-09-10T08:07:02.405898+0000","last_clean":"2024-09-10T08:07:02.405898+0000","last_became_active":"2024-09-10T08:06:53.925017+0000","last_became_peered":"2024-09-10T08:06:53.925017+0000","last_unstale":"2024-09-10T08:07:02.405898+0000","last_undegraded":"2024-09-10T08:07:02.405898+0000","last_fullsized":"2024-09-10T08:07:02.405898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:22.692658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":134,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:57.542986+0000","last_change":"2024-09-10T08:06:51.849126+0000","last_active":"2024-09-10T08:07:57.542986+0000","last_peered":"2024-09-10T08:07:57.542986+0000","last_clean":"2024-09-10T08:07:57.542986+0000","last_became_active":"2024-09-10T08:06:51.848504+0000","last_became_peered":"2024-09-10T08:06:51.848504+0000","last_unstale":"2024-09-10T08:07:57.542986+0000","last_undegraded":"2024-09-10T08:07:57.542986+0000","last_fullsized":"2024-09-10T08:07:57.542986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:56:36.691846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":108,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428899+0000","last_change":"2024-09-10T08:06:53.930777+0000","last_active":"2024-09-10T08:07:02.428899+0000","last_peered":"2024-09-10T08:07:02.428899+0000","last_clean":"2024-09-10T08:07:02.428899+0000","last_became_active":"2024-09-10T08:06:53.929781+0000","last_became_peered":"2024-09-10T08:06:53.929781+0000","last_unstale":"2024-09-10T08:07:02.428899+0000","last_undegraded":"2024-09-10T08:07:02.428899+0000","last_fullsized":"2024-09-10T08:07:02.428899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:17:07.184254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.465673+0000","last_change":"2024-09-10T08:07:02.431452+0000","last_active":"2024-09-10T08:07:04.465673+0000","last_peered":"2024-09-10T08:07:04.465673+0000","last_clean":"2024-09-10T08:07:04.465673+0000","last_became_active":"2024-09-10T08:07:02.430794+0000","last_became_peered":"2024-09-10T08:07:02.430794+0000","last_unstale":"2024-09-10T08:07:04.465673+0000","last_undegraded":"2024-09-10T08:07:04.465673+0000","last_fullsized":"2024-09-10T08:07:04.465673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:46:48.313101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408754+0000","last_change":"2024-09-10T08:06:53.924896+0000","last_active":"2024-09-10T08:07:02.408754+0000","last_peered":"2024-09-10T08:07:02.408754+0000","last_clean":"2024-09-10T08:07:02.408754+0000","last_became_active":"2024-09-10T08:06:53.924593+0000","last_became_peered":"2024-09-10T08:06:53.924593+0000","last_unstale":"2024-09-10T08:07:02.408754+0000","last_undegraded":"2024-09-10T08:07:02.408754+0000","last_fullsized":"2024-09-10T08:07:02.408754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:32:49.802792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.444479+0000","last_change":"2024-09-10T08:06:52.045216+0000","last_active":"2024-09-10T08:07:04.444479+0000","last_peered":"2024-09-10T08:07:04.444479+0000","last_clean":"2024-09-10T08:07:04.444479+0000","last_became_active":"2024-09-10T08:06:52.044707+0000","last_became_peered":"2024-09-10T08:06:52.044707+0000","last_unstale":"2024-09-10T08:07:04.444479+0000","last_undegraded":"2024-09-10T08:07:04.444479+0000","last_fullsized":"2024-09-10T08:07:04.444479+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:00:59.778427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427975+0000","last_change":"2024-09-10T08:06:53.932607+0000","last_active":"2024-09-10T08:07:02.427975+0000","last_peered":"2024-09-10T08:07:02.427975+0000","last_clean":"2024-09-10T08:07:02.427975+0000","last_became_active":"2024-09-10T08:06:53.932149+0000","last_became_peered":"2024-09-10T08:06:53.932149+0000","last_unstale":"2024-09-10T08:07:02.427975+0000","last_undegraded":"2024-09-10T08:07:02.427975+0000","last_fullsized":"2024-09-10T08:07:02.427975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:40.969547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'29","reported_seq":167,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:57.542979+0000","last_change":"2024-09-10T08:06:51.854321+0000","last_active":"2024-09-10T08:07:57.542979+0000","last_peered":"2024-09-10T08:07:57.542979+0000","last_clean":"2024-09-10T08:07:57.542979+0000","last_became_active":"2024-09-10T08:06:51.853931+0000","last_became_peered":"2024-09-10T08:06:51.853931+0000","last_unstale":"2024-09-10T08:07:57.542979+0000","last_undegraded":"2024-09-10T08:07:57.542979+0000","last_fullsized":"2024-09-10T08:07:57.542979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:07:30.930761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61199,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":117,"num_write":31,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411799+0000","last_change":"2024-09-10T08:06:53.924899+0000","last_active":"2024-09-10T08:07:02.411799+0000","last_peered":"2024-09-10T08:07:02.411799+0000","last_clean":"2024-09-10T08:07:02.411799+0000","last_became_active":"2024-09-10T08:06:53.924571+0000","last_became_peered":"2024-09-10T08:06:53.924571+0000","last_unstale":"2024-09-10T08:07:02.411799+0000","last_undegraded":"2024-09-10T08:07:02.411799+0000","last_fullsized":"2024-09-10T08:07:02.411799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:04.681689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.467171+0000","last_change":"2024-09-10T08:06:51.851860+0000","last_active":"2024-09-10T08:07:04.467171+0000","last_peered":"2024-09-10T08:07:04.467171+0000","last_clean":"2024-09-10T08:07:04.467171+0000","last_became_active":"2024-09-10T08:06:51.851520+0000","last_became_peered":"2024-09-10T08:06:51.851520+0000","last_unstale":"2024-09-10T08:07:04.467171+0000","last_undegraded":"2024-09-10T08:07:04.467171+0000","last_fullsized":"2024-09-10T08:07:04.467171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:06:20.182866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427983+0000","last_change":"2024-09-10T08:06:53.924888+0000","last_active":"2024-09-10T08:07:02.427983+0000","last_peered":"2024-09-10T08:07:02.427983+0000","last_clean":"2024-09-10T08:07:02.427983+0000","last_became_active":"2024-09-10T08:06:53.924572+0000","last_became_peered":"2024-09-10T08:06:53.924572+0000","last_unstale":"2024-09-10T08:07:02.427983+0000","last_undegraded":"2024-09-10T08:07:02.427983+0000","last_fullsized":"2024-09-10T08:07:02.427983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:26:19.446554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.465505+0000","last_change":"2024-09-10T08:06:51.848665+0000","last_active":"2024-09-10T08:07:04.465505+0000","last_peered":"2024-09-10T08:07:04.465505+0000","last_clean":"2024-09-10T08:07:04.465505+0000","last_became_active":"2024-09-10T08:06:51.848301+0000","last_became_peered":"2024-09-10T08:06:51.848301+0000","last_unstale":"2024-09-10T08:07:04.465505+0000","last_undegraded":"2024-09-10T08:07:04.465505+0000","last_fullsized":"2024-09-10T08:07:04.465505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:16:32.754470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409650+0000","last_change":"2024-09-10T08:06:53.933953+0000","last_active":"2024-09-10T08:07:02.409650+0000","last_peered":"2024-09-10T08:07:02.409650+0000","last_clean":"2024-09-10T08:07:02.409650+0000","last_became_active":"2024-09-10T08:06:53.933590+0000","last_became_peered":"2024-09-10T08:06:53.933590+0000","last_unstale":"2024-09-10T08:07:02.409650+0000","last_undegraded":"2024-09-10T08:07:02.409650+0000","last_fullsized":"2024-09-10T08:07:02.409650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:31:54.530660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:54.538210+0000","last_change":"2024-09-10T08:06:51.847673+0000","last_active":"2024-09-10T08:07:54.538210+0000","last_peered":"2024-09-10T08:07:54.538210+0000","last_clean":"2024-09-10T08:07:54.538210+0000","last_became_active":"2024-09-10T08:06:51.847324+0000","last_became_peered":"2024-09-10T08:06:51.847324+0000","last_unstale":"2024-09-10T08:07:54.538210+0000","last_undegraded":"2024-09-10T08:07:54.538210+0000","last_fullsized":"2024-09-10T08:07:54.538210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:32:24.962333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409220+0000","last_change":"2024-09-10T08:06:53.929884+0000","last_active":"2024-09-10T08:07:02.409220+0000","last_peered":"2024-09-10T08:07:02.409220+0000","last_clean":"2024-09-10T08:07:02.409220+0000","last_became_active":"2024-09-10T08:06:53.927766+0000","last_became_peered":"2024-09-10T08:06:53.927766+0000","last_unstale":"2024-09-10T08:07:02.409220+0000","last_undegraded":"2024-09-10T08:07:02.409220+0000","last_fullsized":"2024-09-10T08:07:02.409220+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:16:18.403993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.458590+0000","last_change":"2024-09-10T08:07:02.425907+0000","last_active":"2024-09-10T08:07:04.458590+0000","last_peered":"2024-09-10T08:07:04.458590+0000","last_clean":"2024-09-10T08:07:04.458590+0000","last_became_active":"2024-09-10T08:07:02.416949+0000","last_became_peered":"2024-09-10T08:07:02.416949+0000","last_unstale":"2024-09-10T08:07:04.458590+0000","last_undegraded":"2024-09-10T08:07:04.458590+0000","last_fullsized":"2024-09-10T08:07:04.458590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:19:01.410272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.413786+0000","last_change":"2024-09-10T08:06:53.927620+0000","last_active":"2024-09-10T08:07:02.413786+0000","last_peered":"2024-09-10T08:07:02.413786+0000","last_clean":"2024-09-10T08:07:02.413786+0000","last_became_active":"2024-09-10T08:06:53.926543+0000","last_became_peered":"2024-09-10T08:06:53.926543+0000","last_unstale":"2024-09-10T08:07:02.413786+0000","last_undegraded":"2024-09-10T08:07:02.413786+0000","last_fullsized":"2024-09-10T08:07:02.413786+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:40:18.210472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.432980+0000","last_change":"2024-09-10T08:07:02.430550+0000","last_active":"2024-09-10T08:07:04.432980+0000","last_peered":"2024-09-10T08:07:04.432980+0000","last_clean":"2024-09-10T08:07:04.432980+0000","last_became_active":"2024-09-10T08:07:02.416317+0000","last_became_peered":"2024-09-10T08:07:02.416317+0000","last_unstale":"2024-09-10T08:07:04.432980+0000","last_undegraded":"2024-09-10T08:07:04.432980+0000","last_fullsized":"2024-09-10T08:07:04.432980+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:20:10.317471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409840+0000","last_change":"2024-09-10T08:06:53.925598+0000","last_active":"2024-09-10T08:07:02.409840+0000","last_peered":"2024-09-10T08:07:02.409840+0000","last_clean":"2024-09-10T08:07:02.409840+0000","last_became_active":"2024-09-10T08:06:53.925253+0000","last_became_peered":"2024-09-10T08:06:53.925253+0000","last_unstale":"2024-09-10T08:07:02.409840+0000","last_undegraded":"2024-09-10T08:07:02.409840+0000","last_fullsized":"2024-09-10T08:07:02.409840+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:03:29.662057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.465757+0000","last_change":"2024-09-10T08:06:51.851790+0000","last_active":"2024-09-10T08:07:04.465757+0000","last_peered":"2024-09-10T08:07:04.465757+0000","last_clean":"2024-09-10T08:07:04.465757+0000","last_became_active":"2024-09-10T08:06:51.851417+0000","last_became_peered":"2024-09-10T08:06:51.851417+0000","last_unstale":"2024-09-10T08:07:04.465757+0000","last_undegraded":"2024-09-10T08:07:04.465757+0000","last_fullsized":"2024-09-10T08:07:04.465757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:46:41.432728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409698+0000","last_change":"2024-09-10T08:06:53.926530+0000","last_active":"2024-09-10T08:07:02.409698+0000","last_peered":"2024-09-10T08:07:02.409698+0000","last_clean":"2024-09-10T08:07:02.409698+0000","last_became_active":"2024-09-10T08:06:53.926191+0000","last_became_peered":"2024-09-10T08:06:53.926191+0000","last_unstale":"2024-09-10T08:07:02.409698+0000","last_undegraded":"2024-09-10T08:07:02.409698+0000","last_fullsized":"2024-09-10T08:07:02.409698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:20:09.789763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.458396+0000","last_change":"2024-09-10T08:06:51.846679+0000","last_active":"2024-09-10T08:07:04.458396+0000","last_peered":"2024-09-10T08:07:04.458396+0000","last_clean":"2024-09-10T08:07:04.458396+0000","last_became_active":"2024-09-10T08:06:51.846328+0000","last_became_peered":"2024-09-10T08:06:51.846328+0000","last_unstale":"2024-09-10T08:07:04.458396+0000","last_undegraded":"2024-09-10T08:07:04.458396+0000","last_fullsized":"2024-09-10T08:07:04.458396+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:18:09.207285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409613+0000","last_change":"2024-09-10T08:06:53.928316+0000","last_active":"2024-09-10T08:07:02.409613+0000","last_peered":"2024-09-10T08:07:02.409613+0000","last_clean":"2024-09-10T08:07:02.409613+0000","last_became_active":"2024-09-10T08:06:53.927974+0000","last_became_peered":"2024-09-10T08:06:53.927974+0000","last_unstale":"2024-09-10T08:07:02.409613+0000","last_undegraded":"2024-09-10T08:07:02.409613+0000","last_fullsized":"2024-09-10T08:07:02.409613+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:06.875492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'6","reported_seq":86,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:57.543782+0000","last_change":"2024-09-10T08:06:52.151494+0000","last_active":"2024-09-10T08:07:57.543782+0000","last_peered":"2024-09-10T08:07:57.543782+0000","last_clean":"2024-09-10T08:07:57.543782+0000","last_became_active":"2024-09-10T08:06:52.151029+0000","last_became_peered":"2024-09-10T08:06:52.151029+0000","last_unstale":"2024-09-10T08:07:57.543782+0000","last_undegraded":"2024-09-10T08:07:57.543782+0000","last_fullsized":"2024-09-10T08:07:57.543782+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:45:23.632526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409767+0000","last_change":"2024-09-10T08:06:53.935415+0000","last_active":"2024-09-10T08:07:02.409767+0000","last_peered":"2024-09-10T08:07:02.409767+0000","last_clean":"2024-09-10T08:07:02.409767+0000","last_became_active":"2024-09-10T08:06:53.934855+0000","last_became_peered":"2024-09-10T08:06:53.934855+0000","last_unstale":"2024-09-10T08:07:02.409767+0000","last_undegraded":"2024-09-10T08:07:02.409767+0000","last_fullsized":"2024-09-10T08:07:02.409767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:42:08.799487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409575+0000","last_change":"2024-09-10T08:05:41.349856+0000","last_active":"2024-09-10T08:07:02.409575+0000","last_peered":"2024-09-10T08:07:02.409575+0000","last_clean":"2024-09-10T08:07:02.409575+0000","last_became_active":"2024-09-10T08:05:41.349403+0000","last_became_peered":"2024-09-10T08:05:41.349403+0000","last_unstale":"2024-09-10T08:07:02.409575+0000","last_undegraded":"2024-09-10T08:07:02.409575+0000","last_fullsized":"2024-09-10T08:07:02.409575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:02:15.710253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:02:15.710253+0000","last_clean_scrub_stamp":"2024-09-10T08:02:15.710253+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:43.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.466365+0000","last_change":"2024-09-10T08:06:51.846885+0000","last_active":"2024-09-10T08:07:04.466365+0000","last_peered":"2024-09-10T08:07:04.466365+0000","last_clean":"2024-09-10T08:07:04.466365+0000","last_became_active":"2024-09-10T08:06:51.846548+0000","last_became_peered":"2024-09-10T08:06:51.846548+0000","last_unstale":"2024-09-10T08:07:04.466365+0000","last_undegraded":"2024-09-10T08:07:04.466365+0000","last_fullsized":"2024-09-10T08:07:04.466365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:04:00.702987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428558+0000","last_change":"2024-09-10T08:06:53.916122+0000","last_active":"2024-09-10T08:07:02.428558+0000","last_peered":"2024-09-10T08:07:02.428558+0000","last_clean":"2024-09-10T08:07:02.428558+0000","last_became_active":"2024-09-10T08:06:53.915816+0000","last_became_peered":"2024-09-10T08:06:53.915816+0000","last_unstale":"2024-09-10T08:07:02.428558+0000","last_undegraded":"2024-09-10T08:07:02.428558+0000","last_fullsized":"2024-09-10T08:07:02.428558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:54:59.454276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:03.436486+0000","last_change":"2024-09-10T08:06:51.851031+0000","last_active":"2024-09-10T08:07:03.436486+0000","last_peered":"2024-09-10T08:07:03.436486+0000","last_clean":"2024-09-10T08:07:03.436486+0000","last_became_active":"2024-09-10T08:06:51.850518+0000","last_became_peered":"2024-09-10T08:06:51.850518+0000","last_unstale":"2024-09-10T08:07:03.436486+0000","last_undegraded":"2024-09-10T08:07:03.436486+0000","last_fullsized":"2024-09-10T08:07:03.436486+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:54:29.350976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427966+0000","last_change":"2024-09-10T08:06:53.923868+0000","last_active":"2024-09-10T08:07:02.427966+0000","last_peered":"2024-09-10T08:07:02.427966+0000","last_clean":"2024-09-10T08:07:02.427966+0000","last_became_active":"2024-09-10T08:06:53.923536+0000","last_became_peered":"2024-09-10T08:06:53.923536+0000","last_unstale":"2024-09-10T08:07:02.427966+0000","last_undegraded":"2024-09-10T08:07:02.427966+0000","last_fullsized":"2024-09-10T08:07:02.427966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:51.635192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:55.539132+0000","last_change":"2024-09-10T08:06:52.044706+0000","last_active":"2024-09-10T08:07:55.539132+0000","last_peered":"2024-09-10T08:07:55.539132+0000","last_clean":"2024-09-10T08:07:55.539132+0000","last_became_active":"2024-09-10T08:06:52.044363+0000","last_became_peered":"2024-09-10T08:06:52.044363+0000","last_unstale":"2024-09-10T08:07:55.539132+0000","last_undegraded":"2024-09-10T08:07:55.539132+0000","last_fullsized":"2024-09-10T08:07:55.539132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:45:34.190568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409680+0000","last_change":"2024-09-10T08:07:02.409349+0000","last_active":"2024-09-10T08:07:02.409680+0000","last_peered":"2024-09-10T08:07:02.409680+0000","last_clean":"2024-09-10T08:07:02.409680+0000","last_became_active":"2024-09-10T08:07:02.408940+0000","last_became_peered":"2024-09-10T08:07:02.408940+0000","last_unstale":"2024-09-10T08:07:02.409680+0000","last_undegraded":"2024-09-10T08:07:02.409680+0000","last_fullsized":"2024-09-10T08:07:02.409680+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:10.702479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,4],"acting":[9,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:54.550056+0000","last_change":"2024-09-10T08:06:51.851874+0000","last_active":"2024-09-10T08:07:54.550056+0000","last_peered":"2024-09-10T08:07:54.550056+0000","last_clean":"2024-09-10T08:07:54.550056+0000","last_became_active":"2024-09-10T08:06:51.851473+0000","last_became_peered":"2024-09-10T08:06:51.851473+0000","last_unstale":"2024-09-10T08:07:54.550056+0000","last_undegraded":"2024-09-10T08:07:54.550056+0000","last_fullsized":"2024-09-10T08:07:54.550056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:54:29.273643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427638+0000","last_change":"2024-09-10T08:06:53.925677+0000","last_active":"2024-09-10T08:07:02.427638+0000","last_peered":"2024-09-10T08:07:02.427638+0000","last_clean":"2024-09-10T08:07:02.427638+0000","last_became_active":"2024-09-10T08:06:53.925374+0000","last_became_peered":"2024-09-10T08:06:53.925374+0000","last_unstale":"2024-09-10T08:07:02.427638+0000","last_undegraded":"2024-09-10T08:07:02.427638+0000","last_fullsized":"2024-09-10T08:07:02.427638+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:33:13.138156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.406100+0000","last_change":"2024-09-10T08:06:52.044960+0000","last_active":"2024-09-10T08:07:02.406100+0000","last_peered":"2024-09-10T08:07:02.406100+0000","last_clean":"2024-09-10T08:07:02.406100+0000","last_became_active":"2024-09-10T08:06:52.044606+0000","last_became_peered":"2024-09-10T08:06:52.044606+0000","last_unstale":"2024-09-10T08:07:02.406100+0000","last_undegraded":"2024-09-10T08:07:02.406100+0000","last_fullsized":"2024-09-10T08:07:02.406100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:08:53.165305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428241+0000","last_change":"2024-09-10T08:06:53.922433+0000","last_active":"2024-09-10T08:07:02.428241+0000","last_peered":"2024-09-10T08:07:02.428241+0000","last_clean":"2024-09-10T08:07:02.428241+0000","last_became_active":"2024-09-10T08:06:53.922071+0000","last_became_peered":"2024-09-10T08:06:53.922071+0000","last_unstale":"2024-09-10T08:07:02.428241+0000","last_undegraded":"2024-09-10T08:07:02.428241+0000","last_fullsized":"2024-09-10T08:07:02.428241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:07:50.971467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.458913+0000","last_change":"2024-09-10T08:06:52.045082+0000","last_active":"2024-09-10T08:07:04.458913+0000","last_peered":"2024-09-10T08:07:04.458913+0000","last_clean":"2024-09-10T08:07:04.458913+0000","last_became_active":"2024-09-10T08:06:52.044536+0000","last_became_peered":"2024-09-10T08:06:52.044536+0000","last_unstale":"2024-09-10T08:07:04.458913+0000","last_undegraded":"2024-09-10T08:07:04.458913+0000","last_fullsized":"2024-09-10T08:07:04.458913+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:13:49.639035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428443+0000","last_change":"2024-09-10T08:06:53.923357+0000","last_active":"2024-09-10T08:07:02.428443+0000","last_peered":"2024-09-10T08:07:02.428443+0000","last_clean":"2024-09-10T08:07:02.428443+0000","last_became_active":"2024-09-10T08:06:53.923060+0000","last_became_peered":"2024-09-10T08:06:53.923060+0000","last_unstale":"2024-09-10T08:07:02.428443+0000","last_undegraded":"2024-09-10T08:07:02.428443+0000","last_fullsized":"2024-09-10T08:07:02.428443+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:08:28.242894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'14","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:19.382230+0000","last_change":"2024-09-10T08:06:51.846268+0000","last_active":"2024-09-10T08:07:19.382230+0000","last_peered":"2024-09-10T08:07:19.382230+0000","last_clean":"2024-09-10T08:07:19.382230+0000","last_became_active":"2024-09-10T08:06:51.845891+0000","last_became_peered":"2024-09-10T08:06:51.845891+0000","last_unstale":"2024-09-10T08:07:19.382230+0000","last_undegraded":"2024-09-10T08:07:19.382230+0000","last_fullsized":"2024-09-10T08:07:19.382230+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:14:52.621019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428556+0000","last_change":"2024-09-10T08:06:53.927836+0000","last_active":"2024-09-10T08:07:02.428556+0000","last_peered":"2024-09-10T08:07:02.428556+0000","last_clean":"2024-09-10T08:07:02.428556+0000","last_became_active":"2024-09-10T08:06:53.927339+0000","last_became_peered":"2024-09-10T08:06:53.927339+0000","last_unstale":"2024-09-10T08:07:02.428556+0000","last_undegraded":"2024-09-10T08:07:02.428556+0000","last_fullsized":"2024-09-10T08:07:02.428556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:17:55.569050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.466698+0000","last_change":"2024-09-10T08:06:52.151335+0000","last_active":"2024-09-10T08:07:04.466698+0000","last_peered":"2024-09-10T08:07:04.466698+0000","last_clean":"2024-09-10T08:07:04.466698+0000","last_became_active":"2024-09-10T08:06:52.150965+0000","last_became_peered":"2024-09-10T08:06:52.150965+0000","last_unstale":"2024-09-10T08:07:04.466698+0000","last_undegraded":"2024-09-10T08:07:04.466698+0000","last_fullsized":"2024-09-10T08:07:04.466698+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:14:43.933254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.431020+0000","last_change":"2024-09-10T08:07:02.431020+0000","last_active":"2024-09-10T08:07:02.431020+0000","last_peered":"2024-09-10T08:07:02.431020+0000","last_clean":"2024-09-10T08:07:02.431020+0000","last_became_active":"2024-09-10T08:07:02.429794+0000","last_became_peered":"2024-09-10T08:07:02.429794+0000","last_unstale":"2024-09-10T08:07:02.431020+0000","last_undegraded":"2024-09-10T08:07:02.431020+0000","last_fullsized":"2024-09-10T08:07:02.431020+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:17:49.386164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.433054+0000","last_change":"2024-09-10T08:06:52.044739+0000","last_active":"2024-09-10T08:07:02.433054+0000","last_peered":"2024-09-10T08:07:02.433054+0000","last_clean":"2024-09-10T08:07:02.433054+0000","last_became_active":"2024-09-10T08:06:52.044424+0000","last_became_peered":"2024-09-10T08:06:52.044424+0000","last_unstale":"2024-09-10T08:07:02.433054+0000","last_undegraded":"2024-09-10T08:07:02.433054+0000","last_fullsized":"2024-09-10T08:07:02.433054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:24:01.279274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.411626+0000","last_change":"2024-09-10T08:06:53.918245+0000","last_active":"2024-09-10T08:07:02.411626+0000","last_peered":"2024-09-10T08:07:02.411626+0000","last_clean":"2024-09-10T08:07:02.411626+0000","last_became_active":"2024-09-10T08:06:53.917857+0000","last_became_peered":"2024-09-10T08:06:53.917857+0000","last_unstale":"2024-09-10T08:07:02.411626+0000","last_undegraded":"2024-09-10T08:07:02.411626+0000","last_fullsized":"2024-09-10T08:07:02.411626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:18:53.762361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.466341+0000","last_change":"2024-09-10T08:06:51.845368+0000","last_active":"2024-09-10T08:07:04.466341+0000","last_peered":"2024-09-10T08:07:04.466341+0000","last_clean":"2024-09-10T08:07:04.466341+0000","last_became_active":"2024-09-10T08:06:51.845052+0000","last_became_peered":"2024-09-10T08:06:51.845052+0000","last_unstale":"2024-09-10T08:07:04.466341+0000","last_undegraded":"2024-09-10T08:07:04.466341+0000","last_fullsized":"2024-09-10T08:07:04.466341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:17:45.620311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409721+0000","last_change":"2024-09-10T08:06:53.923576+0000","last_active":"2024-09-10T08:07:02.409721+0000","last_peered":"2024-09-10T08:07:02.409721+0000","last_clean":"2024-09-10T08:07:02.409721+0000","last_became_active":"2024-09-10T08:06:53.922934+0000","last_became_peered":"2024-09-10T08:06:53.922934+0000","last_unstale":"2024-09-10T08:07:02.409721+0000","last_undegraded":"2024-09-10T08:07:02.409721+0000","last_fullsized":"2024-09-10T08:07:02.409721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:48:06.088145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.444804+0000","last_change":"2024-09-10T08:06:51.850535+0000","last_active":"2024-09-10T08:07:04.444804+0000","last_peered":"2024-09-10T08:07:04.444804+0000","last_clean":"2024-09-10T08:07:04.444804+0000","last_became_active":"2024-09-10T08:06:51.850146+0000","last_became_peered":"2024-09-10T08:06:51.850146+0000","last_unstale":"2024-09-10T08:07:04.444804+0000","last_undegraded":"2024-09-10T08:07:04.444804+0000","last_fullsized":"2024-09-10T08:07:04.444804+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:28.327887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.429015+0000","last_change":"2024-09-10T08:06:53.922375+0000","last_active":"2024-09-10T08:07:02.429015+0000","last_peered":"2024-09-10T08:07:02.429015+0000","last_clean":"2024-09-10T08:07:02.429015+0000","last_became_active":"2024-09-10T08:06:53.922038+0000","last_became_peered":"2024-09-10T08:06:53.922038+0000","last_unstale":"2024-09-10T08:07:02.429015+0000","last_undegraded":"2024-09-10T08:07:02.429015+0000","last_fullsized":"2024-09-10T08:07:02.429015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:32.710083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:03.149639+0000","last_change":"2024-09-10T08:07:02.419694+0000","last_active":"2024-09-10T08:07:03.149639+0000","last_peered":"2024-09-10T08:07:03.149639+0000","last_clean":"2024-09-10T08:07:03.149639+0000","last_became_active":"2024-09-10T08:07:02.415181+0000","last_became_peered":"2024-09-10T08:07:02.415181+0000","last_unstale":"2024-09-10T08:07:03.149639+0000","last_undegraded":"2024-09-10T08:07:03.149639+0000","last_fullsized":"2024-09-10T08:07:03.149639+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:01.023611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.409406+0000","last_change":"2024-09-10T08:06:53.934546+0000","last_active":"2024-09-10T08:07:02.409406+0000","last_peered":"2024-09-10T08:07:02.409406+0000","last_clean":"2024-09-10T08:07:02.409406+0000","last_became_active":"2024-09-10T08:06:53.933883+0000","last_became_peered":"2024-09-10T08:06:53.933883+0000","last_unstale":"2024-09-10T08:07:02.409406+0000","last_undegraded":"2024-09-10T08:07:02.409406+0000","last_fullsized":"2024-09-10T08:07:02.409406+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:08:09.396870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.414803+0000","last_change":"2024-09-10T08:06:53.925407+0000","last_active":"2024-09-10T08:07:02.414803+0000","last_peered":"2024-09-10T08:07:02.414803+0000","last_clean":"2024-09-10T08:07:02.414803+0000","last_became_active":"2024-09-10T08:06:53.925057+0000","last_became_peered":"2024-09-10T08:06:53.925057+0000","last_unstale":"2024-09-10T08:07:02.414803+0000","last_undegraded":"2024-09-10T08:07:02.414803+0000","last_fullsized":"2024-09-10T08:07:02.414803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:52.012219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.467437+0000","last_change":"2024-09-10T08:06:51.852922+0000","last_active":"2024-09-10T08:07:04.467437+0000","last_peered":"2024-09-10T08:07:04.467437+0000","last_clean":"2024-09-10T08:07:04.467437+0000","last_became_active":"2024-09-10T08:06:51.852354+0000","last_became_peered":"2024-09-10T08:06:51.852354+0000","last_unstale":"2024-09-10T08:07:04.467437+0000","last_undegraded":"2024-09-10T08:07:04.467437+0000","last_fullsized":"2024-09-10T08:07:04.467437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:50:21.559686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.427871+0000","last_change":"2024-09-10T08:06:53.932155+0000","last_active":"2024-09-10T08:07:02.427871+0000","last_peered":"2024-09-10T08:07:02.427871+0000","last_clean":"2024-09-10T08:07:02.427871+0000","last_became_active":"2024-09-10T08:06:53.931688+0000","last_became_peered":"2024-09-10T08:06:53.931688+0000","last_unstale":"2024-09-10T08:07:02.427871+0000","last_undegraded":"2024-09-10T08:07:02.427871+0000","last_fullsized":"2024-09-10T08:07:02.427871+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:43:58.481716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":35,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:04.467357+0000","last_change":"2024-09-10T08:06:51.851900+0000","last_active":"2024-09-10T08:07:04.467357+0000","last_peered":"2024-09-10T08:07:04.467357+0000","last_clean":"2024-09-10T08:07:04.467357+0000","last_became_active":"2024-09-10T08:06:51.851509+0000","last_became_peered":"2024-09-10T08:06:51.851509+0000","last_unstale":"2024-09-10T08:07:04.467357+0000","last_undegraded":"2024-09-10T08:07:04.467357+0000","last_fullsized":"2024-09-10T08:07:04.467357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:41.250995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.408641+0000","last_change":"2024-09-10T08:06:53.917320+0000","last_active":"2024-09-10T08:07:02.408641+0000","last_peered":"2024-09-10T08:07:02.408641+0000","last_clean":"2024-09-10T08:07:02.408641+0000","last_became_active":"2024-09-10T08:06:53.917027+0000","last_became_peered":"2024-09-10T08:06:53.917027+0000","last_unstale":"2024-09-10T08:07:02.408641+0000","last_undegraded":"2024-09-10T08:07:02.408641+0000","last_fullsized":"2024-09-10T08:07:02.408641+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:23:08.882036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428812+0000","last_change":"2024-09-10T08:06:52.046168+0000","last_active":"2024-09-10T08:07:02.428812+0000","last_peered":"2024-09-10T08:07:02.428812+0000","last_clean":"2024-09-10T08:07:02.428812+0000","last_became_active":"2024-09-10T08:06:52.045825+0000","last_became_peered":"2024-09-10T08:06:52.045825+0000","last_unstale":"2024-09-10T08:07:02.428812+0000","last_undegraded":"2024-09-10T08:07:02.428812+0000","last_fullsized":"2024-09-10T08:07:02.428812+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:07:15.467875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:02.428487+0000","last_change":"2024-09-10T08:06:53.922449+0000","last_active":"2024-09-10T08:07:02.428487+0000","last_peered":"2024-09-10T08:07:02.428487+0000","last_clean":"2024-09-10T08:07:02.428487+0000","last_became_active":"2024-09-10T08:06:53.922123+0000","last_became_peered":"2024-09-10T08:06:53.922123+0000","last_unstale":"2024-09-10T08:07:02.428487+0000","last_undegraded":"2024-09-10T08:07:02.428487+0000","last_fullsized":"2024-09-10T08:07:02.428487+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:52.896348+0000","last_clean_scrub_stamp":"2024-09-10T08:06:52.896348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:43:44.424257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":89,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-10T08:07:56.552257+0000","last_change":"2024-09-10T08:06:51.847689+0000","last_active":"2024-09-10T08:07:56.552257+0000","last_peered":"2024-09-10T08:07:56.552257+0000","last_clean":"2024-09-10T08:07:56.552257+0000","last_became_active":"2024-09-10T08:06:51.847394+0000","last_became_peered":"2024-09-10T08:06:51.847394+0000","last_unstale":"2024-09-10T08:07:56.552257+0000","last_undegraded":"2024-09-10T08:07:56.552257+0000","last_fullsized":"2024-09-10T08:07:56.552257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:06:50.829771+0000","last_clean_scrub_stamp":"2024-09-10T08:06:50.829771+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:55:58.581814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68014,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":570,"num_read_kb":362,"num_write":239,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":204042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":285538,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547227,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":909312,"data_stored":438048,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776159,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":1089861,"data_compressed":42108,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939685,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":437563,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168618,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":437919,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397550,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":1030068,"data_compressed":42108,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561076,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":913408,"data_stored":437280,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790008,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":1029746,"data_compressed":42108,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":921600,"data_stored":437253,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36252,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708900,"statfs":{"total":95995035648,"available":95957913600,"internally_reserved":0,"allocated":929792,"data_stored":437105,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":499893,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":499392,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":439012,"data_compressed":5803,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34671,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34671,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34671,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36305,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:08:01.243 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T08:08:01.243 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T08:08:01.244 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T08:08:01.244 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T08:08:01.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:00 smithi100 ceph-mon[35102]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:08:01.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:01 smithi153 ceph-mon[35609]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T08:08:01.501 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:02.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.966+0000 7fdca7428640 1 -- 172.21.15.22:0/2101742295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca0100e20 msgr2=0x7fdca0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:02.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.966+0000 7fdca7428640 1 --2- 172.21.15.22:0/2101742295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca0100e20 0x7fdca0101200 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c009900 tx=0x7fdc9c02a480 comp rx=0 tx=0).stop 2024-09-10T08:08:02.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.966+0000 7fdca7428640 1 -- 172.21.15.22:0/2101742295 shutdown_connections 2024-09-10T08:08:02.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.966+0000 7fdca7428640 1 --2- 172.21.15.22:0/2101742295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdca0102ef0 0x7fdca010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:02.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.966+0000 7fdca7428640 1 --2- 172.21.15.22:0/2101742295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0102570 0x7fdca01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:02.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.966+0000 7fdca7428640 1 --2- 172.21.15.22:0/2101742295 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca0100e20 0x7fdca0101200 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.966+0000 7fdca7428640 1 -- 172.21.15.22:0/2101742295 >> 172.21.15.22:0/2101742295 conn(0x7fdca00fc7d0 msgr2=0x7fdca00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.966+0000 7fdca7428640 1 -- 172.21.15.22:0/2101742295 shutdown_connections 2024-09-10T08:08:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.966+0000 7fdca7428640 1 -- 172.21.15.22:0/2101742295 wait complete. 2024-09-10T08:08:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca7428640 1 Processor -- start 2024-09-10T08:08:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca7428640 1 -- start start 2024-09-10T08:08:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca7428640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdca0100e20 0x7fdca0198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca7428640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca0102570 0x7fdca0198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca7428640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0102ef0 0x7fdca019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca7428640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdca0111020 con 0x7fdca0102570 2024-09-10T08:08:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca7428640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdca0110ea0 con 0x7fdca0102ef0 2024-09-10T08:08:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca7428640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdca01111a0 con 0x7fdca0100e20 2024-09-10T08:08:02.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca49c3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca0102570 0x7fdca0198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:02.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca49c3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca0102570 0x7fdca0198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49582/0 (socket says 172.21.15.22:49582) 2024-09-10T08:08:02.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca49c3640 1 -- 172.21.15.22:0/3544043250 learned_addr learned my addr 172.21.15.22:0/3544043250 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:02.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca59c5640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0102ef0 0x7fdca019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:02.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca51c4640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdca0100e20 0x7fdca0198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:02.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca49c3640 1 -- 172.21.15.22:0/3544043250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdca0100e20 msgr2=0x7fdca0198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:02.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca49c3640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdca0100e20 0x7fdca0198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:02.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca49c3640 1 -- 172.21.15.22:0/3544043250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0102ef0 msgr2=0x7fdca019cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:02.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca49c3640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0102ef0 0x7fdca019cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:02.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.967+0000 7fdca49c3640 1 -- 172.21.15.22:0/3544043250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca019d620 con 0x7fdca0102570 2024-09-10T08:08:02.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.968+0000 7fdca49c3640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca0102570 0x7fdca0198bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400b4a0 tx=0x7fdc9400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:02.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.968+0000 7fdc927fc640 1 -- 172.21.15.22:0/3544043250 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94014070 con 0x7fdca0102570 2024-09-10T08:08:02.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.968+0000 7fdc927fc640 1 -- 172.21.15.22:0/3544043250 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdc94010af0 con 0x7fdca0102570 2024-09-10T08:08:02.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.968+0000 7fdca7428640 1 -- 172.21.15.22:0/3544043250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca019d910 con 0x7fdca0102570 2024-09-10T08:08:02.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.968+0000 7fdc927fc640 1 -- 172.21.15.22:0/3544043250 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94017d10 con 0x7fdca0102570 2024-09-10T08:08:02.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.968+0000 7fdca7428640 1 -- 172.21.15.22:0/3544043250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca01a51f0 con 0x7fdca0102570 2024-09-10T08:08:02.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.969+0000 7fdca7428640 1 -- 172.21.15.22:0/3544043250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca0101280 con 0x7fdca0102570 2024-09-10T08:08:02.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.970+0000 7fdc927fc640 1 -- 172.21.15.22:0/3544043250 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fdc94017070 con 0x7fdca0102570 2024-09-10T08:08:02.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.971+0000 7fdc927fc640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdc8c0a2c10 0x7fdc8c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:02.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.971+0000 7fdc927fc640 1 -- 172.21.15.22:0/3544043250 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fdc940ce820 con 0x7fdca0102570 2024-09-10T08:08:02.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.971+0000 7fdca51c4640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdc8c0a2c10 0x7fdc8c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:02.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.972+0000 7fdca51c4640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdc8c0a2c10 0x7fdc8c0a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c005ab0 tx=0x7fdc9c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:02.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:01.974+0000 7fdc927fc640 1 -- 172.21.15.22:0/3544043250 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc9409b730 con 0x7fdca0102570 2024-09-10T08:08:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.190+0000 7fdca7428640 1 -- 172.21.15.22:0/3544043250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdca01999d0 con 0x7fdca0102570 2024-09-10T08:08:02.190 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:02 smithi022 ceph-mon[30854]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:08:02.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.191+0000 7fdc927fc640 1 -- 172.21.15.22:0/3544043250 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fdca01999d0 con 0x7fdca0102570 2024-09-10T08:08:02.191 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:02.191 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T08:08:02.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.193+0000 7fdca7428640 1 -- 172.21.15.22:0/3544043250 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdc8c0a2c10 msgr2=0x7fdc8c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:02.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.193+0000 7fdca7428640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdc8c0a2c10 0x7fdc8c0a50d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c005ab0 tx=0x7fdc9c005a20 comp rx=0 tx=0).stop 2024-09-10T08:08:02.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.193+0000 7fdca7428640 1 -- 172.21.15.22:0/3544043250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca0102570 msgr2=0x7fdca0198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:02.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.193+0000 7fdca7428640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca0102570 0x7fdca0198bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400b4a0 tx=0x7fdc9400b960 comp rx=0 tx=0).stop 2024-09-10T08:08:02.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.193+0000 7fdca7428640 1 -- 172.21.15.22:0/3544043250 shutdown_connections 2024-09-10T08:08:02.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.193+0000 7fdca7428640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fdc8c0a2c10 0x7fdc8c0a50d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:02.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.193+0000 7fdca7428640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca0102ef0 0x7fdca019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:02.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.193+0000 7fdca7428640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdca0102570 0x7fdca0198bb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:02.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.193+0000 7fdca7428640 1 --2- 172.21.15.22:0/3544043250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdca0100e20 0x7fdca0198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:02.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.193+0000 7fdca7428640 1 -- 172.21.15.22:0/3544043250 >> 172.21.15.22:0/3544043250 conn(0x7fdca00fc7d0 msgr2=0x7fdca006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:02.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.193+0000 7fdca7428640 1 -- 172.21.15.22:0/3544043250 shutdown_connections 2024-09-10T08:08:02.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:02.193+0000 7fdca7428640 1 -- 172.21.15.22:0/3544043250 wait complete. 2024-09-10T08:08:02.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:02 smithi100 ceph-mon[35102]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:08:02.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:02 smithi153 ceph-mon[35609]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:08:02.889 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T08:08:02.890 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:08:03.154 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:03.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:03 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3544043250' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T08:08:03.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:03 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3544043250' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T08:08:03.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:03 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3544043250' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-10T08:08:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.658+0000 7fce96da7640 1 -- 172.21.15.22:0/1083030903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce90102570 msgr2=0x7fce901029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.658+0000 7fce96da7640 1 --2- 172.21.15.22:0/1083030903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce90102570 0x7fce901029b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fce84009900 tx=0x7fce8402a480 comp rx=0 tx=0).stop 2024-09-10T08:08:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.658+0000 7fce96da7640 1 -- 172.21.15.22:0/1083030903 shutdown_connections 2024-09-10T08:08:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.658+0000 7fce96da7640 1 --2- 172.21.15.22:0/1083030903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90102ef0 0x7fce9010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.658+0000 7fce96da7640 1 --2- 172.21.15.22:0/1083030903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce90102570 0x7fce901029b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.658+0000 7fce96da7640 1 --2- 172.21.15.22:0/1083030903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce90100e20 0x7fce90101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.658+0000 7fce96da7640 1 -- 172.21.15.22:0/1083030903 >> 172.21.15.22:0/1083030903 conn(0x7fce900fc7d0 msgr2=0x7fce900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.658+0000 7fce96da7640 1 -- 172.21.15.22:0/1083030903 shutdown_connections 2024-09-10T08:08:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.658+0000 7fce96da7640 1 -- 172.21.15.22:0/1083030903 wait complete. 2024-09-10T08:08:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.658+0000 7fce96da7640 1 Processor -- start 2024-09-10T08:08:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.658+0000 7fce96da7640 1 -- start start 2024-09-10T08:08:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce96da7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce90100e20 0x7fce90199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce96da7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90102570 0x7fce901998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce96da7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce90102ef0 0x7fce901a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:03.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce96da7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fce90110fa0 con 0x7fce90102ef0 2024-09-10T08:08:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce96da7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce90110e20 con 0x7fce90102570 2024-09-10T08:08:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce96da7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce90111120 con 0x7fce90100e20 2024-09-10T08:08:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce95344640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce90102ef0 0x7fce901a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce95344640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce90102ef0 0x7fce901a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49554/0 (socket says 172.21.15.22:49554) 2024-09-10T08:08:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce95344640 1 -- 172.21.15.22:0/1830600017 learned_addr learned my addr 172.21.15.22:0/1830600017 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce94b43640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce90100e20 0x7fce90199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce8ffff640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90102570 0x7fce901998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce95344640 1 -- 172.21.15.22:0/1830600017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce90100e20 msgr2=0x7fce90199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce95344640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce90100e20 0x7fce90199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:03.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce95344640 1 -- 172.21.15.22:0/1830600017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90102570 msgr2=0x7fce901998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce95344640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90102570 0x7fce901998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce95344640 1 -- 172.21.15.22:0/1830600017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce901a4930 con 0x7fce90102ef0 2024-09-10T08:08:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce8ffff640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90102570 0x7fce901998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce94b43640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce90100e20 0x7fce90199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce95344640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce90102ef0 0x7fce901a43f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fce8800cce0 tx=0x7fce8800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.659+0000 7fce8dffb640 1 -- 172.21.15.22:0/1830600017 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8800f450 con 0x7fce90102ef0 2024-09-10T08:08:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.660+0000 7fce96da7640 1 -- 172.21.15.22:0/1830600017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce901a4b00 con 0x7fce90102ef0 2024-09-10T08:08:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.660+0000 7fce8dffb640 1 -- 172.21.15.22:0/1830600017 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce8800fad0 con 0x7fce90102ef0 2024-09-10T08:08:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.660+0000 7fce8dffb640 1 -- 172.21.15.22:0/1830600017 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88018c10 con 0x7fce90102ef0 2024-09-10T08:08:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.660+0000 7fce96da7640 1 -- 172.21.15.22:0/1830600017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce901a4fc0 con 0x7fce90102ef0 2024-09-10T08:08:03.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.661+0000 7fce96da7640 1 -- 172.21.15.22:0/1830600017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce90101200 con 0x7fce90102ef0 2024-09-10T08:08:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.662+0000 7fce8dffb640 1 -- 172.21.15.22:0/1830600017 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fce8800f5f0 con 0x7fce90102ef0 2024-09-10T08:08:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.662+0000 7fce8dffb640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fce780a2c10 0x7fce780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.663+0000 7fce94b43640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fce780a2c10 0x7fce780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.663+0000 7fce8dffb640 1 -- 172.21.15.22:0/1830600017 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fce880cf940 con 0x7fce90102ef0 2024-09-10T08:08:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.663+0000 7fce94b43640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fce780a2c10 0x7fce780a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fce80009930 tx=0x7fce80008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:03.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.667+0000 7fce8dffb640 1 -- 172.21.15.22:0/1830600017 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce88014030 con 0x7fce90102ef0 2024-09-10T08:08:03.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.876+0000 7fce96da7640 1 -- 172.21.15.22:0/1830600017 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce901a5250 con 0x7fce90102ef0 2024-09-10T08:08:03.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.877+0000 7fce8dffb640 1 -- 172.21.15.22:0/1830600017 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11963 (secure 0 0 0) 0x7fce8809c740 con 0x7fce90102ef0 2024-09-10T08:08:03.876 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:03.877 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"btime":"2024-09-10T08:07:06:469020+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:06:54.609910+0000","modified":"2024-09-10T08:07:06.044085+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24512,"mds_1":24479,"mds_2":24469,"mds_3":24455,"mds_4":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/896927555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":896927555},{"type":"v1","addr":"172.21.15.22:6839","nonce":896927555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14622":{"gid":14622,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.22:6841/969125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":969125},{"type":"v1","addr":"172.21.15.22:6841","nonce":969125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/2417436521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2417436521},{"type":"v1","addr":"172.21.15.153:6837","nonce":2417436521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/1766856743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1766856743},{"type":"v1","addr":"172.21.15.153:6839","nonce":1766856743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/1987693702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1987693702},{"type":"v1","addr":"172.21.15.100:6837","nonce":1987693702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/2512683674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":2512683674},{"type":"v1","addr":"172.21.15.100:6839","nonce":2512683674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24512,"qdb_cluster":[14622,24455,24469,24479,24512]},"id":1}]} 2024-09-10T08:08:03.877 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-10T08:08:03.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.879+0000 7fce96da7640 1 -- 172.21.15.22:0/1830600017 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fce780a2c10 msgr2=0x7fce780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.879+0000 7fce96da7640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fce780a2c10 0x7fce780a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fce80009930 tx=0x7fce80008040 comp rx=0 tx=0).stop 2024-09-10T08:08:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.879+0000 7fce96da7640 1 -- 172.21.15.22:0/1830600017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce90102ef0 msgr2=0x7fce901a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.879+0000 7fce96da7640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce90102ef0 0x7fce901a43f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fce8800cce0 tx=0x7fce8800a620 comp rx=0 tx=0).stop 2024-09-10T08:08:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.879+0000 7fce96da7640 1 -- 172.21.15.22:0/1830600017 shutdown_connections 2024-09-10T08:08:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.879+0000 7fce96da7640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fce780a2c10 0x7fce780a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.879+0000 7fce96da7640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fce90102ef0 0x7fce901a43f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.879+0000 7fce96da7640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90102570 0x7fce901998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.879+0000 7fce96da7640 1 --2- 172.21.15.22:0/1830600017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce90100e20 0x7fce90199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.879+0000 7fce96da7640 1 -- 172.21.15.22:0/1830600017 >> 172.21.15.22:0/1830600017 conn(0x7fce900fc7d0 msgr2=0x7fce901068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:03.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.879+0000 7fce96da7640 1 -- 172.21.15.22:0/1830600017 shutdown_connections 2024-09-10T08:08:03.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:03.879+0000 7fce96da7640 1 -- 172.21.15.22:0/1830600017 wait complete. 2024-09-10T08:08:04.240 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:04 smithi022 ceph-mon[30854]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:08:04.240 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:04 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1830600017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:04.345 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:04 smithi153 ceph-mon[35609]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:08:04.345 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:04 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1830600017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:04.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:04 smithi100 ceph-mon[35102]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:08:04.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:04 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1830600017' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:04.600 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:08:04.858 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.364+0000 7fc2f96a9640 1 -- 172.21.15.22:0/353402469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f4103650 msgr2=0x7fc2f410bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:05.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.364+0000 7fc2f96a9640 1 --2- 172.21.15.22:0/353402469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f4103650 0x7fc2f410bb40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009900 tx=0x7fc2e802a480 comp rx=0 tx=0).stop 2024-09-10T08:08:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.364+0000 7fc2f96a9640 1 -- 172.21.15.22:0/353402469 shutdown_connections 2024-09-10T08:08:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.364+0000 7fc2f96a9640 1 --2- 172.21.15.22:0/353402469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2f410c160 0x7fc2f410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.364+0000 7fc2f96a9640 1 --2- 172.21.15.22:0/353402469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f4103650 0x7fc2f410bb40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.364+0000 7fc2f96a9640 1 --2- 172.21.15.22:0/353402469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f4102d30 0x7fc2f4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.364+0000 7fc2f96a9640 1 -- 172.21.15.22:0/353402469 >> 172.21.15.22:0/353402469 conn(0x7fc2f40fc7d0 msgr2=0x7fc2f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.364+0000 7fc2f96a9640 1 -- 172.21.15.22:0/353402469 shutdown_connections 2024-09-10T08:08:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.364+0000 7fc2f96a9640 1 -- 172.21.15.22:0/353402469 wait complete. 2024-09-10T08:08:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.365+0000 7fc2f96a9640 1 Processor -- start 2024-09-10T08:08:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.365+0000 7fc2f96a9640 1 -- start start 2024-09-10T08:08:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f96a9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2f4102d30 0x7fc2f41983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f96a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f4103650 0x7fc2f4198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:05.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f96a9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f410c160 0x7fc2f419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f96a9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4111f60 con 0x7fc2f4103650 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f96a9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f4111de0 con 0x7fc2f410c160 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f96a9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f41120e0 con 0x7fc2f4102d30 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f4103650 0x7fc2f4198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f4103650 0x7fc2f4198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49574/0 (socket says 172.21.15.22:49574) 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f27fc640 1 -- 172.21.15.22:0/1974897502 learned_addr learned my addr 172.21.15.22:0/1974897502 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f2ffd640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2f4102d30 0x7fc2f41983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f37fe640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f410c160 0x7fc2f419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f27fc640 1 -- 172.21.15.22:0/1974897502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2f4102d30 msgr2=0x7fc2f41983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f27fc640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2f4102d30 0x7fc2f41983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f27fc640 1 -- 172.21.15.22:0/1974897502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f410c160 msgr2=0x7fc2f419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f27fc640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f410c160 0x7fc2f419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:05.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f27fc640 1 -- 172.21.15.22:0/1974897502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f419d390 con 0x7fc2f4103650 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2f27fc640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f4103650 0x7fc2f4198920 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8006010 tx=0x7fc2e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.366+0000 7fc2dbfff640 1 -- 172.21.15.22:0/1974897502 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e803f030 con 0x7fc2f4103650 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.367+0000 7fc2f96a9640 1 -- 172.21.15.22:0/1974897502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f419d620 con 0x7fc2f4103650 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.367+0000 7fc2dbfff640 1 -- 172.21.15.22:0/1974897502 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc2e8003ce0 con 0x7fc2f4103650 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.367+0000 7fc2dbfff640 1 -- 172.21.15.22:0/1974897502 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8035070 con 0x7fc2f4103650 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.367+0000 7fc2f96a9640 1 -- 172.21.15.22:0/1974897502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f41a4f60 con 0x7fc2f4103650 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.368+0000 7fc2f96a9640 1 -- 172.21.15.22:0/1974897502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f4103110 con 0x7fc2f4103650 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.370+0000 7fc2dbfff640 1 -- 172.21.15.22:0/1974897502 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fc2e8042030 con 0x7fc2f4103650 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.370+0000 7fc2dbfff640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc2dc0a2c10 0x7fc2dc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.370+0000 7fc2f2ffd640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc2dc0a2c10 0x7fc2dc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.370+0000 7fc2dbfff640 1 -- 172.21.15.22:0/1974897502 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc2e80efab0 con 0x7fc2f4103650 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.371+0000 7fc2f2ffd640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc2dc0a2c10 0x7fc2dc0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400abe0 tx=0x7fc2e400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:05.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.373+0000 7fc2dbfff640 1 -- 172.21.15.22:0/1974897502 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2e80bc8b0 con 0x7fc2f4103650 2024-09-10T08:08:05.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.586+0000 7fc2f96a9640 1 -- 172.21.15.22:0/1974897502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2f4199740 con 0x7fc2f4103650 2024-09-10T08:08:05.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.587+0000 7fc2dbfff640 1 -- 172.21.15.22:0/1974897502 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11963 (secure 0 0 0) 0x7fc2f4199740 con 0x7fc2f4103650 2024-09-10T08:08:05.586 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:05.586 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"btime":"2024-09-10T08:07:06:469020+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:06:54.609910+0000","modified":"2024-09-10T08:07:06.044085+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24512,"mds_1":24479,"mds_2":24469,"mds_3":24455,"mds_4":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/896927555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":896927555},{"type":"v1","addr":"172.21.15.22:6839","nonce":896927555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14622":{"gid":14622,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.22:6841/969125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":969125},{"type":"v1","addr":"172.21.15.22:6841","nonce":969125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/2417436521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2417436521},{"type":"v1","addr":"172.21.15.153:6837","nonce":2417436521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/1766856743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1766856743},{"type":"v1","addr":"172.21.15.153:6839","nonce":1766856743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/1987693702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1987693702},{"type":"v1","addr":"172.21.15.100:6837","nonce":1987693702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/2512683674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":2512683674},{"type":"v1","addr":"172.21.15.100:6839","nonce":2512683674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24512,"qdb_cluster":[14622,24455,24469,24479,24512]},"id":1}]} 2024-09-10T08:08:05.586 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-10T08:08:05.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.589+0000 7fc2f96a9640 1 -- 172.21.15.22:0/1974897502 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc2dc0a2c10 msgr2=0x7fc2dc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:05.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.589+0000 7fc2f96a9640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc2dc0a2c10 0x7fc2dc0a50d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400abe0 tx=0x7fc2e400a2d0 comp rx=0 tx=0).stop 2024-09-10T08:08:05.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.589+0000 7fc2f96a9640 1 -- 172.21.15.22:0/1974897502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f4103650 msgr2=0x7fc2f4198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:05.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.589+0000 7fc2f96a9640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f4103650 0x7fc2f4198920 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8006010 tx=0x7fc2e80042f0 comp rx=0 tx=0).stop 2024-09-10T08:08:05.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.589+0000 7fc2f96a9640 1 -- 172.21.15.22:0/1974897502 shutdown_connections 2024-09-10T08:08:05.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.589+0000 7fc2f96a9640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc2dc0a2c10 0x7fc2dc0a50d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:05.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.589+0000 7fc2f96a9640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f410c160 0x7fc2f419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:05.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.589+0000 7fc2f96a9640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2f4103650 0x7fc2f4198920 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:05.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.589+0000 7fc2f96a9640 1 --2- 172.21.15.22:0/1974897502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2f4102d30 0x7fc2f41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:05.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.589+0000 7fc2f96a9640 1 -- 172.21.15.22:0/1974897502 >> 172.21.15.22:0/1974897502 conn(0x7fc2f40fc7d0 msgr2=0x7fc2f40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:05.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.589+0000 7fc2f96a9640 1 -- 172.21.15.22:0/1974897502 shutdown_connections 2024-09-10T08:08:05.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:05.589+0000 7fc2f96a9640 1 -- 172.21.15.22:0/1974897502 wait complete. 2024-09-10T08:08:06.177 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:06 smithi022 ceph-mon[30854]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:08:06.178 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:06 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1974897502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:06.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T08:08:06.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:06 smithi100 ceph-mon[35102]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:08:06.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:06 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1974897502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:06.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:06 smithi153 ceph-mon[35609]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:08:06.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:06 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1974897502' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:06.467 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:07.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.024+0000 7f8b8be66640 1 -- 172.21.15.22:0/51814551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b84102570 msgr2=0x7f8b841029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:07.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.024+0000 7f8b8be66640 1 --2- 172.21.15.22:0/51814551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b84102570 0x7f8b841029b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009900 tx=0x7f8b7402a480 comp rx=0 tx=0).stop 2024-09-10T08:08:07.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.024+0000 7f8b8be66640 1 -- 172.21.15.22:0/51814551 shutdown_connections 2024-09-10T08:08:07.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.024+0000 7f8b8be66640 1 --2- 172.21.15.22:0/51814551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b84102ef0 0x7f8b8410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:07.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.024+0000 7f8b8be66640 1 --2- 172.21.15.22:0/51814551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b84102570 0x7f8b841029b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:07.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.024+0000 7f8b8be66640 1 --2- 172.21.15.22:0/51814551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b84100e20 0x7f8b84101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:07.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.024+0000 7f8b8be66640 1 -- 172.21.15.22:0/51814551 >> 172.21.15.22:0/51814551 conn(0x7f8b840fc7d0 msgr2=0x7f8b840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:07.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.025+0000 7f8b8be66640 1 -- 172.21.15.22:0/51814551 shutdown_connections 2024-09-10T08:08:07.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.025+0000 7f8b8be66640 1 -- 172.21.15.22:0/51814551 wait complete. 2024-09-10T08:08:07.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.025+0000 7f8b8be66640 1 Processor -- start 2024-09-10T08:08:07.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.025+0000 7f8b8be66640 1 -- start start 2024-09-10T08:08:07.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.025+0000 7f8b8be66640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b84100e20 0x7f8b840fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:07.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.025+0000 7f8b8be66640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b84102570 0x7f8b840fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:07.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.025+0000 7f8b8be66640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b84102ef0 0x7f8b840fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:07.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.025+0000 7f8b8be66640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84110f80 con 0x7f8b84100e20 2024-09-10T08:08:07.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.025+0000 7f8b8be66640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84110e00 con 0x7f8b84102570 2024-09-10T08:08:07.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.025+0000 7f8b8be66640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8b84111100 con 0x7f8b84102ef0 2024-09-10T08:08:07.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b89c02640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b84100e20 0x7f8b840fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:07.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b89c02640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b84100e20 0x7f8b840fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49588/0 (socket says 172.21.15.22:49588) 2024-09-10T08:08:07.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b89c02640 1 -- 172.21.15.22:0/2423408405 learned_addr learned my addr 172.21.15.22:0/2423408405 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b89401640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b84102570 0x7f8b840fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b8a403640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b84102ef0 0x7f8b840fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b89c02640 1 -- 172.21.15.22:0/2423408405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b84102ef0 msgr2=0x7f8b840fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b89c02640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b84102ef0 0x7f8b840fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b89c02640 1 -- 172.21.15.22:0/2423408405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b84102570 msgr2=0x7f8b840fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b89c02640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b84102570 0x7f8b840fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b89c02640 1 -- 172.21.15.22:0/2423408405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b841a6a20 con 0x7f8b84100e20 2024-09-10T08:08:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b89401640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b84102570 0x7f8b840fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b8a403640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b84102ef0 0x7f8b840fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b89c02640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b84100e20 0x7f8b840fcc80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000d770 tx=0x7f8b8000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b7affd640 1 -- 172.21.15.22:0/2423408405 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80017070 con 0x7f8b84100e20 2024-09-10T08:08:07.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b7affd640 1 -- 172.21.15.22:0/2423408405 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8b80005500 con 0x7f8b84100e20 2024-09-10T08:08:07.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b8be66640 1 -- 172.21.15.22:0/2423408405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b841a6d10 con 0x7f8b84100e20 2024-09-10T08:08:07.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b7affd640 1 -- 172.21.15.22:0/2423408405 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80004e00 con 0x7f8b84100e20 2024-09-10T08:08:07.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.026+0000 7f8b8be66640 1 -- 172.21.15.22:0/2423408405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b841a71a0 con 0x7f8b84100e20 2024-09-10T08:08:07.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.027+0000 7f8b8be66640 1 -- 172.21.15.22:0/2423408405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b84101200 con 0x7f8b84100e20 2024-09-10T08:08:07.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.029+0000 7f8b7affd640 1 -- 172.21.15.22:0/2423408405 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8b80004fa0 con 0x7f8b84100e20 2024-09-10T08:08:07.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.030+0000 7f8b7affd640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b700a2c10 0x7f8b700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:07.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.030+0000 7f8b89401640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b700a2c10 0x7f8b700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:07.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.030+0000 7f8b7affd640 1 -- 172.21.15.22:0/2423408405 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8b800cf0f0 con 0x7f8b84100e20 2024-09-10T08:08:07.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.031+0000 7f8b89401640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b700a2c10 0x7f8b700a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8b840fe710 tx=0x7f8b74005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:07.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.033+0000 7f8b7affd640 1 -- 172.21.15.22:0/2423408405 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b8009beb0 con 0x7f8b84100e20 2024-09-10T08:08:07.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.209+0000 7f8b8be66640 1 -- 172.21.15.22:0/2423408405 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b8410a0a0 con 0x7f8b84100e20 2024-09-10T08:08:07.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.211+0000 7f8b7affd640 1 -- 172.21.15.22:0/2423408405 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22791 (secure 0 0 0) 0x7f8b8009b7b0 con 0x7f8b84100e20 2024-09-10T08:08:07.211 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:07.211 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":83,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","created":"2024-09-10T07:59:04.704048+0000","modified":"2024-09-10T08:07:02.403174+0000","last_up_change":"2024-09-10T08:06:02.535944+0000","last_in_change":"2024-09-10T08:05:39.070554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:02:15.371265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:06:50.358155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:06:52.896201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d296bd3-28a7-418c-ad73-343a5e806cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6803","nonce":4248555152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6805","nonce":4248555152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6809","nonce":4248555152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6807","nonce":4248555152}]},"public_addr":"172.21.15.22:6803/4248555152","cluster_addr":"172.21.15.22:6805/4248555152","heartbeat_back_addr":"172.21.15.22:6809/4248555152","heartbeat_front_addr":"172.21.15.22:6807/4248555152","state":["exists","up"]},{"osd":1,"uuid":"c1e2b40e-b4ab-475a-8a9e-c67409f46b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6801","nonce":2078646052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6803","nonce":2078646052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6807","nonce":2078646052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6805","nonce":2078646052}]},"public_addr":"172.21.15.100:6801/2078646052","cluster_addr":"172.21.15.100:6803/2078646052","heartbeat_back_addr":"172.21.15.100:6807/2078646052","heartbeat_front_addr":"172.21.15.100:6805/2078646052","state":["exists","up"]},{"osd":2,"uuid":"be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6801","nonce":2492419476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6803","nonce":2492419476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6807","nonce":2492419476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6805","nonce":2492419476}]},"public_addr":"172.21.15.153:6801/2492419476","cluster_addr":"172.21.15.153:6803/2492419476","heartbeat_back_addr":"172.21.15.153:6807/2492419476","heartbeat_front_addr":"172.21.15.153:6805/2492419476","state":["exists","up"]},{"osd":3,"uuid":"e980a3ba-c659-4473-9633-9cbe88296d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6811","nonce":3674495276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6813","nonce":3674495276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6817","nonce":3674495276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6815","nonce":3674495276}]},"public_addr":"172.21.15.22:6811/3674495276","cluster_addr":"172.21.15.22:6813/3674495276","heartbeat_back_addr":"172.21.15.22:6817/3674495276","heartbeat_front_addr":"172.21.15.22:6815/3674495276","state":["exists","up"]},{"osd":4,"uuid":"b37d0590-99b1-4566-96b4-9936890d4308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6809","nonce":3886932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6811","nonce":3886932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6815","nonce":3886932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6813","nonce":3886932513}]},"public_addr":"172.21.15.100:6809/3886932513","cluster_addr":"172.21.15.100:6811/3886932513","heartbeat_back_addr":"172.21.15.100:6815/3886932513","heartbeat_front_addr":"172.21.15.100:6813/3886932513","state":["exists","up"]},{"osd":5,"uuid":"6cb989a0-80a1-4a9a-8b45-51b47772b203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6809","nonce":120732073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6811","nonce":120732073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6815","nonce":120732073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6813","nonce":120732073}]},"public_addr":"172.21.15.153:6809/120732073","cluster_addr":"172.21.15.153:6811/120732073","heartbeat_back_addr":"172.21.15.153:6815/120732073","heartbeat_front_addr":"172.21.15.153:6813/120732073","state":["exists","up"]},{"osd":6,"uuid":"294887f3-3e58-4b02-884d-4e0a70a86d16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6819","nonce":3692536487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6821","nonce":3692536487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6825","nonce":3692536487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6823","nonce":3692536487}]},"public_addr":"172.21.15.22:6819/3692536487","cluster_addr":"172.21.15.22:6821/3692536487","heartbeat_back_addr":"172.21.15.22:6825/3692536487","heartbeat_front_addr":"172.21.15.22:6823/3692536487","state":["exists","up"]},{"osd":7,"uuid":"d0c0ec61-4055-46f3-a4b0-39f04c735452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6817","nonce":1221175921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6819","nonce":1221175921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6823","nonce":1221175921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6821","nonce":1221175921}]},"public_addr":"172.21.15.100:6817/1221175921","cluster_addr":"172.21.15.100:6819/1221175921","heartbeat_back_addr":"172.21.15.100:6823/1221175921","heartbeat_front_addr":"172.21.15.100:6821/1221175921","state":["exists","up"]},{"osd":8,"uuid":"bda45a16-742e-4eda-b4d4-e01d6f3dc92e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6817","nonce":1153053941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6819","nonce":1153053941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6823","nonce":1153053941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6821","nonce":1153053941}]},"public_addr":"172.21.15.153:6817/1153053941","cluster_addr":"172.21.15.153:6819/1153053941","heartbeat_back_addr":"172.21.15.153:6823/1153053941","heartbeat_front_addr":"172.21.15.153:6821/1153053941","state":["exists","up"]},{"osd":9,"uuid":"48bd3544-9028-4535-801b-3d39ecadf48e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6827","nonce":3423218876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6829","nonce":3423218876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6833","nonce":3423218876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6831","nonce":3423218876}]},"public_addr":"172.21.15.22:6827/3423218876","cluster_addr":"172.21.15.22:6829/3423218876","heartbeat_back_addr":"172.21.15.22:6833/3423218876","heartbeat_front_addr":"172.21.15.22:6831/3423218876","state":["exists","up"]},{"osd":10,"uuid":"c8716aa0-eb93-435d-a9d0-dd4c3dce1954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6825","nonce":2024112643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6827","nonce":2024112643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6831","nonce":2024112643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6829","nonce":2024112643}]},"public_addr":"172.21.15.100:6825/2024112643","cluster_addr":"172.21.15.100:6827/2024112643","heartbeat_back_addr":"172.21.15.100:6831/2024112643","heartbeat_front_addr":"172.21.15.100:6829/2024112643","state":["exists","up"]},{"osd":11,"uuid":"3c427cfe-8d7c-431e-9eb4-b03cfac3068d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6825","nonce":2245781783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6827","nonce":2245781783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6831","nonce":2245781783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6829","nonce":2245781783}]},"public_addr":"172.21.15.153:6825/2245781783","cluster_addr":"172.21.15.153:6827/2245781783","heartbeat_back_addr":"172.21.15.153:6831/2245781783","heartbeat_front_addr":"172.21.15.153:6829/2245781783","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:23.001057+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:46.353182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:11.469840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:37.557521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:02.630783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:27.374057+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:53.758498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:19.507846+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:45.080789+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:10.286820+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:35.565950+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:06:00.633384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3072001022":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/1519904928":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6801/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/2108462626":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/3337107310":"2024-09-11T07:59:36.505631+0000","172.21.15.22:6801/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/1708436544":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/278091300":"2024-09-11T07:59:36.505631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:08:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.213+0000 7f8b8be66640 1 -- 172.21.15.22:0/2423408405 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b700a2c10 msgr2=0x7f8b700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.213+0000 7f8b8be66640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b700a2c10 0x7f8b700a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8b840fe710 tx=0x7f8b74005a20 comp rx=0 tx=0).stop 2024-09-10T08:08:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.213+0000 7f8b8be66640 1 -- 172.21.15.22:0/2423408405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b84100e20 msgr2=0x7f8b840fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.213+0000 7f8b8be66640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b84100e20 0x7f8b840fcc80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000d770 tx=0x7f8b8000dc30 comp rx=0 tx=0).stop 2024-09-10T08:08:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.213+0000 7f8b8be66640 1 -- 172.21.15.22:0/2423408405 shutdown_connections 2024-09-10T08:08:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.213+0000 7f8b8be66640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8b700a2c10 0x7f8b700a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.213+0000 7f8b8be66640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b84102ef0 0x7f8b840fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.213+0000 7f8b8be66640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b84102570 0x7f8b840fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:07.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.213+0000 7f8b8be66640 1 --2- 172.21.15.22:0/2423408405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b84100e20 0x7f8b840fcc80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.213+0000 7f8b8be66640 1 -- 172.21.15.22:0/2423408405 >> 172.21.15.22:0/2423408405 conn(0x7f8b840fc7d0 msgr2=0x7f8b8406a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.214+0000 7f8b8be66640 1 -- 172.21.15.22:0/2423408405 shutdown_connections 2024-09-10T08:08:07.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:07.214+0000 7f8b8be66640 1 -- 172.21.15.22:0/2423408405 wait complete. 2024-09-10T08:08:07.907 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:08:08.169 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:08.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:08 smithi022 ceph-mon[30854]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:08:08.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:08 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2423408405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:08:08.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:08 smithi100 ceph-mon[35102]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:08:08.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:08 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2423408405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:08:08.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:08 smithi153 ceph-mon[35609]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:08:08.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:08 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2423408405' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:08:08.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.624+0000 7f316af62640 1 -- 172.21.15.22:0/3558571433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3164102790 msgr2=0x7f31641067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:08.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.624+0000 7f316af62640 1 --2- 172.21.15.22:0/3558571433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3164102790 0x7f31641067e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f314c009900 tx=0x7f314c02a3f0 comp rx=0 tx=0).stop 2024-09-10T08:08:08.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.624+0000 7f316af62640 1 -- 172.21.15.22:0/3558571433 shutdown_connections 2024-09-10T08:08:08.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.624+0000 7f316af62640 1 --2- 172.21.15.22:0/3558571433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3164106f10 0x7f316410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:08.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.624+0000 7f316af62640 1 --2- 172.21.15.22:0/3558571433 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3164102790 0x7f31641067e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:08.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.624+0000 7f316af62640 1 --2- 172.21.15.22:0/3558571433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3164101de0 0x7f31641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:08.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.624+0000 7f316af62640 1 -- 172.21.15.22:0/3558571433 >> 172.21.15.22:0/3558571433 conn(0x7f31640fd8c0 msgr2=0x7f31640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:08.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.624+0000 7f316af62640 1 -- 172.21.15.22:0/3558571433 shutdown_connections 2024-09-10T08:08:08.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.624+0000 7f316af62640 1 -- 172.21.15.22:0/3558571433 wait complete. 2024-09-10T08:08:08.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f316af62640 1 Processor -- start 2024-09-10T08:08:08.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f316af62640 1 -- start start 2024-09-10T08:08:08.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f316af62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3164101de0 0x7f316419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:08.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f316af62640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3164102790 0x7f316419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:08.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f316af62640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3164106f10 0x7f316419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f316af62640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3164111f70 con 0x7f3164102790 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f316af62640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3164111df0 con 0x7f3164101de0 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f316af62640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f31641120f0 con 0x7f3164106f10 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f3163fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3164102790 0x7f316419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f3163fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3164102790 0x7f316419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49606/0 (socket says 172.21.15.22:49606) 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f3163fff640 1 -- 172.21.15.22:0/1925796437 learned_addr learned my addr 172.21.15.22:0/1925796437 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f3168cfe640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3164101de0 0x7f316419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f3163fff640 1 -- 172.21.15.22:0/1925796437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3164106f10 msgr2=0x7f316419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f3163fff640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3164106f10 0x7f316419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f3163fff640 1 -- 172.21.15.22:0/1925796437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3164101de0 msgr2=0x7f316419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f3163fff640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3164101de0 0x7f316419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.625+0000 7f3163fff640 1 -- 172.21.15.22:0/1925796437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316419f600 con 0x7f3164102790 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.626+0000 7f3163fff640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3164102790 0x7f316419ab90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f314c006010 tx=0x7f314c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:08.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.626+0000 7f3161ffb640 1 -- 172.21.15.22:0/1925796437 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c03f030 con 0x7f3164102790 2024-09-10T08:08:08.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.626+0000 7f3161ffb640 1 -- 172.21.15.22:0/1925796437 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f314c003ce0 con 0x7f3164102790 2024-09-10T08:08:08.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.626+0000 7f316af62640 1 -- 172.21.15.22:0/1925796437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316419f890 con 0x7f3164102790 2024-09-10T08:08:08.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.626+0000 7f3161ffb640 1 -- 172.21.15.22:0/1925796437 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c035070 con 0x7f3164102790 2024-09-10T08:08:08.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.626+0000 7f316af62640 1 -- 172.21.15.22:0/1925796437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31641a71d0 con 0x7f3164102790 2024-09-10T08:08:08.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.628+0000 7f316af62640 1 -- 172.21.15.22:0/1925796437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31641021c0 con 0x7f3164102790 2024-09-10T08:08:08.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.629+0000 7f3161ffb640 1 -- 172.21.15.22:0/1925796437 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f314c042030 con 0x7f3164102790 2024-09-10T08:08:08.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.630+0000 7f3161ffb640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f31500a2c10 0x7f31500a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:08.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.630+0000 7f3168cfe640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f31500a2c10 0x7f31500a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:08.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.630+0000 7f3161ffb640 1 -- 172.21.15.22:0/1925796437 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f314c0efb60 con 0x7f3164102790 2024-09-10T08:08:08.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.630+0000 7f3168cfe640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f31500a2c10 0x7f31500a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f315400abe0 tx=0x7f315400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:08.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.633+0000 7f3161ffb640 1 -- 172.21.15.22:0/1925796437 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f314c049030 con 0x7f3164102790 2024-09-10T08:08:08.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.845+0000 7f316af62640 1 -- 172.21.15.22:0/1925796437 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31641a7430 con 0x7f3164102790 2024-09-10T08:08:08.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.846+0000 7f3161ffb640 1 -- 172.21.15.22:0/1925796437 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11963 (secure 0 0 0) 0x7f314c0bc960 con 0x7f3164102790 2024-09-10T08:08:08.845 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:08.845 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"btime":"2024-09-10T08:07:06:469020+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:06:54.609910+0000","modified":"2024-09-10T08:07:06.044085+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24512,"mds_1":24479,"mds_2":24469,"mds_3":24455,"mds_4":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/896927555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":896927555},{"type":"v1","addr":"172.21.15.22:6839","nonce":896927555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14622":{"gid":14622,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.22:6841/969125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":969125},{"type":"v1","addr":"172.21.15.22:6841","nonce":969125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/2417436521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2417436521},{"type":"v1","addr":"172.21.15.153:6837","nonce":2417436521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/1766856743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1766856743},{"type":"v1","addr":"172.21.15.153:6839","nonce":1766856743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/1987693702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1987693702},{"type":"v1","addr":"172.21.15.100:6837","nonce":1987693702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/2512683674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":2512683674},{"type":"v1","addr":"172.21.15.100:6839","nonce":2512683674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24512,"qdb_cluster":[14622,24455,24469,24479,24512]},"id":1}]} 2024-09-10T08:08:08.846 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-10T08:08:08.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.848+0000 7f316af62640 1 -- 172.21.15.22:0/1925796437 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f31500a2c10 msgr2=0x7f31500a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:08.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.848+0000 7f316af62640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f31500a2c10 0x7f31500a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f315400abe0 tx=0x7f315400a2d0 comp rx=0 tx=0).stop 2024-09-10T08:08:08.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.848+0000 7f316af62640 1 -- 172.21.15.22:0/1925796437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3164102790 msgr2=0x7f316419ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:08.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.848+0000 7f316af62640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3164102790 0x7f316419ab90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f314c006010 tx=0x7f314c0042f0 comp rx=0 tx=0).stop 2024-09-10T08:08:08.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.848+0000 7f316af62640 1 -- 172.21.15.22:0/1925796437 shutdown_connections 2024-09-10T08:08:08.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.848+0000 7f316af62640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f31500a2c10 0x7f31500a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:08.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.848+0000 7f316af62640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3164106f10 0x7f316419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:08.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.848+0000 7f316af62640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3164102790 0x7f316419ab90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:08.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.848+0000 7f316af62640 1 --2- 172.21.15.22:0/1925796437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3164101de0 0x7f316419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:08.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.848+0000 7f316af62640 1 -- 172.21.15.22:0/1925796437 >> 172.21.15.22:0/1925796437 conn(0x7f31640fd8c0 msgr2=0x7f31640feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:08.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.848+0000 7f316af62640 1 -- 172.21.15.22:0/1925796437 shutdown_connections 2024-09-10T08:08:08.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:08.848+0000 7f316af62640 1 -- 172.21.15.22:0/1925796437 wait complete. 2024-09-10T08:08:09.146 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:09 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1925796437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:09.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:09 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1925796437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:09.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:09 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1925796437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:09.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T08:06:54.609910+0000', 'modified': '2024-09-10T08:07:06.044085+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24512, 'mds_1': 24479, 'mds_2': 24469, 'mds_3': 24455, 'mds_4': 14622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14616': {'gid': 14616, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.22:6839/896927555', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 896927555}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 896927555}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14622': {'gid': 14622, 'name': 'a', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.22:6841/969125', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6840', 'nonce': 969125}, {'type': 'v1', 'addr': '172.21.15.22:6841', 'nonce': 969125}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24409': {'gid': 24409, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6833/3705787109', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 3705787109}, {'type': 'v1', 'addr': '172.21.15.153:6833', 'nonce': 3705787109}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.100:6833/1178134620', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6832', 'nonce': 1178134620}, {'type': 'v1', 'addr': '172.21.15.100:6833', 'nonce': 1178134620}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6835/3505190925', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 3505190925}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 3505190925}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6837/2417436521', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 2417436521}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 2417436521}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.100:6835/800491506', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 800491506}, {'type': 'v1', 'addr': '172.21.15.100:6835', 'nonce': 800491506}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.153:6839/1766856743', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6838', 'nonce': 1766856743}, {'type': 'v1', 'addr': '172.21.15.153:6839', 'nonce': 1766856743}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24479': {'gid': 24479, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.100:6837/1987693702', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 1987693702}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 1987693702}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24512': {'gid': 24512, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6839/2512683674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 2512683674}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 2512683674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24512, 'qdb_cluster': [14622, 24455, 24469, 24479, 24512]} 2024-09-10T08:08:09.457 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-10T08:08:09.457 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell mds.a status 2024-09-10T08:08:09.717 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:10.126 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:10 smithi022 ceph-mon[30854]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T08:08:10.284 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:10 smithi100 ceph-mon[35102]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T08:08:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.276+0000 7f2598aa3640 1 -- 172.21.15.22:0/1232833660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f259410c180 msgr2=0x7f259410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.276+0000 7f2598aa3640 1 --2- 172.21.15.22:0/1232833660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f259410c180 0x7f259410e600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f258c009ca0 tx=0x7f258c02a950 comp rx=0 tx=0).stop 2024-09-10T08:08:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.276+0000 7f2598aa3640 1 -- 172.21.15.22:0/1232833660 shutdown_connections 2024-09-10T08:08:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.277+0000 7f2598aa3640 1 --2- 172.21.15.22:0/1232833660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f259410c180 0x7f259410e600 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.277+0000 7f2598aa3640 1 --2- 172.21.15.22:0/1232833660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25941036c0 0x7f259410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.277+0000 7f2598aa3640 1 --2- 172.21.15.22:0/1232833660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2594102da0 0x7f2594103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.277+0000 7f2598aa3640 1 -- 172.21.15.22:0/1232833660 >> 172.21.15.22:0/1232833660 conn(0x7f25940fc7a0 msgr2=0x7f25940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.277+0000 7f2598aa3640 1 -- 172.21.15.22:0/1232833660 shutdown_connections 2024-09-10T08:08:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.277+0000 7f2598aa3640 1 -- 172.21.15.22:0/1232833660 wait complete. 2024-09-10T08:08:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.277+0000 7f2598aa3640 1 Processor -- start 2024-09-10T08:08:10.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.277+0000 7f2598aa3640 1 -- start start 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f2598aa3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2594102da0 0x7f25941983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f2598aa3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25941036c0 0x7f2594198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f2598aa3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259410c180 0x7f259419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f2598aa3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2594111f40 con 0x7f2594102da0 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f2598aa3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2594111dc0 con 0x7f259410c180 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f2598aa3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25941120c0 con 0x7f25941036c0 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f259259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2594102da0 0x7f25941983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f259259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2594102da0 0x7f25941983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49626/0 (socket says 172.21.15.22:49626) 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f259259c640 1 -- 172.21.15.22:0/3410085476 learned_addr learned my addr 172.21.15.22:0/3410085476 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f2592d9d640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259410c180 0x7f259419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f2591d9b640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25941036c0 0x7f2594198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f259259c640 1 -- 172.21.15.22:0/3410085476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25941036c0 msgr2=0x7f2594198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:10.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f259259c640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25941036c0 0x7f2594198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f259259c640 1 -- 172.21.15.22:0/3410085476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259410c180 msgr2=0x7f259419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f259259c640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259410c180 0x7f259419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f259259c640 1 -- 172.21.15.22:0/3410085476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259419d370 con 0x7f2594102da0 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f259259c640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2594102da0 0x7f25941983c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f258400e9f0 tx=0x7f258400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f25837fe640 1 -- 172.21.15.22:0/3410085476 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258400cd80 con 0x7f2594102da0 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f25837fe640 1 -- 172.21.15.22:0/3410085476 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2584010910 con 0x7f2594102da0 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f2598aa3640 1 -- 172.21.15.22:0/3410085476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f259419d660 con 0x7f2594102da0 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.278+0000 7f25837fe640 1 -- 172.21.15.22:0/3410085476 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2584018990 con 0x7f2594102da0 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.279+0000 7f2598aa3640 1 -- 172.21.15.22:0/3410085476 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25941a4f40 con 0x7f2594102da0 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.281+0000 7f25837fe640 1 -- 172.21.15.22:0/3410085476 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f2584010ac0 con 0x7f2594102da0 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.281+0000 7f259ae7c740 1 Processor -- start 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259ae7c740 1 -- start start 2024-09-10T08:08:10.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f25837fe640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f257c0a2c90 0x7f257c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259ae7c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 0x56328a6eadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259ae7c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6eb2f0 0x56328a6f5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259ae7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6f5bb0 0x56328a6f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259ae7c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56328a651090 con 0x56328a6ea9d0 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259ae7c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56328a5f8a70 con 0x56328a6eb2f0 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259ae7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56328a64d050 con 0x56328a6f5bb0 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 0x56328a6eadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f2592d9d640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f257c0a2c90 0x7f257c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 0x56328a6eadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49638/0 (socket says 172.21.15.22:49638) 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259259c640 1 -- 172.21.15.22:0/164522226 learned_addr learned my addr 172.21.15.22:0/164522226 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f2591d9b640 1 --2- 172.21.15.22:0/164522226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6eb2f0 0x56328a6f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f25837fe640 1 -- 172.21.15.22:0/3410085476 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f25840cf480 con 0x7f2594102da0 2024-09-10T08:08:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259259c640 1 -- 172.21.15.22:0/164522226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6f5bb0 msgr2=0x56328a6f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259259c640 1 --2- 172.21.15.22:0/164522226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6f5bb0 0x56328a6f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259259c640 1 -- 172.21.15.22:0/164522226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6eb2f0 msgr2=0x56328a6f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259259c640 1 --2- 172.21.15.22:0/164522226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6eb2f0 0x56328a6f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f259259c640 1 -- 172.21.15.22:0/164522226 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56328a605130 con 0x56328a6ea9d0 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.282+0000 7f2591d9b640 1 --2- 172.21.15.22:0/164522226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6eb2f0 0x56328a6f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.283+0000 7f259259c640 1 --2- 172.21.15.22:0/164522226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 0x56328a6eadb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f258409bb80 tx=0x7f258409ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419c38ba6830dda9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.283+0000 7f2592d9d640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f257c0a2c90 0x7f257c0a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f258c005e30 tx=0x7f258c005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.283+0000 7f2580ff9640 1 -- 172.21.15.22:0/164522226 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840a1080 con 0x56328a6ea9d0 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.283+0000 7f2580ff9640 1 -- 172.21.15.22:0/164522226 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2584086070 con 0x56328a6ea9d0 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.283+0000 7f2580ff9640 1 -- 172.21.15.22:0/164522226 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840a1860 con 0x56328a6ea9d0 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.283+0000 7f259ae7c740 1 -- 172.21.15.22:0/164522226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 msgr2=0x56328a6eadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.283+0000 7f259ae7c740 1 --2- 172.21.15.22:0/164522226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 0x56328a6eadb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f258409bb80 tx=0x7f258409ba80 comp rx=0 tx=0).stop 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 -- 172.21.15.22:0/164522226 shutdown_connections 2024-09-10T08:08:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 --2- 172.21.15.22:0/164522226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6f5bb0 0x56328a6f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 --2- 172.21.15.22:0/164522226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6eb2f0 0x56328a6f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 --2- 172.21.15.22:0/164522226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 0x56328a6eadb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 -- 172.21.15.22:0/164522226 >> 172.21.15.22:0/164522226 conn(0x56328a6e6f60 msgr2=0x56328a6e7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 -- 172.21.15.22:0/164522226 shutdown_connections 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 -- 172.21.15.22:0/164522226 wait complete. 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 -- start start 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 Processor -- start 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 0x56328a6f5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6eb2f0 0x56328a6f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6f5bb0 0x56328a6f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56328a6f8780 con 0x56328a6ea9d0 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56328a60bf20 con 0x56328a6eb2f0 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56328a6f8900 con 0x56328a6f5bb0 2024-09-10T08:08:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 0x56328a6f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259ae7c740 10 client.0 _ll_register_callbacks cb 0x56328a5d5030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 0x56328a6f5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49654/0 (socket says 172.21.15.22:49654) 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.284+0000 7f259259c640 1 -- 172.21.15.22:0/2305889413 learned_addr learned my addr 172.21.15.22:0/2305889413 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f2591d9b640 1 --2- 172.21.15.22:0/2305889413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6eb2f0 0x56328a6f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f259259c640 1 -- 172.21.15.22:0/2305889413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6f5bb0 msgr2=0x56328a6f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f259259c640 1 --2- 172.21.15.22:0/2305889413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6f5bb0 0x56328a6f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f259259c640 1 -- 172.21.15.22:0/2305889413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6eb2f0 msgr2=0x56328a6f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f259259c640 1 --2- 172.21.15.22:0/2305889413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6eb2f0 0x56328a6f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f259259c640 1 -- 172.21.15.22:0/2305889413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56328a3c22b0 con 0x56328a6ea9d0 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f259259c640 1 --2- 172.21.15.22:0/2305889413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 0x56328a6f5460 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f258400c6a0 tx=0x7f25840a1470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd221ab89f8c3a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f2579ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f2579ffb640 1 -- 172.21.15.22:0/2305889413 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840b9060 con 0x56328a6ea9d0 2024-09-10T08:08:10.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f2579ffb640 1 -- 172.21.15.22:0/2305889413 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f25840cf0d0 con 0x56328a6ea9d0 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f259ae7c740 1 -- 172.21.15.22:0/2305889413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2584086070 con 0x56328a6ea9d0 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f2579ffb640 1 -- 172.21.15.22:0/2305889413 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f258409fef0 con 0x56328a6ea9d0 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f259ae7c740 10 client.14982 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f259ae7c740 1 -- 172.21.15.22:0/2305889413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56328a7084e0 con 0x56328a6ea9d0 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f2579ffb640 1 -- 172.21.15.22:0/2305889413 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2584086070 con 0x56328a6ea9d0 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.285+0000 7f2579ffb640 1 -- 172.21.15.22:0/2305889413 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f25840ba250 con 0x56328a6ea9d0 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.286+0000 7f259ae7c740 10 client.14982 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.286+0000 7f259ae7c740 10 client.14982 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.286+0000 7f259ae7c740 20 client.14982 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.286+0000 7f259ae7c740 1 --2- 172.21.15.22:0/2305889413 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x56328a70a6e0 0x56328a70bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.286+0000 7f259ae7c740 4 client.14982 mds_command: new command op to 14622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.286+0000 7f259ae7c740 1 -- 172.21.15.22:0/2305889413 --> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56328a65e600 con 0x56328a70a6e0 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.286+0000 7f2591d9b640 1 --2- 172.21.15.22:0/2305889413 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x56328a70a6e0 0x56328a70bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.286+0000 7f2591d9b640 1 --2- 172.21.15.22:0/2305889413 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x56328a70a6e0 0x56328a70bb50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1b9a15f553c7576e server_cookie=b0592b541af5445c in_seq=0 out_seq=0 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.286+0000 7f2579ffb640 10 client.14982 ms_handle_connect on v2:172.21.15.22:6840/969125 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f2579ffb640 1 -- 172.21.15.22:0/2305889413 <== mds.4 v2:172.21.15.22:6840/969125 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56328a65e600 con 0x56328a70a6e0 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f2579ffb640 10 client.14982 handle_command_reply: tid=0 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f259ae7c740 1 client.14982 shutdown 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f259ae7c740 1 -- 172.21.15.22:0/2305889413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 msgr2=0x56328a6f5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f259ae7c740 1 --2- 172.21.15.22:0/2305889413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 0x56328a6f5460 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f258400c6a0 tx=0x7f25840a1470 comp rx=0 tx=0).stop 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f259ae7c740 1 -- 172.21.15.22:0/2305889413 shutdown_connections 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f259ae7c740 1 --2- 172.21.15.22:0/2305889413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6f5bb0 0x56328a6f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f259ae7c740 1 --2- 172.21.15.22:0/2305889413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6eb2f0 0x56328a6f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f259ae7c740 1 --2- 172.21.15.22:0/2305889413 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x56328a70a6e0 0x56328a70bb50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f259ae7c740 1 --2- 172.21.15.22:0/2305889413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6ea9d0 0x56328a6f5460 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f259ae7c740 1 -- 172.21.15.22:0/2305889413 >> 172.21.15.22:0/2305889413 conn(0x56328a6e6f60 msgr2=0x56328a6ecc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:10.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f2579ffb640 0 client.14982 ms_handle_reset on v2:172.21.15.22:6840/969125 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f259ae7c740 1 -- 172.21.15.22:0/2305889413 shutdown_connections 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f259ae7c740 1 -- 172.21.15.22:0/2305889413 wait complete. 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.287+0000 7f259ae7c740 20 client.14982 trim_cache size 0 max 16384 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f259ae7c740 1 Processor -- start 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f259ae7c740 1 -- start start 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f259ae7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6ea9d0 0x56328a70adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f259ae7c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6eb2f0 0x56328a709830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f259ae7c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6f5bb0 0x56328a6ecb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f259ae7c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56328a709e90 con 0x56328a6eb2f0 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f259ae7c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56328a70a560 con 0x56328a6f5bb0 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f259ae7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56328a70ac30 con 0x56328a6ea9d0 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f2591d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6eb2f0 0x56328a709830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f2591d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6eb2f0 0x56328a709830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49658/0 (socket says 172.21.15.22:49658) 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f2591d9b640 1 -- 172.21.15.22:0/644090085 learned_addr learned my addr 172.21.15.22:0/644090085 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f2592d9d640 1 --2- 172.21.15.22:0/644090085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6f5bb0 0x56328a6ecb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f259259c640 1 --2- 172.21.15.22:0/644090085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6ea9d0 0x56328a70adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f2591d9b640 1 -- 172.21.15.22:0/644090085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6ea9d0 msgr2=0x56328a70adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f2591d9b640 1 --2- 172.21.15.22:0/644090085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6ea9d0 0x56328a70adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f2591d9b640 1 -- 172.21.15.22:0/644090085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6f5bb0 msgr2=0x56328a6ecb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f2591d9b640 1 --2- 172.21.15.22:0/644090085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6f5bb0 0x56328a6ecb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f2591d9b640 1 -- 172.21.15.22:0/644090085 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56328a6f5080 con 0x56328a6eb2f0 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f259259c640 1 --2- 172.21.15.22:0/644090085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6ea9d0 0x56328a70adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.305+0000 7f2592d9d640 1 --2- 172.21.15.22:0/644090085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6f5bb0 0x56328a6ecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f2591d9b640 1 --2- 172.21.15.22:0/644090085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6eb2f0 0x56328a709830 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f259410d530 tx=0x7f258800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e3d36307078145 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f257bfff640 1 -- 172.21.15.22:0/644090085 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588003d20 con 0x56328a6eb2f0 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f257bfff640 1 -- 172.21.15.22:0/644090085 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2588005500 con 0x56328a6eb2f0 2024-09-10T08:08:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f257bfff640 1 -- 172.21.15.22:0/644090085 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25880116a0 con 0x56328a6eb2f0 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f259ae7c740 1 -- 172.21.15.22:0/644090085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6eb2f0 msgr2=0x56328a709830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f259ae7c740 1 --2- 172.21.15.22:0/644090085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6eb2f0 0x56328a709830 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f259410d530 tx=0x7f258800b390 comp rx=0 tx=0).stop 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f259ae7c740 1 -- 172.21.15.22:0/644090085 shutdown_connections 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f259ae7c740 1 --2- 172.21.15.22:0/644090085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6f5bb0 0x56328a6ecb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f259ae7c740 1 --2- 172.21.15.22:0/644090085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6eb2f0 0x56328a709830 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f259ae7c740 1 --2- 172.21.15.22:0/644090085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6ea9d0 0x56328a70adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f259ae7c740 1 -- 172.21.15.22:0/644090085 >> 172.21.15.22:0/644090085 conn(0x56328a6e6f60 msgr2=0x56328a6ec420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f259ae7c740 1 -- 172.21.15.22:0/644090085 shutdown_connections 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.306+0000 7f259ae7c740 1 -- 172.21.15.22:0/644090085 wait complete. 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f259ae7c740 1 -- start start 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f259ae7c740 1 Processor -- start 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f259ae7c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6ea9d0 0x56328a712b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f259ae7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6eb2f0 0x56328a713080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f259ae7c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6f5bb0 0x56328a772de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f259ae7c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56328a70b9d0 con 0x56328a6f5bb0 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f259ae7c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56328a70b300 con 0x56328a6ea9d0 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f259ae7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56328a70c0a0 con 0x56328a6eb2f0 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f259ae7c740 10 client.0 _ll_register_callbacks cb 0x7f2588004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f2592d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6f5bb0 0x56328a772de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f2592d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6f5bb0 0x56328a772de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49670/0 (socket says 172.21.15.22:49670) 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f2592d9d640 1 -- 172.21.15.22:0/1497337308 learned_addr learned my addr 172.21.15.22:0/1497337308 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f259259c640 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6ea9d0 0x56328a712b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f2592d9d640 1 -- 172.21.15.22:0/1497337308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6eb2f0 msgr2=0x56328a713080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f2591d9b640 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6eb2f0 0x56328a713080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f2592d9d640 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6eb2f0 0x56328a713080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f2592d9d640 1 -- 172.21.15.22:0/1497337308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6ea9d0 msgr2=0x56328a712b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:10.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f2592d9d640 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6ea9d0 0x56328a712b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.307+0000 7f2592d9d640 1 -- 172.21.15.22:0/1497337308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56328a773320 con 0x56328a6f5bb0 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f259259c640 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6ea9d0 0x56328a712b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f2592d9d640 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6f5bb0 0x56328a772de0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f258c009ca0 tx=0x7f258c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78036ed472b68a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f2579ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f2579ffb640 1 -- 172.21.15.22:0/1497337308 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c034040 con 0x56328a6f5bb0 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f2579ffb640 1 -- 172.21.15.22:0/1497337308 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f258c004450 con 0x56328a6f5bb0 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f259ae7c740 1 -- 172.21.15.22:0/1497337308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2588005500 con 0x56328a6f5bb0 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f2579ffb640 1 -- 172.21.15.22:0/1497337308 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f258c003e40 con 0x56328a6f5bb0 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f259ae7c740 10 client.14988 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f259ae7c740 1 -- 172.21.15.22:0/1497337308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56328a774560 con 0x56328a6f5bb0 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f2579ffb640 1 -- 172.21.15.22:0/1497337308 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2588005500 con 0x56328a6f5bb0 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f2579ffb640 1 -- 172.21.15.22:0/1497337308 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f258c03a430 con 0x56328a6f5bb0 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f259ae7c740 10 client.14988 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:10.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f259ae7c740 10 client.14988 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f259ae7c740 20 client.14988 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f259ae7c740 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x56328a779210 0x56328a777f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f259ae7c740 4 client.14988 mds_command: new command op to 14622 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.308+0000 7f259ae7c740 1 -- 172.21.15.22:0/1497337308 --> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] -- command(tid 0: {"prefix": "status"}) -- 0x56328a658b10 con 0x56328a779210 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259259c640 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x56328a779210 0x56328a777f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259259c640 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x56328a779210 0x56328a777f20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c952fa19a7fab6de server_cookie=25dccbb86e12f6f8 in_seq=0 out_seq=0 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f2579ffb640 10 client.14988 ms_handle_connect on v2:172.21.15.22:6840/969125 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f2579ffb640 1 -- 172.21.15.22:0/1497337308 <== mds.4 v2:172.21.15.22:6840/969125 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56328a658b10 con 0x56328a779210 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f2579ffb640 10 client.14988 handle_command_reply: tid=0 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259ae7c740 1 client.14988 shutdown 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259ae7c740 1 -- 172.21.15.22:0/1497337308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6f5bb0 msgr2=0x56328a772de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259ae7c740 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6f5bb0 0x56328a772de0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f258c009ca0 tx=0x7f258c0095c0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259ae7c740 1 -- 172.21.15.22:0/1497337308 shutdown_connections 2024-09-10T08:08:10.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259ae7c740 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x56328a779210 0x56328a777f20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259ae7c740 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56328a6f5bb0 0x56328a772de0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259ae7c740 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56328a6eb2f0 0x56328a713080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.378 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:08:10.378 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T08:08:10.378 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 4, 2024-09-10T08:08:10.378 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 14622, 2024-09-10T08:08:10.378 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-10T08:08:10.378 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-10T08:08:10.378 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-10T08:08:10.379 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 65.853038146000003, 2024-09-10T08:08:10.379 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-10T08:08:10.379 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 83, 2024-09-10T08:08:10.379 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T08:08:10.379 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 88.771472255000006 2024-09-10T08:08:10.379 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:08:10.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259ae7c740 1 --2- 172.21.15.22:0/1497337308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56328a6ea9d0 0x56328a712b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259ae7c740 1 -- 172.21.15.22:0/1497337308 >> 172.21.15.22:0/1497337308 conn(0x56328a6e6f60 msgr2=0x56328a6ecc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:10.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f2579ffb640 0 client.14988 ms_handle_reset on v2:172.21.15.22:6840/969125 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259ae7c740 1 -- 172.21.15.22:0/1497337308 shutdown_connections 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.309+0000 7f259ae7c740 1 -- 172.21.15.22:0/1497337308 wait complete. 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f259ae7c740 20 client.14988 trim_cache size 0 max 16384 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f2598aa3640 1 -- 172.21.15.22:0/3410085476 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f257c0a2c90 msgr2=0x7f257c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f2598aa3640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f257c0a2c90 0x7f257c0a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f258c005e30 tx=0x7f258c005ef0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f2598aa3640 1 -- 172.21.15.22:0/3410085476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2594102da0 msgr2=0x7f25941983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f2598aa3640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2594102da0 0x7f25941983c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f258400e9f0 tx=0x7f258400eeb0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f2598aa3640 1 -- 172.21.15.22:0/3410085476 shutdown_connections 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f2598aa3640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f257c0a2c90 0x7f257c0a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f2598aa3640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f259410c180 0x7f259419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f2598aa3640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25941036c0 0x7f2594198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f2598aa3640 1 --2- 172.21.15.22:0/3410085476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2594102da0 0x7f25941983c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:10.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f2598aa3640 1 -- 172.21.15.22:0/3410085476 >> 172.21.15.22:0/3410085476 conn(0x7f25940fc7a0 msgr2=0x7f25940fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:10.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f2598aa3640 1 -- 172.21.15.22:0/3410085476 shutdown_connections 2024-09-10T08:08:10.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:10.310+0000 7f2598aa3640 1 -- 172.21.15.22:0/3410085476 wait complete. 2024-09-10T08:08:10.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:10 smithi153 ceph-mon[35609]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T08:08:11.088 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell mds.e status 2024-09-10T08:08:11.348 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:11.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.817+0000 7f6452cd4640 1 -- 172.21.15.22:0/984504773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f644c101de0 msgr2=0x7f644c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:11.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.817+0000 7f6452cd4640 1 --2- 172.21.15.22:0/984504773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f644c101de0 0x7f644c1021c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6440009900 tx=0x7f644002a410 comp rx=0 tx=0).stop 2024-09-10T08:08:11.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.817+0000 7f6452cd4640 1 -- 172.21.15.22:0/984504773 shutdown_connections 2024-09-10T08:08:11.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.817+0000 7f6452cd4640 1 --2- 172.21.15.22:0/984504773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f644c106f10 0x7f644c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.817+0000 7f6452cd4640 1 --2- 172.21.15.22:0/984504773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f644c102790 0x7f644c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.817+0000 7f6452cd4640 1 --2- 172.21.15.22:0/984504773 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f644c101de0 0x7f644c1021c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.817+0000 7f6452cd4640 1 -- 172.21.15.22:0/984504773 >> 172.21.15.22:0/984504773 conn(0x7f644c0fd8c0 msgr2=0x7f644c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.817+0000 7f6452cd4640 1 -- 172.21.15.22:0/984504773 shutdown_connections 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.817+0000 7f6452cd4640 1 -- 172.21.15.22:0/984504773 wait complete. 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.818+0000 7f6452cd4640 1 Processor -- start 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.818+0000 7f6452cd4640 1 -- start start 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.818+0000 7f6452cd4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f644c101de0 0x7f644c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.818+0000 7f6452cd4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f644c102790 0x7f644c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.818+0000 7f6452cd4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f644c106f10 0x7f644c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.818+0000 7f6452cd4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f644c111f70 con 0x7f644c101de0 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.818+0000 7f6452cd4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f644c111df0 con 0x7f644c102790 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.818+0000 7f6452cd4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1120f0 con 0x7f644c106f10 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.818+0000 7f6450a70640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f644c101de0 0x7f644c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.818+0000 7f6450a70640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f644c101de0 0x7f644c198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49688/0 (socket says 172.21.15.22:49688) 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.818+0000 7f6450a70640 1 -- 172.21.15.22:0/869226540 learned_addr learned my addr 172.21.15.22:0/869226540 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.818+0000 7f644bfff640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f644c102790 0x7f644c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6451271640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f644c106f10 0x7f644c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6450a70640 1 -- 172.21.15.22:0/869226540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f644c106f10 msgr2=0x7f644c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6450a70640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f644c106f10 0x7f644c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6450a70640 1 -- 172.21.15.22:0/869226540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f644c102790 msgr2=0x7f644c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6450a70640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f644c102790 0x7f644c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6450a70640 1 -- 172.21.15.22:0/869226540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c19d420 con 0x7f644c101de0 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f644bfff640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f644c102790 0x7f644c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6451271640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f644c106f10 0x7f644c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6450a70640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f644c101de0 0x7f644c198470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6440005ab0 tx=0x7f64400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6449ffb640 1 -- 172.21.15.22:0/869226540 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644003f030 con 0x7f644c101de0 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6452cd4640 1 -- 172.21.15.22:0/869226540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c19d6b0 con 0x7f644c101de0 2024-09-10T08:08:11.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6449ffb640 1 -- 172.21.15.22:0/869226540 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6440003ce0 con 0x7f644c101de0 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6449ffb640 1 -- 172.21.15.22:0/869226540 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6440035070 con 0x7f644c101de0 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.819+0000 7f6452cd4640 1 -- 172.21.15.22:0/869226540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c1a4ff0 con 0x7f644c101de0 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.822+0000 7f6449ffb640 1 -- 172.21.15.22:0/869226540 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f6440042030 con 0x7f644c101de0 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.822+0000 7f64550ad740 1 Processor -- start 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.822+0000 7f64550ad740 1 -- start start 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.822+0000 7f64550ad740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e6398d0 0x55638e639cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f64550ad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e63a1f0 0x55638e648a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f64550ad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e648fc0 0x55638e64b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f64550ad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55638e5a0090 con 0x55638e648fc0 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f64550ad740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55638e547a70 con 0x55638e6398d0 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f64550ad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55638e59c050 con 0x55638e63a1f0 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f644bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e648fc0 0x55638e64b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f644bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e648fc0 0x55638e64b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49698/0 (socket says 172.21.15.22:49698) 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f644bfff640 1 -- 172.21.15.22:0/2811623792 learned_addr learned my addr 172.21.15.22:0/2811623792 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f6450a70640 1 --2- 172.21.15.22:0/2811623792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e63a1f0 0x55638e648a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f6451271640 1 --2- 172.21.15.22:0/2811623792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e6398d0 0x55638e639cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f644bfff640 1 -- 172.21.15.22:0/2811623792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e63a1f0 msgr2=0x55638e648a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f644bfff640 1 --2- 172.21.15.22:0/2811623792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e63a1f0 0x55638e648a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f644bfff640 1 -- 172.21.15.22:0/2811623792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e6398d0 msgr2=0x55638e639cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f644bfff640 1 --2- 172.21.15.22:0/2811623792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e6398d0 0x55638e639cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f644bfff640 1 -- 172.21.15.22:0/2811623792 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638e554130 con 0x55638e648fc0 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f6451271640 1 --2- 172.21.15.22:0/2811623792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e6398d0 0x55638e639cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f6449ffb640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f643c0a2c10 0x7f643c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f6451271640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f643c0a2c10 0x7f643c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f644bfff640 1 --2- 172.21.15.22:0/2811623792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e648fc0 0x55638e64b3b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f643800cc50 tx=0x7f643800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1955a1a2261a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:11.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f6449ffb640 1 -- 172.21.15.22:0/869226540 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f64400ef830 con 0x7f644c101de0 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.823+0000 7f6436ffd640 1 -- 172.21.15.22:0/2811623792 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438014070 con 0x55638e648fc0 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.824+0000 7f6436ffd640 1 -- 172.21.15.22:0/2811623792 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6438019b40 con 0x55638e648fc0 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.824+0000 7f6436ffd640 1 -- 172.21.15.22:0/2811623792 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438010cb0 con 0x55638e648fc0 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.824+0000 7f64550ad740 1 -- 172.21.15.22:0/2811623792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e648fc0 msgr2=0x55638e64b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.824+0000 7f6451271640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f643c0a2c10 0x7f643c0a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6444005fd0 tx=0x7f64440085b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.824+0000 7f64550ad740 1 --2- 172.21.15.22:0/2811623792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e648fc0 0x55638e64b3b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f643800cc50 tx=0x7f643800e720 comp rx=0 tx=0).stop 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.824+0000 7f64550ad740 1 -- 172.21.15.22:0/2811623792 shutdown_connections 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.824+0000 7f64550ad740 1 --2- 172.21.15.22:0/2811623792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e648fc0 0x55638e64b3b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.824+0000 7f64550ad740 1 --2- 172.21.15.22:0/2811623792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e63a1f0 0x55638e648a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.824+0000 7f64550ad740 1 --2- 172.21.15.22:0/2811623792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e6398d0 0x55638e639cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.824+0000 7f64550ad740 1 -- 172.21.15.22:0/2811623792 >> 172.21.15.22:0/2811623792 conn(0x55638e635f60 msgr2=0x55638e636340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.824+0000 7f64550ad740 1 -- 172.21.15.22:0/2811623792 shutdown_connections 2024-09-10T08:08:11.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.824+0000 7f64550ad740 1 -- 172.21.15.22:0/2811623792 wait complete. 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f64550ad740 1 -- start start 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f64550ad740 1 Processor -- start 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f64550ad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e6398d0 0x55638e648900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f64550ad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e63a1f0 0x55638e645c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f64550ad740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e648fc0 0x55638e646190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f64550ad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55638e64bbf0 con 0x55638e6398d0 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f64550ad740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55638e55af20 con 0x55638e648fc0 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f64550ad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55638e64bd70 con 0x55638e63a1f0 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f64550ad740 10 client.0 _ll_register_callbacks cb 0x55638e524030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f6450a70640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e6398d0 0x55638e648900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f6450a70640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e6398d0 0x55638e648900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49704/0 (socket says 172.21.15.22:49704) 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f6450a70640 1 -- 172.21.15.22:0/4248936254 learned_addr learned my addr 172.21.15.22:0/4248936254 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:11.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f6451271640 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e648fc0 0x55638e646190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.825+0000 7f644bfff640 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e63a1f0 0x55638e645c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f6450a70640 1 -- 172.21.15.22:0/4248936254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e63a1f0 msgr2=0x55638e645c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f6450a70640 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e63a1f0 0x55638e645c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f6450a70640 1 -- 172.21.15.22:0/4248936254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e648fc0 msgr2=0x55638e646190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f6450a70640 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e648fc0 0x55638e646190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f6450a70640 1 -- 172.21.15.22:0/4248936254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638e3112b0 con 0x55638e6398d0 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f6451271640 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e648fc0 0x55638e646190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f6450a70640 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e6398d0 0x55638e648900 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6440005ec0 tx=0x7f6440009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b5645b8cccf0b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f642bfff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f642bfff640 1 -- 172.21.15.22:0/4248936254 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64400f5020 con 0x55638e6398d0 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f642bfff640 1 -- 172.21.15.22:0/4248936254 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f64400ed3f0 con 0x55638e6398d0 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f64550ad740 1 -- 172.21.15.22:0/4248936254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6438019b40 con 0x55638e6398d0 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f642bfff640 1 -- 172.21.15.22:0/4248936254 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6440049030 con 0x55638e6398d0 2024-09-10T08:08:11.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f64550ad740 10 client.15000 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f64550ad740 1 -- 172.21.15.22:0/4248936254 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55638e6575e0 con 0x55638e6398d0 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.826+0000 7f642bfff640 1 -- 172.21.15.22:0/4248936254 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6438019b40 con 0x55638e6398d0 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.827+0000 7f642bfff640 1 -- 172.21.15.22:0/4248936254 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f644003b460 con 0x55638e6398d0 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.827+0000 7f64550ad740 10 client.15000 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.827+0000 7f64550ad740 10 client.15000 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.827+0000 7f64550ad740 20 client.15000 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.827+0000 7f64550ad740 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x55638e659c30 0x55638e65b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.827+0000 7f64550ad740 4 client.15000 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.827+0000 7f64550ad740 1 -- 172.21.15.22:0/4248936254 --> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55638e5ad600 con 0x55638e659c30 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.827+0000 7f644bfff640 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x55638e659c30 0x55638e65b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.827+0000 7f642bfff640 10 client.15000 ms_handle_connect on v2:172.21.15.100:6834/800491506 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.827+0000 7f644bfff640 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x55638e659c30 0x55638e65b0a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ffcbc95d38f6e60c server_cookie=b6dea90fcce2d765 in_seq=0 out_seq=0 2024-09-10T08:08:11.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.828+0000 7f642bfff640 1 -- 172.21.15.22:0/4248936254 <== mds.3 v2:172.21.15.100:6834/800491506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55638e5ad600 con 0x55638e659c30 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.828+0000 7f642bfff640 10 client.15000 handle_command_reply: tid=0 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.828+0000 7f64550ad740 1 client.15000 shutdown 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.828+0000 7f64550ad740 1 -- 172.21.15.22:0/4248936254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e6398d0 msgr2=0x55638e648900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.828+0000 7f64550ad740 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e6398d0 0x55638e648900 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6440005ec0 tx=0x7f6440009620 comp rx=0 tx=0).stop 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.828+0000 7f64550ad740 1 -- 172.21.15.22:0/4248936254 shutdown_connections 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.828+0000 7f64550ad740 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x55638e659c30 0x55638e65b0a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.828+0000 7f64550ad740 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e648fc0 0x55638e646190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.828+0000 7f64550ad740 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e63a1f0 0x55638e645c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.828+0000 7f64550ad740 1 --2- 172.21.15.22:0/4248936254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e6398d0 0x55638e648900 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.828+0000 7f642bfff640 0 client.15000 ms_handle_reset on v2:172.21.15.100:6834/800491506 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.828+0000 7f64550ad740 1 -- 172.21.15.22:0/4248936254 >> 172.21.15.22:0/4248936254 conn(0x55638e635f60 msgr2=0x55638e63bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.829+0000 7f64550ad740 1 -- 172.21.15.22:0/4248936254 shutdown_connections 2024-09-10T08:08:11.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.829+0000 7f64550ad740 1 -- 172.21.15.22:0/4248936254 wait complete. 2024-09-10T08:08:11.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.829+0000 7f64550ad740 20 client.15000 trim_cache size 0 max 16384 2024-09-10T08:08:11.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f64550ad740 1 Processor -- start 2024-09-10T08:08:11.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f64550ad740 1 -- start start 2024-09-10T08:08:11.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f64550ad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e6398d0 0x55638e65b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f64550ad740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e63a1f0 0x55638e663350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f64550ad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e648fc0 0x55638e663890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f64550ad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55638e6593e0 con 0x55638e648fc0 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f64550ad740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55638e659ab0 con 0x55638e63a1f0 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f64550ad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55638e65a180 con 0x55638e6398d0 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f644bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e63a1f0 0x55638e663350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f644bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e63a1f0 0x55638e663350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.22:52968/0 (socket says 172.21.15.22:52968) 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f6451271640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e648fc0 0x55638e663890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f644bfff640 1 -- 172.21.15.22:0/2362537790 learned_addr learned my addr 172.21.15.22:0/2362537790 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f6450a70640 1 --2- 172.21.15.22:0/2362537790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e6398d0 0x55638e65b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f644bfff640 1 -- 172.21.15.22:0/2362537790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e6398d0 msgr2=0x55638e65b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f644bfff640 1 --2- 172.21.15.22:0/2362537790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e6398d0 0x55638e65b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f644bfff640 1 -- 172.21.15.22:0/2362537790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e648fc0 msgr2=0x55638e663890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:11.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f644bfff640 1 --2- 172.21.15.22:0/2362537790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e648fc0 0x55638e663890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.847+0000 7f644bfff640 1 -- 172.21.15.22:0/2362537790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55638e648c70 con 0x55638e63a1f0 2024-09-10T08:08:11.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.848+0000 7f644bfff640 1 --2- 172.21.15.22:0/2362537790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e63a1f0 0x55638e663350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f64380058c0 tx=0x7f643800c570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e507ea23411d542e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:11.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.848+0000 7f64367fc640 1 -- 172.21.15.22:0/2362537790 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438014040 con 0x55638e63a1f0 2024-09-10T08:08:11.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.848+0000 7f64367fc640 1 -- 172.21.15.22:0/2362537790 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f643800c810 con 0x55638e63a1f0 2024-09-10T08:08:11.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.848+0000 7f64367fc640 1 -- 172.21.15.22:0/2362537790 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6438005040 con 0x55638e63a1f0 2024-09-10T08:08:11.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.849+0000 7f64550ad740 1 -- 172.21.15.22:0/2362537790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e63a1f0 msgr2=0x55638e663350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:11.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.849+0000 7f64550ad740 1 --2- 172.21.15.22:0/2362537790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e63a1f0 0x55638e663350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f64380058c0 tx=0x7f643800c570 comp rx=0 tx=0).stop 2024-09-10T08:08:11.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.849+0000 7f64550ad740 1 -- 172.21.15.22:0/2362537790 shutdown_connections 2024-09-10T08:08:11.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.849+0000 7f64550ad740 1 --2- 172.21.15.22:0/2362537790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e648fc0 0x55638e663890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.849+0000 7f64550ad740 1 --2- 172.21.15.22:0/2362537790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e63a1f0 0x55638e663350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.849+0000 7f64550ad740 1 --2- 172.21.15.22:0/2362537790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e6398d0 0x55638e65b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.849+0000 7f64550ad740 1 -- 172.21.15.22:0/2362537790 >> 172.21.15.22:0/2362537790 conn(0x55638e635f60 msgr2=0x55638e644520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.849+0000 7f64550ad740 1 -- 172.21.15.22:0/2362537790 shutdown_connections 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.849+0000 7f64550ad740 1 -- 172.21.15.22:0/2362537790 wait complete. 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.849+0000 7f64550ad740 1 -- start start 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.849+0000 7f64550ad740 1 Processor -- start 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f64550ad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e6398d0 0x55638e663ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f64550ad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e63a1f0 0x55638e65ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f64550ad740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e648fc0 0x55638e65d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f64550ad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55638e65af20 con 0x55638e63a1f0 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f64550ad740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55638e65a850 con 0x55638e648fc0 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f64550ad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55638e65b5f0 con 0x55638e6398d0 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f64550ad740 10 client.0 _ll_register_callbacks cb 0x7f6440046fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f644bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e63a1f0 0x55638e65ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f644bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e63a1f0 0x55638e65ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49730/0 (socket says 172.21.15.22:49730) 2024-09-10T08:08:11.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f6451271640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e648fc0 0x55638e65d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f644bfff640 1 -- 172.21.15.22:0/2580008903 learned_addr learned my addr 172.21.15.22:0/2580008903 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f6450a70640 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e6398d0 0x55638e663ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f6451271640 1 -- 172.21.15.22:0/2580008903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e6398d0 msgr2=0x55638e663ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f6451271640 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e6398d0 0x55638e663ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f6451271640 1 -- 172.21.15.22:0/2580008903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e63a1f0 msgr2=0x55638e65ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f6451271640 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e63a1f0 0x55638e65ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f6451271640 1 -- 172.21.15.22:0/2580008903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55638e65db70 con 0x55638e648fc0 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f644bfff640 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e63a1f0 0x55638e65ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f6451271640 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e648fc0 0x55638e65d340 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55638e630d20 tx=0x7f6444004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcb7df03e448f60c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.850+0000 7f642bfff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f642bfff640 1 -- 172.21.15.22:0/2580008903 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644402c060 con 0x55638e648fc0 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f64550ad740 1 -- 172.21.15.22:0/2580008903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f643800c810 con 0x55638e648fc0 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f642bfff640 1 -- 172.21.15.22:0/2580008903 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f644400ec90 con 0x55638e648fc0 2024-09-10T08:08:11.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f642bfff640 1 -- 172.21.15.22:0/2580008903 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f644400ee90 con 0x55638e648fc0 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f64550ad740 10 client.24746 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f64550ad740 1 -- 172.21.15.22:0/2580008903 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55638e6c4400 con 0x55638e648fc0 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f642bfff640 1 -- 172.21.15.22:0/2580008903 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f643800c810 con 0x55638e648fc0 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f642bfff640 1 -- 172.21.15.22:0/2580008903 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6444027410 con 0x55638e648fc0 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f64550ad740 10 client.24746 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f64550ad740 10 client.24746 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f64550ad740 20 client.24746 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f64550ad740 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x55638e6c9020 0x55638e6c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f64550ad740 4 client.24746 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.851+0000 7f64550ad740 1 -- 172.21.15.22:0/2580008903 --> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] -- command(tid 0: {"prefix": "status"}) -- 0x55638e5a7b10 con 0x55638e6c9020 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f6450a70640 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x55638e6c9020 0x55638e6c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f6450a70640 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x55638e6c9020 0x55638e6c7d30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b832a8a72af5410d server_cookie=3d02a0a9fafcc19 in_seq=0 out_seq=0 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f642bfff640 10 client.24746 ms_handle_connect on v2:172.21.15.100:6834/800491506 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f642bfff640 1 -- 172.21.15.22:0/2580008903 <== mds.3 v2:172.21.15.100:6834/800491506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55638e5a7b10 con 0x55638e6c9020 2024-09-10T08:08:11.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f642bfff640 10 client.24746 handle_command_reply: tid=0 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f64550ad740 1 client.24746 shutdown 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f64550ad740 1 -- 172.21.15.22:0/2580008903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e648fc0 msgr2=0x55638e65d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f64550ad740 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e648fc0 0x55638e65d340 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55638e630d20 tx=0x7f6444004a40 comp rx=0 tx=0).stop 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f64550ad740 1 -- 172.21.15.22:0/2580008903 shutdown_connections 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f64550ad740 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x55638e6c9020 0x55638e6c7d30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f64550ad740 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55638e648fc0 0x55638e65d340 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f64550ad740 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55638e63a1f0 0x55638e65ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f642bfff640 0 client.24746 ms_handle_reset on v2:172.21.15.100:6834/800491506 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f64550ad740 1 --2- 172.21.15.22:0/2580008903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55638e6398d0 0x55638e663ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.852+0000 7f64550ad740 1 -- 172.21.15.22:0/2580008903 >> 172.21.15.22:0/2580008903 conn(0x55638e635f60 msgr2=0x55638e640a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f64550ad740 1 -- 172.21.15.22:0/2580008903 shutdown_connections 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f64550ad740 1 -- 172.21.15.22:0/2580008903 wait complete. 2024-09-10T08:08:11.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f64550ad740 20 client.24746 trim_cache size 0 max 16384 2024-09-10T08:08:11.858 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:08:11.858 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T08:08:11.858 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 3, 2024-09-10T08:08:11.858 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24455, 2024-09-10T08:08:11.858 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-10T08:08:11.858 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-10T08:08:11.858 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-10T08:08:11.858 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 67.419181151999993, 2024-09-10T08:08:11.858 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-10T08:08:11.858 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 83, 2024-09-10T08:08:11.858 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T08:08:11.858 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 107.041500597 2024-09-10T08:08:11.859 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:08:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f6452cd4640 1 -- 172.21.15.22:0/869226540 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f643c0a2c10 msgr2=0x7f643c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f6452cd4640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f643c0a2c10 0x7f643c0a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6444005fd0 tx=0x7f64440085b0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f6452cd4640 1 -- 172.21.15.22:0/869226540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f644c101de0 msgr2=0x7f644c198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f6452cd4640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f644c101de0 0x7f644c198470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6440005ab0 tx=0x7f64400042f0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f6452cd4640 1 -- 172.21.15.22:0/869226540 shutdown_connections 2024-09-10T08:08:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f6452cd4640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f643c0a2c10 0x7f643c0a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f6452cd4640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f644c106f10 0x7f644c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f6452cd4640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f644c102790 0x7f644c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f6452cd4640 1 --2- 172.21.15.22:0/869226540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f644c101de0 0x7f644c198470 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.853+0000 7f6452cd4640 1 -- 172.21.15.22:0/869226540 >> 172.21.15.22:0/869226540 conn(0x7f644c0fd8c0 msgr2=0x7f644c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.854+0000 7f6452cd4640 1 -- 172.21.15.22:0/869226540 shutdown_connections 2024-09-10T08:08:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:11.854+0000 7f6452cd4640 1 -- 172.21.15.22:0/869226540 wait complete. 2024-09-10T08:08:12.289 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:12 smithi022 ceph-mon[30854]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:08:12.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:12 smithi100 ceph-mon[35102]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:08:12.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:12 smithi153 ceph-mon[35609]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:08:12.554 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T08:08:12.811 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:13.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.289+0000 7f9794de5640 1 -- 172.21.15.22:0/2638910756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9790102570 msgr2=0x7f97901029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.289+0000 7f9794de5640 1 --2- 172.21.15.22:0/2638910756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9790102570 0x7f97901029b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9778009900 tx=0x7f977802a480 comp rx=0 tx=0).stop 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.289+0000 7f9794de5640 1 -- 172.21.15.22:0/2638910756 shutdown_connections 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.289+0000 7f9794de5640 1 --2- 172.21.15.22:0/2638910756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790102ef0 0x7f979010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.289+0000 7f9794de5640 1 --2- 172.21.15.22:0/2638910756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9790102570 0x7f97901029b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.289+0000 7f9794de5640 1 --2- 172.21.15.22:0/2638910756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790100e20 0x7f9790101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.289+0000 7f9794de5640 1 -- 172.21.15.22:0/2638910756 >> 172.21.15.22:0/2638910756 conn(0x7f97900fc7d0 msgr2=0x7f97900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.289+0000 7f9794de5640 1 -- 172.21.15.22:0/2638910756 shutdown_connections 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.289+0000 7f9794de5640 1 -- 172.21.15.22:0/2638910756 wait complete. 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f9794de5640 1 Processor -- start 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f9794de5640 1 -- start start 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f9794de5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790100e20 0x7f9790198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f9794de5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9790102570 0x7f9790198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f9794de5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790102ef0 0x7f979019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f9794de5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9790110fa0 con 0x7f9790102570 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f9794de5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9790110e20 con 0x7f9790100e20 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f9794de5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9790111120 con 0x7f9790102ef0 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f978dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9790102570 0x7f9790198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f978dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9790102570 0x7f9790198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49740/0 (socket says 172.21.15.22:49740) 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f978dd9b640 1 -- 172.21.15.22:0/1497309107 learned_addr learned my addr 172.21.15.22:0/1497309107 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f978ed9d640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790102ef0 0x7f979019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f978e59c640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790100e20 0x7f9790198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f978dd9b640 1 -- 172.21.15.22:0/1497309107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790102ef0 msgr2=0x7f979019ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f978dd9b640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790102ef0 0x7f979019ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f978dd9b640 1 -- 172.21.15.22:0/1497309107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790100e20 msgr2=0x7f9790198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f978dd9b640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790100e20 0x7f9790198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f978dd9b640 1 -- 172.21.15.22:0/1497309107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979019d520 con 0x7f9790102570 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f978e59c640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790100e20 0x7f9790198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.290+0000 7f978dd9b640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9790102570 0x7f9790198ab0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9778006010 tx=0x7f9778003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.291+0000 7f97877fe640 1 -- 172.21.15.22:0/1497309107 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977803f070 con 0x7f9790102570 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.291+0000 7f9794de5640 1 -- 172.21.15.22:0/1497309107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979019d7b0 con 0x7f9790102570 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.291+0000 7f97877fe640 1 -- 172.21.15.22:0/1497309107 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9778031e30 con 0x7f9790102570 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.291+0000 7f97877fe640 1 -- 172.21.15.22:0/1497309107 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778035030 con 0x7f9790102570 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.291+0000 7f9794de5640 1 -- 172.21.15.22:0/1497309107 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97901a50f0 con 0x7f9790102570 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.293+0000 7f97971be740 1 Processor -- start 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.293+0000 7f97877fe640 1 -- 172.21.15.22:0/1497309107 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f9778042070 con 0x7f9790102570 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.293+0000 7f97971be740 1 -- start start 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f97971be740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea249d0 0x56416ea24db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f97971be740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea252f0 0x56416ea2f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f97971be740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea2fbb0 0x56416ea31fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f97971be740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56416e98b090 con 0x56416ea249d0 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f97971be740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56416e932a70 con 0x56416ea252f0 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f97971be740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56416e987050 con 0x56416ea2fbb0 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea249d0 0x56416ea24db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea249d0 0x56416ea24db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49752/0 (socket says 172.21.15.22:49752) 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978ed9d640 1 -- 172.21.15.22:0/1139109684 learned_addr learned my addr 172.21.15.22:0/1139109684 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978e59c640 1 --2- 172.21.15.22:0/1139109684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea252f0 0x56416ea2f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978dd9b640 1 --2- 172.21.15.22:0/1139109684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea2fbb0 0x56416ea31fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978ed9d640 1 -- 172.21.15.22:0/1139109684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea2fbb0 msgr2=0x56416ea31fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978ed9d640 1 --2- 172.21.15.22:0/1139109684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea2fbb0 0x56416ea31fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978ed9d640 1 -- 172.21.15.22:0/1139109684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea252f0 msgr2=0x56416ea2f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978ed9d640 1 --2- 172.21.15.22:0/1139109684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea252f0 0x56416ea2f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978ed9d640 1 -- 172.21.15.22:0/1139109684 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56416e93f130 con 0x56416ea249d0 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978e59c640 1 --2- 172.21.15.22:0/1139109684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea252f0 0x56416ea2f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:13.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f97877fe640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f977c0a2c10 0x7f977c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978ed9d640 1 --2- 172.21.15.22:0/1139109684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea249d0 0x56416ea24db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f978800cb40 tx=0x7f978800e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a101a35ce1144094 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:13.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f978e59c640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f977c0a2c10 0x7f977c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f97877fe640 1 -- 172.21.15.22:0/1497309107 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f97780efbd0 con 0x7f9790102570 2024-09-10T08:08:13.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.294+0000 7f9784ff9640 1 -- 172.21.15.22:0/1139109684 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9788004020 con 0x56416ea249d0 2024-09-10T08:08:13.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.295+0000 7f9784ff9640 1 -- 172.21.15.22:0/1139109684 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97880041c0 con 0x56416ea249d0 2024-09-10T08:08:13.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.295+0000 7f9784ff9640 1 -- 172.21.15.22:0/1139109684 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97880107b0 con 0x56416ea249d0 2024-09-10T08:08:13.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.295+0000 7f97971be740 1 -- 172.21.15.22:0/1139109684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea249d0 msgr2=0x56416ea24db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:13.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.295+0000 7f978e59c640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f977c0a2c10 0x7f977c0a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x56416ea21dc0 tx=0x7f9780007660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:13.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.295+0000 7f97971be740 1 --2- 172.21.15.22:0/1139109684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea249d0 0x56416ea24db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f978800cb40 tx=0x7f978800e350 comp rx=0 tx=0).stop 2024-09-10T08:08:13.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.295+0000 7f97971be740 1 -- 172.21.15.22:0/1139109684 shutdown_connections 2024-09-10T08:08:13.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.295+0000 7f97971be740 1 --2- 172.21.15.22:0/1139109684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea2fbb0 0x56416ea31fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.295+0000 7f97971be740 1 --2- 172.21.15.22:0/1139109684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea252f0 0x56416ea2f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.295+0000 7f97971be740 1 --2- 172.21.15.22:0/1139109684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea249d0 0x56416ea24db0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.295+0000 7f97971be740 1 -- 172.21.15.22:0/1139109684 >> 172.21.15.22:0/1139109684 conn(0x56416ea20f60 msgr2=0x56416ea21340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.295+0000 7f97971be740 1 -- 172.21.15.22:0/1139109684 shutdown_connections 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.295+0000 7f97971be740 1 -- 172.21.15.22:0/1139109684 wait complete. 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f97971be740 1 -- start start 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f97971be740 1 Processor -- start 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f97971be740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea2f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f97971be740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea2c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f97971be740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea2cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f97971be740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56416ea32780 con 0x56416ea252f0 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f97971be740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56416e945f20 con 0x56416ea2fbb0 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f97971be740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56416ea32900 con 0x56416ea249d0 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f97971be740 10 client.0 _ll_register_callbacks cb 0x56416e90f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:13.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f978dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea2c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f978dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea2c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49766/0 (socket says 172.21.15.22:49766) 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f978dd9b640 1 -- 172.21.15.22:0/607935106 learned_addr learned my addr 172.21.15.22:0/607935106 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.296+0000 7f978e59c640 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea2f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f978ed9d640 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea2cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f978dd9b640 1 -- 172.21.15.22:0/607935106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 msgr2=0x56416ea2f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f978dd9b640 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea2f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f978dd9b640 1 -- 172.21.15.22:0/607935106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 msgr2=0x56416ea2cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f978dd9b640 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea2cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f978dd9b640 1 -- 172.21.15.22:0/607935106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56416e6fc2b0 con 0x56416ea252f0 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f978dd9b640 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea2c7a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f97780b8730 tx=0x7f977803b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f00ba4575ba5f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f9775ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f9775ffb640 1 -- 172.21.15.22:0/607935106 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778049030 con 0x56416ea252f0 2024-09-10T08:08:13.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f97971be740 1 -- 172.21.15.22:0/607935106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97880041c0 con 0x56416ea252f0 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f9775ffb640 1 -- 172.21.15.22:0/607935106 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f977803b5f0 con 0x56416ea252f0 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f9775ffb640 1 -- 172.21.15.22:0/607935106 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97780bbe10 con 0x56416ea252f0 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f97971be740 10 client.15018 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f97971be740 1 -- 172.21.15.22:0/607935106 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56416ea3e0a0 con 0x56416ea252f0 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.297+0000 7f9775ffb640 1 -- 172.21.15.22:0/607935106 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97880041c0 con 0x56416ea252f0 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.298+0000 7f9775ffb640 1 -- 172.21.15.22:0/607935106 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97780c4ab0 con 0x56416ea252f0 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.298+0000 7f97971be740 10 client.15018 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.298+0000 7f97971be740 10 client.15018 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.298+0000 7f97971be740 20 client.15018 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.298+0000 7f97971be740 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x56416ea40710 0x56416ea41b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.298+0000 7f97971be740 4 client.15018 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.298+0000 7f97971be740 1 -- 172.21.15.22:0/607935106 --> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56416e998600 con 0x56416ea40710 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.298+0000 7f978e59c640 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x56416ea40710 0x56416ea41b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.298+0000 7f9775ffb640 10 client.15018 ms_handle_connect on v2:172.21.15.153:6838/1766856743 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.298+0000 7f978e59c640 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x56416ea40710 0x56416ea41b80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=688e34a37e0c9541 server_cookie=b8b762e4bca08fdc in_seq=0 out_seq=0 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f9775ffb640 1 -- 172.21.15.22:0/607935106 <== mds.2 v2:172.21.15.153:6838/1766856743 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56416e998600 con 0x56416ea40710 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f9775ffb640 10 client.15018 handle_command_reply: tid=0 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f97971be740 1 client.15018 shutdown 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f97971be740 1 -- 172.21.15.22:0/607935106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 msgr2=0x56416ea2c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f97971be740 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea2c7a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f97780b8730 tx=0x7f977803b560 comp rx=0 tx=0).stop 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f97971be740 1 -- 172.21.15.22:0/607935106 shutdown_connections 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f97971be740 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea2cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f97971be740 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x56416ea40710 0x56416ea41b80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f97971be740 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea2c7a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f97971be740 1 --2- 172.21.15.22:0/607935106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea2f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f97971be740 1 -- 172.21.15.22:0/607935106 >> 172.21.15.22:0/607935106 conn(0x56416ea20f60 msgr2=0x56416ea26c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f9775ffb640 0 client.15018 ms_handle_reset on v2:172.21.15.153:6838/1766856743 2024-09-10T08:08:13.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f97971be740 1 -- 172.21.15.22:0/607935106 shutdown_connections 2024-09-10T08:08:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.299+0000 7f97971be740 1 -- 172.21.15.22:0/607935106 wait complete. 2024-09-10T08:08:13.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.300+0000 7f97971be740 20 client.15018 trim_cache size 0 max 16384 2024-09-10T08:08:13.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.317+0000 7f97971be740 1 Processor -- start 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.317+0000 7f97971be740 1 -- start start 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f97971be740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea40710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f97971be740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea2b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f97971be740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea2b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f97971be740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56416ea3fec0 con 0x56416ea252f0 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f97971be740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56416ea40590 con 0x56416ea2fbb0 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f97971be740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56416ea40c60 con 0x56416ea249d0 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f978dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea2b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f978dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea2b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49770/0 (socket says 172.21.15.22:49770) 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f978dd9b640 1 -- 172.21.15.22:0/234440246 learned_addr learned my addr 172.21.15.22:0/234440246 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f978dd9b640 1 -- 172.21.15.22:0/234440246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 msgr2=0x56416ea40710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f978ed9d640 1 --2- 172.21.15.22:0/234440246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea2b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f978e59c640 1 --2- 172.21.15.22:0/234440246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea40710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f978dd9b640 1 --2- 172.21.15.22:0/234440246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea40710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f978dd9b640 1 -- 172.21.15.22:0/234440246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 msgr2=0x56416ea2b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f978dd9b640 1 --2- 172.21.15.22:0/234440246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea2b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f978dd9b640 1 -- 172.21.15.22:0/234440246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56416ea21bf0 con 0x56416ea252f0 2024-09-10T08:08:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f978ed9d640 1 --2- 172.21.15.22:0/234440246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea2b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f978dd9b640 1 --2- 172.21.15.22:0/234440246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea2b090 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f97780c4e50 tx=0x7f97780dc200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fc2fd7696431a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f9777fff640 1 -- 172.21.15.22:0/234440246 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778049070 con 0x56416ea252f0 2024-09-10T08:08:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f9777fff640 1 -- 172.21.15.22:0/234440246 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97780bc9d0 con 0x56416ea252f0 2024-09-10T08:08:13.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.318+0000 7f9777fff640 1 -- 172.21.15.22:0/234440246 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97780bbc30 con 0x56416ea252f0 2024-09-10T08:08:13.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.319+0000 7f97971be740 1 -- 172.21.15.22:0/234440246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 msgr2=0x56416ea2b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:13.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.319+0000 7f97971be740 1 --2- 172.21.15.22:0/234440246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea2b090 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f97780c4e50 tx=0x7f97780dc200 comp rx=0 tx=0).stop 2024-09-10T08:08:13.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.319+0000 7f97971be740 1 -- 172.21.15.22:0/234440246 shutdown_connections 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.319+0000 7f97971be740 1 --2- 172.21.15.22:0/234440246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea2b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.319+0000 7f97971be740 1 --2- 172.21.15.22:0/234440246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea2b090 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.319+0000 7f97971be740 1 --2- 172.21.15.22:0/234440246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea40710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.319+0000 7f97971be740 1 -- 172.21.15.22:0/234440246 >> 172.21.15.22:0/234440246 conn(0x56416ea20f60 msgr2=0x56416ea1bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.319+0000 7f97971be740 1 -- 172.21.15.22:0/234440246 shutdown_connections 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.319+0000 7f97971be740 1 -- 172.21.15.22:0/234440246 wait complete. 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.319+0000 7f97971be740 1 -- start start 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.319+0000 7f97971be740 1 Processor -- start 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f97971be740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea28dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f97971be740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea29310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f97971be740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea48dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f97971be740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56416ea41a00 con 0x56416ea252f0 2024-09-10T08:08:13.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f97971be740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56416ea41330 con 0x56416ea2fbb0 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f97971be740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56416ea420d0 con 0x56416ea249d0 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f97971be740 10 client.0 _ll_register_callbacks cb 0x7f9778003f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f978dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea29310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f978dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea29310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49786/0 (socket says 172.21.15.22:49786) 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f978dd9b640 1 -- 172.21.15.22:0/1795911028 learned_addr learned my addr 172.21.15.22:0/1795911028 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f978e59c640 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea28dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f978ed9d640 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea48dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f978dd9b640 1 -- 172.21.15.22:0/1795911028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 msgr2=0x56416ea28dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f978dd9b640 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea28dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f978dd9b640 1 -- 172.21.15.22:0/1795911028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 msgr2=0x56416ea48dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f978dd9b640 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea48dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f978dd9b640 1 -- 172.21.15.22:0/1795911028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56416ea49310 con 0x56416ea252f0 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f978e59c640 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea28dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:13.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f978dd9b640 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea29310 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f97780c4a10 tx=0x7f9778031480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa0576f511808e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f9775ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.320+0000 7f9775ffb640 1 -- 172.21.15.22:0/1795911028 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9778049070 con 0x56416ea252f0 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f9775ffb640 1 -- 172.21.15.22:0/1795911028 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f97780edb90 con 0x56416ea252f0 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f97971be740 1 -- 172.21.15.22:0/1795911028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97780bc9d0 con 0x56416ea252f0 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f9775ffb640 1 -- 172.21.15.22:0/1795911028 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f97780bbc30 con 0x56416ea252f0 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f97971be740 10 client.15024 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f97971be740 1 -- 172.21.15.22:0/1795911028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56416ea49310 con 0x56416ea252f0 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f9775ffb640 1 -- 172.21.15.22:0/1795911028 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97780bc9d0 con 0x56416ea252f0 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f9775ffb640 1 -- 172.21.15.22:0/1795911028 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f97780c0170 con 0x56416ea252f0 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f97971be740 10 client.15024 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f97971be740 10 client.15024 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f97971be740 20 client.15024 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f97971be740 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x56416eaaeb10 0x56416eaad820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:13.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f97971be740 4 client.15024 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f97971be740 1 -- 172.21.15.22:0/1795911028 --> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] -- command(tid 0: {"prefix": "status"}) -- 0x56416e992b10 con 0x56416eaaeb10 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.321+0000 7f978e59c640 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x56416eaaeb10 0x56416eaad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.322+0000 7f978e59c640 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x56416eaaeb10 0x56416eaad820 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5d94d8afb7ea1977 server_cookie=2a08fd4ec039129b in_seq=0 out_seq=0 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.322+0000 7f9775ffb640 10 client.15024 ms_handle_connect on v2:172.21.15.153:6838/1766856743 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.322+0000 7f9775ffb640 1 -- 172.21.15.22:0/1795911028 <== mds.2 v2:172.21.15.153:6838/1766856743 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x56416e992b10 con 0x56416eaaeb10 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.322+0000 7f9775ffb640 10 client.15024 handle_command_reply: tid=0 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.322+0000 7f97971be740 1 client.15024 shutdown 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.322+0000 7f97971be740 1 -- 172.21.15.22:0/1795911028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 msgr2=0x56416ea29310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.322+0000 7f97971be740 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea29310 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f97780c4a10 tx=0x7f9778031480 comp rx=0 tx=0).stop 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f97971be740 1 -- 172.21.15.22:0/1795911028 shutdown_connections 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f97971be740 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56416ea2fbb0 0x56416ea48dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f97971be740 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x56416eaaeb10 0x56416eaad820 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f97971be740 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56416ea252f0 0x56416ea29310 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f97971be740 1 --2- 172.21.15.22:0/1795911028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56416ea249d0 0x56416ea28dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f9775ffb640 0 client.15024 ms_handle_reset on v2:172.21.15.153:6838/1766856743 2024-09-10T08:08:13.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f97971be740 1 -- 172.21.15.22:0/1795911028 >> 172.21.15.22:0/1795911028 conn(0x56416ea20f60 msgr2=0x56416ea2c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:13.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f97971be740 1 -- 172.21.15.22:0/1795911028 shutdown_connections 2024-09-10T08:08:13.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f97971be740 1 -- 172.21.15.22:0/1795911028 wait complete. 2024-09-10T08:08:13.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f97971be740 20 client.15024 trim_cache size 0 max 16384 2024-09-10T08:08:13.328 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:08:13.328 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T08:08:13.328 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 2, 2024-09-10T08:08:13.328 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24469, 2024-09-10T08:08:13.328 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-10T08:08:13.329 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-10T08:08:13.329 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-10T08:08:13.329 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 69.896260221999995, 2024-09-10T08:08:13.329 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-10T08:08:13.329 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 83, 2024-09-10T08:08:13.329 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T08:08:13.329 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 97.834883366 2024-09-10T08:08:13.329 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:08:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f9794de5640 1 -- 172.21.15.22:0/1497309107 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f977c0a2c10 msgr2=0x7f977c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f9794de5640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f977c0a2c10 0x7f977c0a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x56416ea21dc0 tx=0x7f9780007660 comp rx=0 tx=0).stop 2024-09-10T08:08:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f9794de5640 1 -- 172.21.15.22:0/1497309107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9790102570 msgr2=0x7f9790198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f9794de5640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9790102570 0x7f9790198ab0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9778006010 tx=0x7f9778003c80 comp rx=0 tx=0).stop 2024-09-10T08:08:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f9794de5640 1 -- 172.21.15.22:0/1497309107 shutdown_connections 2024-09-10T08:08:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f9794de5640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f977c0a2c10 0x7f977c0a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f9794de5640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790102ef0 0x7f979019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f9794de5640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9790102570 0x7f9790198ab0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f9794de5640 1 --2- 172.21.15.22:0/1497309107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790100e20 0x7f9790198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.323+0000 7f9794de5640 1 -- 172.21.15.22:0/1497309107 >> 172.21.15.22:0/1497309107 conn(0x7f97900fc7d0 msgr2=0x7f9790069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.324+0000 7f9794de5640 1 -- 172.21.15.22:0/1497309107 shutdown_connections 2024-09-10T08:08:13.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:13.324+0000 7f9794de5640 1 -- 172.21.15.22:0/1497309107 wait complete. 2024-09-10T08:08:14.041 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T08:08:14.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:14 smithi022 ceph-mon[30854]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:08:14.297 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:14.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:14 smithi100 ceph-mon[35102]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:08:14.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:14 smithi153 ceph-mon[35609]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:08:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.765+0000 7f3601395640 1 -- 172.21.15.22:0/4002763864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35fc103740 msgr2=0x7f35fc107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:14.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.765+0000 7f3601395640 1 --2- 172.21.15.22:0/4002763864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35fc103740 0x7f35fc107b80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009930 tx=0x7f35f002a420 comp rx=0 tx=0).stop 2024-09-10T08:08:14.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.765+0000 7f3601395640 1 -- 172.21.15.22:0/4002763864 shutdown_connections 2024-09-10T08:08:14.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.765+0000 7f3601395640 1 --2- 172.21.15.22:0/4002763864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35fc108290 0x7f35fc10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.765+0000 7f3601395640 1 --2- 172.21.15.22:0/4002763864 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35fc103740 0x7f35fc107b80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.765+0000 7f3601395640 1 --2- 172.21.15.22:0/4002763864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35fc102d90 0x7f35fc103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.765+0000 7f3601395640 1 -- 172.21.15.22:0/4002763864 >> 172.21.15.22:0/4002763864 conn(0x7f35fc0fc7d0 msgr2=0x7f35fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:14.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.765+0000 7f3601395640 1 -- 172.21.15.22:0/4002763864 shutdown_connections 2024-09-10T08:08:14.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.765+0000 7f3601395640 1 -- 172.21.15.22:0/4002763864 wait complete. 2024-09-10T08:08:14.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.765+0000 7f3601395640 1 Processor -- start 2024-09-10T08:08:14.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f3601395640 1 -- start start 2024-09-10T08:08:14.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f3601395640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35fc102d90 0x7f35fc1009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f3601395640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35fc103740 0x7f35fc100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f3601395640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35fc108290 0x7f35fc101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f3601395640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc112090 con 0x7f35fc108290 2024-09-10T08:08:14.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f3601395640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc111f10 con 0x7f35fc103740 2024-09-10T08:08:14.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f3601395640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f35fc112210 con 0x7f35fc102d90 2024-09-10T08:08:14.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f35fb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35fc108290 0x7f35fc101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f35fb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35fc108290 0x7f35fc101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54590/0 (socket says 172.21.15.22:54590) 2024-09-10T08:08:14.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f35fb7fe640 1 -- 172.21.15.22:0/179344070 learned_addr learned my addr 172.21.15.22:0/179344070 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f35faffd640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35fc102d90 0x7f35fc1009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35fc103740 0x7f35fc100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f35fb7fe640 1 -- 172.21.15.22:0/179344070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35fc102d90 msgr2=0x7f35fc1009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f35fb7fe640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35fc102d90 0x7f35fc1009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f35fb7fe640 1 -- 172.21.15.22:0/179344070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35fc103740 msgr2=0x7f35fc100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f35fb7fe640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35fc103740 0x7f35fc100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f35fb7fe640 1 -- 172.21.15.22:0/179344070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35fc1a69b0 con 0x7f35fc108290 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.766+0000 7f35fb7fe640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35fc108290 0x7f35fc101470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f35f400eaa0 tx=0x7f35f400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.767+0000 7f35e3fff640 1 -- 172.21.15.22:0/179344070 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4004d20 con 0x7f35fc108290 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.767+0000 7f3601395640 1 -- 172.21.15.22:0/179344070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35fc1a6ca0 con 0x7f35fc108290 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.767+0000 7f35e3fff640 1 -- 172.21.15.22:0/179344070 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f4005020 con 0x7f35fc108290 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.767+0000 7f35e3fff640 1 -- 172.21.15.22:0/179344070 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f40116d0 con 0x7f35fc108290 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.767+0000 7f3601395640 1 -- 172.21.15.22:0/179344070 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35fc1a71b0 con 0x7f35fc108290 2024-09-10T08:08:14.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.769+0000 7f35e3fff640 1 -- 172.21.15.22:0/179344070 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f35f40051d0 con 0x7f35fc108290 2024-09-10T08:08:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.769+0000 7f360376e740 1 Processor -- start 2024-09-10T08:08:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.769+0000 7f360376e740 1 -- start start 2024-09-10T08:08:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f360376e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585179d0 0x55aa58517db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f360376e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa58522670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f360376e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa58522bb0 0x55aa58524fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f360376e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aa5847e090 con 0x55aa585179d0 2024-09-10T08:08:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f360376e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aa58425a70 con 0x55aa585182f0 2024-09-10T08:08:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f360376e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aa5847a050 con 0x55aa58522bb0 2024-09-10T08:08:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35fa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585179d0 0x55aa58517db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35fa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585179d0 0x55aa58517db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54592/0 (socket says 172.21.15.22:54592) 2024-09-10T08:08:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35fa7fc640 1 -- 172.21.15.22:0/3534513494 learned_addr learned my addr 172.21.15.22:0/3534513494 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:14.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35e3fff640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f35e40a2c10 0x7f35e40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35faffd640 1 --2- 172.21.15.22:0/3534513494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa58522670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35fb7fe640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f35e40a2c10 0x7f35e40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/3534513494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa58522bb0 0x55aa58524fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35e3fff640 1 -- 172.21.15.22:0/179344070 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f35f40cf340 con 0x7f35fc108290 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35fa7fc640 1 -- 172.21.15.22:0/3534513494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa58522bb0 msgr2=0x55aa58524fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/3534513494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa58522bb0 0x55aa58524fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35fa7fc640 1 -- 172.21.15.22:0/3534513494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 msgr2=0x55aa58522670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/3534513494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa58522670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35fa7fc640 1 -- 172.21.15.22:0/3534513494 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa58432130 con 0x55aa585179d0 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/3534513494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585179d0 0x55aa58517db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f35f0005ab0 tx=0x7f35f0005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f45e3f66dfcd14 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35fb7fe640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f35e40a2c10 0x7f35e40a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f35f4084fd0 tx=0x7f35f4086040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.770+0000 7f35e17fa640 1 -- 172.21.15.22:0/3534513494 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0035050 con 0x55aa585179d0 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.771+0000 7f35e17fa640 1 -- 172.21.15.22:0/3534513494 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f0031800 con 0x55aa585179d0 2024-09-10T08:08:14.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.771+0000 7f35e17fa640 1 -- 172.21.15.22:0/3534513494 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f00048c0 con 0x55aa585179d0 2024-09-10T08:08:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.771+0000 7f360376e740 1 -- 172.21.15.22:0/3534513494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585179d0 msgr2=0x55aa58517db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.771+0000 7f360376e740 1 --2- 172.21.15.22:0/3534513494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585179d0 0x55aa58517db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f35f0005ab0 tx=0x7f35f0005d70 comp rx=0 tx=0).stop 2024-09-10T08:08:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.771+0000 7f360376e740 1 -- 172.21.15.22:0/3534513494 shutdown_connections 2024-09-10T08:08:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.771+0000 7f360376e740 1 --2- 172.21.15.22:0/3534513494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa58522bb0 0x55aa58524fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.771+0000 7f360376e740 1 --2- 172.21.15.22:0/3534513494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa58522670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.771+0000 7f360376e740 1 --2- 172.21.15.22:0/3534513494 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585179d0 0x55aa58517db0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.771+0000 7f360376e740 1 -- 172.21.15.22:0/3534513494 >> 172.21.15.22:0/3534513494 conn(0x55aa58513f60 msgr2=0x55aa58514340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.771+0000 7f360376e740 1 -- 172.21.15.22:0/3534513494 shutdown_connections 2024-09-10T08:08:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.771+0000 7f360376e740 1 -- 172.21.15.22:0/3534513494 wait complete. 2024-09-10T08:08:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f360376e740 1 -- start start 2024-09-10T08:08:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f360376e740 1 Processor -- start 2024-09-10T08:08:14.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f360376e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 0x55aa58522470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f360376e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa5851f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f360376e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 0x55aa5851fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f360376e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aa58525780 con 0x55aa58522bb0 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f360376e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aa58438f20 con 0x55aa585182f0 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f360376e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aa58525900 con 0x55aa585179d0 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f360376e740 10 client.0 _ll_register_callbacks cb 0x55aa58402030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f35fa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 0x55aa5851fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f35fa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 0x55aa5851fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54606/0 (socket says 172.21.15.22:54606) 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f35fa7fc640 1 -- 172.21.15.22:0/841212440 learned_addr learned my addr 172.21.15.22:0/841212440 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f35faffd640 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa5851f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.772+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 0x55aa58522470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f35fa7fc640 1 -- 172.21.15.22:0/841212440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 msgr2=0x55aa58522470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:14.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 0x55aa58522470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f35fa7fc640 1 -- 172.21.15.22:0/841212440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 msgr2=0x55aa5851f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa5851f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f35fa7fc640 1 -- 172.21.15.22:0/841212440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa581ef2b0 con 0x55aa58522bb0 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 0x55aa5851fd00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f35f0005790 tx=0x7f35f00054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff69bcd470352b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f35deff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f35deff5640 1 -- 172.21.15.22:0/841212440 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0051060 con 0x55aa58522bb0 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f35deff5640 1 -- 172.21.15.22:0/841212440 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f35f0004350 con 0x55aa58522bb0 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f360376e740 1 -- 172.21.15.22:0/841212440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f0031800 con 0x55aa58522bb0 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f35deff5640 1 -- 172.21.15.22:0/841212440 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f35f0035070 con 0x55aa58522bb0 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f360376e740 10 client.15036 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f360376e740 1 -- 172.21.15.22:0/841212440 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aa585310d0 con 0x55aa58522bb0 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f35deff5640 1 -- 172.21.15.22:0/841212440 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f0031800 con 0x55aa58522bb0 2024-09-10T08:08:14.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.773+0000 7f35deff5640 1 -- 172.21.15.22:0/841212440 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f35f0056070 con 0x55aa58522bb0 2024-09-10T08:08:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.774+0000 7f360376e740 10 client.15036 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.774+0000 7f360376e740 10 client.15036 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T08:08:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.774+0000 7f360376e740 20 client.15036 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.774+0000 7f360376e740 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55aa585331e0 0x55aa58534650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.774+0000 7f360376e740 4 client.15036 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:08:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.774+0000 7f360376e740 1 -- 172.21.15.22:0/841212440 --> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa5848b600 con 0x55aa585331e0 2024-09-10T08:08:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.774+0000 7f35faffd640 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55aa585331e0 0x55aa58534650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.774+0000 7f35faffd640 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55aa585331e0 0x55aa58534650 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c4f35d37f70ff4b3 server_cookie=db4df22fc77a0351 in_seq=0 out_seq=0 2024-09-10T08:08:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.774+0000 7f35deff5640 10 client.15036 ms_handle_connect on v2:172.21.15.100:6836/1987693702 2024-09-10T08:08:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f35deff5640 1 -- 172.21.15.22:0/841212440 <== mds.1 v2:172.21.15.100:6836/1987693702 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa5848b600 con 0x55aa585331e0 2024-09-10T08:08:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f35deff5640 10 client.15036 handle_command_reply: tid=0 2024-09-10T08:08:14.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f360376e740 1 client.15036 shutdown 2024-09-10T08:08:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f360376e740 1 -- 172.21.15.22:0/841212440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 msgr2=0x55aa5851fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f360376e740 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 0x55aa5851fd00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f35f0005790 tx=0x7f35f00054b0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f360376e740 1 -- 172.21.15.22:0/841212440 shutdown_connections 2024-09-10T08:08:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f360376e740 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 0x55aa5851fd00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f360376e740 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa5851f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f360376e740 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55aa585331e0 0x55aa58534650 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f35deff5640 0 client.15036 ms_handle_reset on v2:172.21.15.100:6836/1987693702 2024-09-10T08:08:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f360376e740 1 --2- 172.21.15.22:0/841212440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 0x55aa58522470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f360376e740 1 -- 172.21.15.22:0/841212440 >> 172.21.15.22:0/841212440 conn(0x55aa58513f60 msgr2=0x55aa58519c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.775+0000 7f360376e740 1 -- 172.21.15.22:0/841212440 shutdown_connections 2024-09-10T08:08:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.776+0000 7f360376e740 1 -- 172.21.15.22:0/841212440 wait complete. 2024-09-10T08:08:14.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.776+0000 7f360376e740 20 client.15036 trim_cache size 0 max 16384 2024-09-10T08:08:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f360376e740 1 Processor -- start 2024-09-10T08:08:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f360376e740 1 -- start start 2024-09-10T08:08:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f360376e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 0x55aa58534650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f360376e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa5851ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f360376e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 0x55aa5851cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f360376e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aa58532990 con 0x55aa58522bb0 2024-09-10T08:08:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f360376e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aa58533060 con 0x55aa585182f0 2024-09-10T08:08:14.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f360376e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aa58533730 con 0x55aa585179d0 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f35fa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 0x55aa5851cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f35fa7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 0x55aa5851cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54616/0 (socket says 172.21.15.22:54616) 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f35fa7fc640 1 -- 172.21.15.22:0/4130425204 learned_addr learned my addr 172.21.15.22:0/4130425204 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/4130425204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 0x55aa58534650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f35faffd640 1 --2- 172.21.15.22:0/4130425204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa5851ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f35fa7fc640 1 -- 172.21.15.22:0/4130425204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 msgr2=0x55aa58534650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/4130425204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 0x55aa58534650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f35fa7fc640 1 -- 172.21.15.22:0/4130425204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 msgr2=0x55aa5851ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/4130425204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa5851ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f35fa7fc640 1 -- 172.21.15.22:0/4130425204 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa58518120 con 0x55aa58522bb0 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.794+0000 7f35faffd640 1 --2- 172.21.15.22:0/4130425204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa5851ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.795+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/4130425204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 0x55aa5851cf60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f35f0003a00 tx=0x7f35f003f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9275fd1f36a4ab62 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.795+0000 7f35e0ff9640 1 -- 172.21.15.22:0/4130425204 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f005c030 con 0x55aa58522bb0 2024-09-10T08:08:14.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.795+0000 7f35e0ff9640 1 -- 172.21.15.22:0/4130425204 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f005d040 con 0x55aa58522bb0 2024-09-10T08:08:14.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.795+0000 7f35e0ff9640 1 -- 172.21.15.22:0/4130425204 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0051070 con 0x55aa58522bb0 2024-09-10T08:08:14.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 -- 172.21.15.22:0/4130425204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 msgr2=0x55aa5851cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 --2- 172.21.15.22:0/4130425204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 0x55aa5851cf60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f35f0003a00 tx=0x7f35f003f040 comp rx=0 tx=0).stop 2024-09-10T08:08:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 -- 172.21.15.22:0/4130425204 shutdown_connections 2024-09-10T08:08:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 --2- 172.21.15.22:0/4130425204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa58522bb0 0x55aa5851cf60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 --2- 172.21.15.22:0/4130425204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa585182f0 0x55aa5851ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 --2- 172.21.15.22:0/4130425204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 0x55aa58534650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 -- 172.21.15.22:0/4130425204 >> 172.21.15.22:0/4130425204 conn(0x55aa58513f60 msgr2=0x55aa5850ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 -- 172.21.15.22:0/4130425204 shutdown_connections 2024-09-10T08:08:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 -- 172.21.15.22:0/4130425204 wait complete. 2024-09-10T08:08:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 -- start start 2024-09-10T08:08:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 Processor -- start 2024-09-10T08:08:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 0x55aa585358b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585182f0 0x55aa58535df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa58522bb0 0x55aa58536330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aa585344d0 con 0x55aa585182f0 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aa58533e00 con 0x55aa58522bb0 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aa58534ba0 con 0x55aa585179d0 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f360376e740 10 client.0 _ll_register_callbacks cb 0x7f35ec00a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.796+0000 7f35faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585182f0 0x55aa58535df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585182f0 0x55aa58535df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54632/0 (socket says 172.21.15.22:54632) 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35faffd640 1 -- 172.21.15.22:0/304097733 learned_addr learned my addr 172.21.15.22:0/304097733 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 0x55aa585358b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa58522bb0 0x55aa58536330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35faffd640 1 -- 172.21.15.22:0/304097733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 msgr2=0x55aa585358b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35faffd640 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 0x55aa585358b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35faffd640 1 -- 172.21.15.22:0/304097733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa58522bb0 msgr2=0x55aa58536330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35faffd640 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa58522bb0 0x55aa58536330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35faffd640 1 -- 172.21.15.22:0/304097733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa5859bb80 con 0x55aa585182f0 2024-09-10T08:08:14.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35faffd640 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585182f0 0x55aa58535df0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f35ec005e10 tx=0x7f35ec010ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e214921160b4a5f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35deff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35deff5640 1 -- 172.21.15.22:0/304097733 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec005220 con 0x55aa585182f0 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35deff5640 1 -- 172.21.15.22:0/304097733 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f35ec0053c0 con 0x55aa585182f0 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f360376e740 1 -- 172.21.15.22:0/304097733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f005d040 con 0x55aa585182f0 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f35deff5640 1 -- 172.21.15.22:0/304097733 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f35ec0055c0 con 0x55aa585182f0 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f360376e740 10 client.15042 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.797+0000 7f360376e740 1 -- 172.21.15.22:0/304097733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55aa5859ce50 con 0x55aa585182f0 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.798+0000 7f35deff5640 1 -- 172.21.15.22:0/304097733 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f005d040 con 0x55aa585182f0 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.798+0000 7f35deff5640 1 -- 172.21.15.22:0/304097733 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f35ec025400 con 0x55aa585182f0 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.798+0000 7f360376e740 10 client.15042 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.798+0000 7f360376e740 10 client.15042 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.798+0000 7f360376e740 20 client.15042 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.798+0000 7f360376e740 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55aa585331e0 0x55aa585a0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.798+0000 7f360376e740 4 client.15042 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:08:14.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.798+0000 7f360376e740 1 -- 172.21.15.22:0/304097733 --> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] -- command(tid 0: {"prefix": "status"}) -- 0x55aa58485b10 con 0x55aa585331e0 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.798+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55aa585331e0 0x55aa585a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.798+0000 7f35fa7fc640 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55aa585331e0 0x55aa585a0790 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ddc30cefea040156 server_cookie=2d6612295acd2e5d in_seq=0 out_seq=0 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.798+0000 7f35deff5640 10 client.15042 ms_handle_connect on v2:172.21.15.100:6836/1987693702 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f35deff5640 1 -- 172.21.15.22:0/304097733 <== mds.1 v2:172.21.15.100:6836/1987693702 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55aa58485b10 con 0x55aa585331e0 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f35deff5640 10 client.15042 handle_command_reply: tid=0 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f360376e740 1 client.15042 shutdown 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f360376e740 1 -- 172.21.15.22:0/304097733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585182f0 msgr2=0x55aa58535df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f360376e740 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585182f0 0x55aa58535df0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f35ec005e10 tx=0x7f35ec010ad0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f360376e740 1 -- 172.21.15.22:0/304097733 shutdown_connections 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f360376e740 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa58522bb0 0x55aa58536330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f360376e740 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aa585182f0 0x55aa58535df0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f360376e740 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55aa585331e0 0x55aa585a0790 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f360376e740 1 --2- 172.21.15.22:0/304097733 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa585179d0 0x55aa585358b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f35deff5640 0 client.15042 ms_handle_reset on v2:172.21.15.100:6836/1987693702 2024-09-10T08:08:14.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f360376e740 1 -- 172.21.15.22:0/304097733 >> 172.21.15.22:0/304097733 conn(0x55aa58513f60 msgr2=0x55aa58520e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:14.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f360376e740 1 -- 172.21.15.22:0/304097733 shutdown_connections 2024-09-10T08:08:14.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f360376e740 1 -- 172.21.15.22:0/304097733 wait complete. 2024-09-10T08:08:14.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.799+0000 7f360376e740 20 client.15042 trim_cache size 0 max 16384 2024-09-10T08:08:14.805 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:08:14.805 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T08:08:14.805 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 1, 2024-09-10T08:08:14.805 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24479, 2024-09-10T08:08:14.805 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-10T08:08:14.805 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-10T08:08:14.805 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-10T08:08:14.805 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 72.380791807999998, 2024-09-10T08:08:14.805 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-10T08:08:14.806 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 83, 2024-09-10T08:08:14.806 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T08:08:14.806 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 102.038856882 2024-09-10T08:08:14.806 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:08:14.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.800+0000 7f3601395640 1 -- 172.21.15.22:0/179344070 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f35e40a2c10 msgr2=0x7f35e40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:14.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.800+0000 7f3601395640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f35e40a2c10 0x7f35e40a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f35f4084fd0 tx=0x7f35f4086040 comp rx=0 tx=0).stop 2024-09-10T08:08:14.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.800+0000 7f3601395640 1 -- 172.21.15.22:0/179344070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35fc108290 msgr2=0x7f35fc101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:14.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.800+0000 7f3601395640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35fc108290 0x7f35fc101470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f35f400eaa0 tx=0x7f35f400eea0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.800+0000 7f3601395640 1 -- 172.21.15.22:0/179344070 shutdown_connections 2024-09-10T08:08:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.800+0000 7f3601395640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f35e40a2c10 0x7f35e40a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.800+0000 7f3601395640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35fc108290 0x7f35fc101470 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.800+0000 7f3601395640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35fc103740 0x7f35fc100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.800+0000 7f3601395640 1 --2- 172.21.15.22:0/179344070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35fc102d90 0x7f35fc1009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.800+0000 7f3601395640 1 -- 172.21.15.22:0/179344070 >> 172.21.15.22:0/179344070 conn(0x7f35fc0fc7d0 msgr2=0x7f35fc105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.800+0000 7f3601395640 1 -- 172.21.15.22:0/179344070 shutdown_connections 2024-09-10T08:08:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:14.800+0000 7f3601395640 1 -- 172.21.15.22:0/179344070 wait complete. 2024-09-10T08:08:15.419 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T08:08:15.677 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:16.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:16 smithi022 ceph-mon[30854]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:08:16.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.116+0000 7f50939bd640 1 -- 172.21.15.22:0/3634741968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c1009b0 msgr2=0x7f508c100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:16.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.116+0000 7f50939bd640 1 --2- 172.21.15.22:0/3634741968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c1009b0 0x7f508c100d90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5088009900 tx=0x7f508802a410 comp rx=0 tx=0).stop 2024-09-10T08:08:16.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.116+0000 7f50939bd640 1 -- 172.21.15.22:0/3634741968 shutdown_connections 2024-09-10T08:08:16.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.116+0000 7f50939bd640 1 --2- 172.21.15.22:0/3634741968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f508c10e4d0 0x7f508c1108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.116+0000 7f50939bd640 1 --2- 172.21.15.22:0/3634741968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f508c101360 0x7f508c10df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.116+0000 7f50939bd640 1 --2- 172.21.15.22:0/3634741968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c1009b0 0x7f508c100d90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.116+0000 7f50939bd640 1 -- 172.21.15.22:0/3634741968 >> 172.21.15.22:0/3634741968 conn(0x7f508c0fc7d0 msgr2=0x7f508c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:16.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.116+0000 7f50939bd640 1 -- 172.21.15.22:0/3634741968 shutdown_connections 2024-09-10T08:08:16.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.116+0000 7f50939bd640 1 -- 172.21.15.22:0/3634741968 wait complete. 2024-09-10T08:08:16.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f50939bd640 1 Processor -- start 2024-09-10T08:08:16.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f50939bd640 1 -- start start 2024-09-10T08:08:16.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f50939bd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f508c1009b0 0x7f508c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f50939bd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c101360 0x7f508c19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f50939bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f508c10e4d0 0x7f508c19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f50939bd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f508c114210 con 0x7f508c101360 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f50939bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f508c114090 con 0x7f508c10e4d0 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f50939bd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f508c114390 con 0x7f508c1009b0 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f5090f58640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c101360 0x7f508c19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f5090f58640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c101360 0x7f508c19ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54658/0 (socket says 172.21.15.22:54658) 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f5090f58640 1 -- 172.21.15.22:0/1201803124 learned_addr learned my addr 172.21.15.22:0/1201803124 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f5091759640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f508c1009b0 0x7f508c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f5091f5a640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f508c10e4d0 0x7f508c19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f5090f58640 1 -- 172.21.15.22:0/1201803124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f508c1009b0 msgr2=0x7f508c19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f5090f58640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f508c1009b0 0x7f508c19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f5090f58640 1 -- 172.21.15.22:0/1201803124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f508c10e4d0 msgr2=0x7f508c19f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f5090f58640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f508c10e4d0 0x7f508c19f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.117+0000 7f5090f58640 1 -- 172.21.15.22:0/1201803124 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508c19f6f0 con 0x7f508c101360 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.118+0000 7f5090f58640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c101360 0x7f508c19ac80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f507c00d950 tx=0x7f507c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.118+0000 7f50827fc640 1 -- 172.21.15.22:0/1201803124 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c017070 con 0x7f508c101360 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.118+0000 7f50939bd640 1 -- 172.21.15.22:0/1201803124 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508c19f9e0 con 0x7f508c101360 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.118+0000 7f50827fc640 1 -- 172.21.15.22:0/1201803124 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f507c009c30 con 0x7f508c101360 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.118+0000 7f50827fc640 1 -- 172.21.15.22:0/1201803124 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c00f6b0 con 0x7f508c101360 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.118+0000 7f50939bd640 1 -- 172.21.15.22:0/1201803124 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508c1a72c0 con 0x7f508c101360 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.121+0000 7f50827fc640 1 -- 172.21.15.22:0/1201803124 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f507c0109d0 con 0x7f508c101360 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.121+0000 7f5095d96740 1 Processor -- start 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.121+0000 7f5095d96740 1 -- start start 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.121+0000 7f5095d96740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc36fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.121+0000 7f5095d96740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc37a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.121+0000 7f5095d96740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 0x5628dc37cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.121+0000 7f5095d96740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5628dc2d6090 con 0x5628dc36f9d0 2024-09-10T08:08:16.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.121+0000 7f5095d96740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5628dc27da70 con 0x5628dc37abb0 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.121+0000 7f5095d96740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5628dc2d2050 con 0x5628dc3702f0 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.121+0000 7f5091f5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc36fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.121+0000 7f5091f5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc36fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54670/0 (socket says 172.21.15.22:54670) 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.121+0000 7f5091f5a640 1 -- 172.21.15.22:0/1891522886 learned_addr learned my addr 172.21.15.22:0/1891522886 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f5091759640 1 --2- 172.21.15.22:0/1891522886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc37a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f50827fc640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f50780a2c10 0x7f50780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f5090f58640 1 --2- 172.21.15.22:0/1891522886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 0x5628dc37cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f5091f5a640 1 -- 172.21.15.22:0/1891522886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 msgr2=0x5628dc37a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f5091f5a640 1 --2- 172.21.15.22:0/1891522886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc37a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f5091f5a640 1 -- 172.21.15.22:0/1891522886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 msgr2=0x5628dc37cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f5091f5a640 1 --2- 172.21.15.22:0/1891522886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 0x5628dc37cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f5091f5a640 1 -- 172.21.15.22:0/1891522886 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628dc28a130 con 0x5628dc36f9d0 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f50827fc640 1 -- 172.21.15.22:0/1201803124 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f507c0cee40 con 0x7f508c101360 2024-09-10T08:08:16.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f5091f5a640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f50780a2c10 0x7f50780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f5091f5a640 1 --2- 172.21.15.22:0/1891522886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc36fdb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5084008ec0 tx=0x7f508400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abcc746d48c5332 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f50777fe640 1 -- 172.21.15.22:0/1891522886 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084022070 con 0x5628dc36f9d0 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f50777fe640 1 -- 172.21.15.22:0/1891522886 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f508401c470 con 0x5628dc36f9d0 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.122+0000 7f50777fe640 1 -- 172.21.15.22:0/1891522886 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508401a600 con 0x5628dc36f9d0 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.123+0000 7f5095d96740 1 -- 172.21.15.22:0/1891522886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 msgr2=0x5628dc36fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.123+0000 7f5091f5a640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f50780a2c10 0x7f50780a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f508401f000 tx=0x7f5084020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.123+0000 7f5095d96740 1 --2- 172.21.15.22:0/1891522886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc36fdb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5084008ec0 tx=0x7f508400e720 comp rx=0 tx=0).stop 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.123+0000 7f5095d96740 1 -- 172.21.15.22:0/1891522886 shutdown_connections 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.123+0000 7f5095d96740 1 --2- 172.21.15.22:0/1891522886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 0x5628dc37cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.123+0000 7f5095d96740 1 --2- 172.21.15.22:0/1891522886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc37a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.123+0000 7f5095d96740 1 --2- 172.21.15.22:0/1891522886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc36fdb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.123+0000 7f5095d96740 1 -- 172.21.15.22:0/1891522886 >> 172.21.15.22:0/1891522886 conn(0x5628dc36bf60 msgr2=0x5628dc36c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.123+0000 7f5095d96740 1 -- 172.21.15.22:0/1891522886 shutdown_connections 2024-09-10T08:08:16.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.123+0000 7f5095d96740 1 -- 172.21.15.22:0/1891522886 wait complete. 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5095d96740 1 -- start start 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5095d96740 1 Processor -- start 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5095d96740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc36f9d0 0x5628dc37a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5095d96740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc3702f0 0x5628dc377790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5095d96740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc37abb0 0x5628dc377cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5095d96740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5628dc37d780 con 0x5628dc37abb0 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5095d96740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5628dc290f20 con 0x5628dc3702f0 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5095d96740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5628dc37d900 con 0x5628dc36f9d0 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5095d96740 10 client.0 _ll_register_callbacks cb 0x5628dc25a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5091f5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc37abb0 0x5628dc377cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5091f5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc37abb0 0x5628dc377cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54672/0 (socket says 172.21.15.22:54672) 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5091f5a640 1 -- 172.21.15.22:0/3014316640 learned_addr learned my addr 172.21.15.22:0/3014316640 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.124+0000 7f5091759640 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc36f9d0 0x5628dc37a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5090f58640 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc3702f0 0x5628dc377790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5091f5a640 1 -- 172.21.15.22:0/3014316640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc36f9d0 msgr2=0x5628dc37a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5091f5a640 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc36f9d0 0x5628dc37a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5091f5a640 1 -- 172.21.15.22:0/3014316640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc3702f0 msgr2=0x5628dc377790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5091f5a640 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc3702f0 0x5628dc377790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5091f5a640 1 -- 172.21.15.22:0/3014316640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628dc0472b0 con 0x5628dc37abb0 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5091759640 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc36f9d0 0x5628dc37a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5091f5a640 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc37abb0 0x5628dc377cd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f508401cd20 tx=0x7f508401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2357e1fe303993d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5074ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5074ff9640 1 -- 172.21.15.22:0/3014316640 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5084022040 con 0x5628dc37abb0 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5074ff9640 1 -- 172.21.15.22:0/3014316640 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5084005a90 con 0x5628dc37abb0 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5095d96740 1 -- 172.21.15.22:0/3014316640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f508401c470 con 0x5628dc37abb0 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5074ff9640 1 -- 172.21.15.22:0/3014316640 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f50840089c0 con 0x5628dc37abb0 2024-09-10T08:08:16.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5095d96740 10 client.15054 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5095d96740 1 -- 172.21.15.22:0/3014316640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5628dc389070 con 0x5628dc37abb0 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.125+0000 7f5074ff9640 1 -- 172.21.15.22:0/3014316640 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f508401c470 con 0x5628dc37abb0 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.126+0000 7f5074ff9640 1 -- 172.21.15.22:0/3014316640 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5084019040 con 0x5628dc37abb0 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.126+0000 7f5095d96740 10 client.15054 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.126+0000 7f5095d96740 10 client.15054 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.126+0000 7f5095d96740 20 client.15054 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.126+0000 7f5095d96740 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x5628dc38b490 0x5628dc38c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.126+0000 7f5095d96740 4 client.15054 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.126+0000 7f5095d96740 1 -- 172.21.15.22:0/3014316640 --> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628dc2e3600 con 0x5628dc38b490 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.126+0000 7f5091759640 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x5628dc38b490 0x5628dc38c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.127+0000 7f5074ff9640 10 client.15054 ms_handle_connect on v2:172.21.15.100:6838/2512683674 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.127+0000 7f5091759640 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x5628dc38b490 0x5628dc38c900 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d15918fd1b912b3 server_cookie=3a188d255b53bc3b in_seq=0 out_seq=0 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.127+0000 7f5074ff9640 1 -- 172.21.15.22:0/3014316640 <== mds.0 v2:172.21.15.100:6838/2512683674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628dc2e3600 con 0x5628dc38b490 2024-09-10T08:08:16.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.127+0000 7f5074ff9640 10 client.15054 handle_command_reply: tid=0 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.127+0000 7f5095d96740 1 client.15054 shutdown 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.128+0000 7f5095d96740 1 -- 172.21.15.22:0/3014316640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc37abb0 msgr2=0x5628dc377cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.128+0000 7f5095d96740 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc37abb0 0x5628dc377cd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f508401cd20 tx=0x7f508401cc10 comp rx=0 tx=0).stop 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.128+0000 7f5095d96740 1 -- 172.21.15.22:0/3014316640 shutdown_connections 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.128+0000 7f5095d96740 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x5628dc38b490 0x5628dc38c900 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.128+0000 7f5095d96740 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc37abb0 0x5628dc377cd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.128+0000 7f5095d96740 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc3702f0 0x5628dc377790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.128+0000 7f5095d96740 1 --2- 172.21.15.22:0/3014316640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc36f9d0 0x5628dc37a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.128+0000 7f5095d96740 1 -- 172.21.15.22:0/3014316640 >> 172.21.15.22:0/3014316640 conn(0x5628dc36bf60 msgr2=0x5628dc371c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.128+0000 7f5074ff9640 0 client.15054 ms_handle_reset on v2:172.21.15.100:6838/2512683674 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.128+0000 7f5095d96740 1 -- 172.21.15.22:0/3014316640 shutdown_connections 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.128+0000 7f5095d96740 1 -- 172.21.15.22:0/3014316640 wait complete. 2024-09-10T08:08:16.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.128+0000 7f5095d96740 20 client.15054 trim_cache size 0 max 16384 2024-09-10T08:08:16.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.146+0000 7f5095d96740 1 Processor -- start 2024-09-10T08:08:16.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.146+0000 7f5095d96740 1 -- start start 2024-09-10T08:08:16.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5095d96740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc38bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5095d96740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc36b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5095d96740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 0x5628dc394be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5095d96740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5628dc38ac40 con 0x5628dc36f9d0 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5095d96740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5628dc38b310 con 0x5628dc37abb0 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5095d96740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5628dc38b9e0 con 0x5628dc3702f0 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5091759640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc38bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5091759640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc38bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54674/0 (socket says 172.21.15.22:54674) 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5091759640 1 -- 172.21.15.22:0/3502481735 learned_addr learned my addr 172.21.15.22:0/3502481735 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5090f58640 1 --2- 172.21.15.22:0/3502481735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc36b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5091f5a640 1 --2- 172.21.15.22:0/3502481735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 0x5628dc394be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5091759640 1 -- 172.21.15.22:0/3502481735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 msgr2=0x5628dc36b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5091759640 1 --2- 172.21.15.22:0/3502481735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc36b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5091759640 1 -- 172.21.15.22:0/3502481735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 msgr2=0x5628dc394be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:16.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5091759640 1 --2- 172.21.15.22:0/3502481735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 0x5628dc394be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5091759640 1 -- 172.21.15.22:0/3502481735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628dc37d890 con 0x5628dc36f9d0 2024-09-10T08:08:16.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5091759640 1 --2- 172.21.15.22:0/3502481735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc38bb60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5088009230 tx=0x7f50880058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510f3119348555f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:16.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.147+0000 7f5076ffd640 1 -- 172.21.15.22:0/3502481735 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508804a070 con 0x5628dc36f9d0 2024-09-10T08:08:16.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.148+0000 7f5076ffd640 1 -- 172.21.15.22:0/3502481735 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5088005500 con 0x5628dc36f9d0 2024-09-10T08:08:16.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.148+0000 7f5076ffd640 1 -- 172.21.15.22:0/3502481735 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088035040 con 0x5628dc36f9d0 2024-09-10T08:08:16.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.148+0000 7f5095d96740 1 -- 172.21.15.22:0/3502481735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 msgr2=0x5628dc38bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:16.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.148+0000 7f5095d96740 1 --2- 172.21.15.22:0/3502481735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc38bb60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5088009230 tx=0x7f50880058d0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.148+0000 7f5095d96740 1 -- 172.21.15.22:0/3502481735 shutdown_connections 2024-09-10T08:08:16.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.148+0000 7f5095d96740 1 --2- 172.21.15.22:0/3502481735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 0x5628dc394be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.148+0000 7f5095d96740 1 --2- 172.21.15.22:0/3502481735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc36b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.148+0000 7f5095d96740 1 --2- 172.21.15.22:0/3502481735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc38bb60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.148+0000 7f5095d96740 1 -- 172.21.15.22:0/3502481735 >> 172.21.15.22:0/3502481735 conn(0x5628dc36bf60 msgr2=0x5628dc366ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:16.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.148+0000 7f5095d96740 1 -- 172.21.15.22:0/3502481735 shutdown_connections 2024-09-10T08:08:16.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.148+0000 7f5095d96740 1 -- 172.21.15.22:0/3502481735 wait complete. 2024-09-10T08:08:16.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.149+0000 7f5095d96740 1 -- start start 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.149+0000 7f5095d96740 1 Processor -- start 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.149+0000 7f5095d96740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc3751b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.149+0000 7f5095d96740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc373a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.149+0000 7f5095d96740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 0x5628dc373f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.149+0000 7f5095d96740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5628dc38c780 con 0x5628dc36f9d0 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.149+0000 7f5095d96740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5628dc38c0b0 con 0x5628dc37abb0 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.149+0000 7f5095d96740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5628dc38ce50 con 0x5628dc3702f0 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.149+0000 7f5095d96740 10 client.0 _ll_register_callbacks cb 0x7f5084020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.149+0000 7f5091759640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc3751b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.149+0000 7f5091759640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc3751b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54678/0 (socket says 172.21.15.22:54678) 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.149+0000 7f5091759640 1 -- 172.21.15.22:0/3318367852 learned_addr learned my addr 172.21.15.22:0/3318367852 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5090f58640 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc373a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5091f5a640 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 0x5628dc373f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5091759640 1 -- 172.21.15.22:0/3318367852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 msgr2=0x5628dc373a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5091759640 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc373a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5091759640 1 -- 172.21.15.22:0/3318367852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 msgr2=0x5628dc373f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5091759640 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 0x5628dc373f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5091759640 1 -- 172.21.15.22:0/3318367852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628dc3745b0 con 0x5628dc36f9d0 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5090f58640 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc373a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5091759640 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc3751b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50880057a0 tx=0x7f5088000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301105179a8733e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5074ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5074ff9640 1 -- 172.21.15.22:0/3318367852 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508804a050 con 0x5628dc36f9d0 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5095d96740 1 -- 172.21.15.22:0/3318367852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5088005500 con 0x5628dc36f9d0 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5074ff9640 1 -- 172.21.15.22:0/3318367852 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f5088004100 con 0x5628dc36f9d0 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5074ff9640 1 -- 172.21.15.22:0/3318367852 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5088035040 con 0x5628dc36f9d0 2024-09-10T08:08:16.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5095d96740 10 client.15060 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.150+0000 7f5095d96740 1 -- 172.21.15.22:0/3318367852 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5628dc394930 con 0x5628dc36f9d0 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.151+0000 7f5074ff9640 1 -- 172.21.15.22:0/3318367852 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5088005500 con 0x5628dc36f9d0 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.151+0000 7f5074ff9640 1 -- 172.21.15.22:0/3318367852 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5088003710 con 0x5628dc36f9d0 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.151+0000 7f5095d96740 10 client.15060 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.151+0000 7f5095d96740 10 client.15060 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.151+0000 7f5095d96740 20 client.15060 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.151+0000 7f5095d96740 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x5628dc3f9270 0x5628dc3f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.151+0000 7f5095d96740 4 client.15060 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.151+0000 7f5095d96740 1 -- 172.21.15.22:0/3318367852 --> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] -- command(tid 0: {"prefix": "status"}) -- 0x5628dc2ddb10 con 0x5628dc3f9270 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.151+0000 7f5090f58640 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x5628dc3f9270 0x5628dc3f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5074ff9640 10 client.15060 ms_handle_connect on v2:172.21.15.100:6838/2512683674 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5090f58640 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x5628dc3f9270 0x5628dc3f7f80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14d4db13f1a2e6cd server_cookie=c010cb069cc258e1 in_seq=0 out_seq=0 2024-09-10T08:08:16.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5074ff9640 1 -- 172.21.15.22:0/3318367852 <== mds.0 v2:172.21.15.100:6838/2512683674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x5628dc2ddb10 con 0x5628dc3f9270 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5074ff9640 10 client.15060 handle_command_reply: tid=0 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5095d96740 1 client.15060 shutdown 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5095d96740 1 -- 172.21.15.22:0/3318367852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 msgr2=0x5628dc3751b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5095d96740 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc3751b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50880057a0 tx=0x7f5088000bc0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5095d96740 1 -- 172.21.15.22:0/3318367852 shutdown_connections 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5095d96740 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x5628dc3f9270 0x5628dc3f7f80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5095d96740 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5628dc37abb0 0x5628dc373f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5095d96740 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5628dc3702f0 0x5628dc373a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5095d96740 1 --2- 172.21.15.22:0/3318367852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628dc36f9d0 0x5628dc3751b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5095d96740 1 -- 172.21.15.22:0/3318367852 >> 172.21.15.22:0/3318367852 conn(0x5628dc36bf60 msgr2=0x5628dc371c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5074ff9640 0 client.15060 ms_handle_reset on v2:172.21.15.100:6838/2512683674 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5095d96740 1 -- 172.21.15.22:0/3318367852 shutdown_connections 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5095d96740 1 -- 172.21.15.22:0/3318367852 wait complete. 2024-09-10T08:08:16.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.152+0000 7f5095d96740 20 client.15060 trim_cache size 0 max 16384 2024-09-10T08:08:16.158 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:08:16.158 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T08:08:16.158 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-09-10T08:08:16.158 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24512, 2024-09-10T08:08:16.158 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-10T08:08:16.158 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-10T08:08:16.158 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-10T08:08:16.158 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 80.78053611, 2024-09-10T08:08:16.158 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-10T08:08:16.158 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 83, 2024-09-10T08:08:16.159 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T08:08:16.159 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 92.011347641 2024-09-10T08:08:16.159 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:08:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.153+0000 7f50939bd640 1 -- 172.21.15.22:0/1201803124 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f50780a2c10 msgr2=0x7f50780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.153+0000 7f50939bd640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f50780a2c10 0x7f50780a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f508401f000 tx=0x7f5084020000 comp rx=0 tx=0).stop 2024-09-10T08:08:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.153+0000 7f50939bd640 1 -- 172.21.15.22:0/1201803124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c101360 msgr2=0x7f508c19ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.153+0000 7f50939bd640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c101360 0x7f508c19ac80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f507c00d950 tx=0x7f507c00de10 comp rx=0 tx=0).stop 2024-09-10T08:08:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.153+0000 7f50939bd640 1 -- 172.21.15.22:0/1201803124 shutdown_connections 2024-09-10T08:08:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.153+0000 7f50939bd640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f50780a2c10 0x7f50780a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.153+0000 7f50939bd640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f508c10e4d0 0x7f508c19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.153+0000 7f50939bd640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f508c101360 0x7f508c19ac80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.153+0000 7f50939bd640 1 --2- 172.21.15.22:0/1201803124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f508c1009b0 0x7f508c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.153+0000 7f50939bd640 1 -- 172.21.15.22:0/1201803124 >> 172.21.15.22:0/1201803124 conn(0x7f508c0fc7d0 msgr2=0x7f508c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:16.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.153+0000 7f50939bd640 1 -- 172.21.15.22:0/1201803124 shutdown_connections 2024-09-10T08:08:16.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:16.153+0000 7f50939bd640 1 -- 172.21.15.22:0/1201803124 wait complete. 2024-09-10T08:08:16.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:16 smithi100 ceph-mon[35102]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:08:16.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:16 smithi153 ceph-mon[35609]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:08:16.895 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T08:08:16.895 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T08:08:16.906 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-10T08:08:16.906 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T08:08:17.166 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:17.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.701+0000 7fda51c39640 1 -- 172.21.15.22:0/1562744382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda4c104fd0 msgr2=0x7fda4c1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:17.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.701+0000 7fda51c39640 1 --2- 172.21.15.22:0/1562744382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda4c104fd0 0x7fda4c1073c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fda40009900 tx=0x7fda4002a410 comp rx=0 tx=0).stop 2024-09-10T08:08:17.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.701+0000 7fda51c39640 1 -- 172.21.15.22:0/1562744382 shutdown_connections 2024-09-10T08:08:17.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.701+0000 7fda51c39640 1 --2- 172.21.15.22:0/1562744382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda4c107900 0x7fda4c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:17.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.701+0000 7fda51c39640 1 --2- 172.21.15.22:0/1562744382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda4c104fd0 0x7fda4c1073c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:17.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.701+0000 7fda51c39640 1 --2- 172.21.15.22:0/1562744382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda4c1026a0 0x7fda4c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:17.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.701+0000 7fda51c39640 1 -- 172.21.15.22:0/1562744382 >> 172.21.15.22:0/1562744382 conn(0x7fda4c0fc2a0 msgr2=0x7fda4c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:17.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.701+0000 7fda51c39640 1 -- 172.21.15.22:0/1562744382 shutdown_connections 2024-09-10T08:08:17.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.701+0000 7fda51c39640 1 -- 172.21.15.22:0/1562744382 wait complete. 2024-09-10T08:08:17.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda51c39640 1 Processor -- start 2024-09-10T08:08:17.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda51c39640 1 -- start start 2024-09-10T08:08:17.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda51c39640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda4c1026a0 0x7fda4c197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:17.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda51c39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda4c104fd0 0x7fda4c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:17.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda51c39640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda4c107900 0x7fda4c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:17.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda51c39640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c10d8f0 con 0x7fda4c104fd0 2024-09-10T08:08:17.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda51c39640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c10d770 con 0x7fda4c107900 2024-09-10T08:08:17.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda51c39640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda4c10da70 con 0x7fda4c1026a0 2024-09-10T08:08:17.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda4affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda4c104fd0 0x7fda4c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:17.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda4affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda4c104fd0 0x7fda4c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54694/0 (socket says 172.21.15.22:54694) 2024-09-10T08:08:17.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda4affd640 1 -- 172.21.15.22:0/3114188471 learned_addr learned my addr 172.21.15.22:0/3114188471 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda4b7fe640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda4c1026a0 0x7fda4c197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda4bfff640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda4c107900 0x7fda4c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda4affd640 1 -- 172.21.15.22:0/3114188471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda4c1026a0 msgr2=0x7fda4c197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda4affd640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda4c1026a0 0x7fda4c197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda4affd640 1 -- 172.21.15.22:0/3114188471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda4c107900 msgr2=0x7fda4c19f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda4affd640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda4c107900 0x7fda4c19f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda4affd640 1 -- 172.21.15.22:0/3114188471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4c19fbd0 con 0x7fda4c104fd0 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.702+0000 7fda4b7fe640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda4c1026a0 0x7fda4c197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.703+0000 7fda4affd640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda4c104fd0 0x7fda4c1984e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fda40031610 tx=0x7fda400043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.703+0000 7fda48ff9640 1 -- 172.21.15.22:0/3114188471 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4003f030 con 0x7fda4c104fd0 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.703+0000 7fda48ff9640 1 -- 172.21.15.22:0/3114188471 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda40003ce0 con 0x7fda4c104fd0 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.703+0000 7fda51c39640 1 -- 172.21.15.22:0/3114188471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda4c19fe60 con 0x7fda4c104fd0 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.703+0000 7fda48ff9640 1 -- 172.21.15.22:0/3114188471 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40035070 con 0x7fda4c104fd0 2024-09-10T08:08:17.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.703+0000 7fda51c39640 1 -- 172.21.15.22:0/3114188471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda4c1a0330 con 0x7fda4c104fd0 2024-09-10T08:08:17.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.704+0000 7fda51c39640 1 -- 172.21.15.22:0/3114188471 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4c0fdd90 con 0x7fda4c104fd0 2024-09-10T08:08:17.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.705+0000 7fda48ff9640 1 -- 172.21.15.22:0/3114188471 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fda40042030 con 0x7fda4c104fd0 2024-09-10T08:08:17.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.706+0000 7fda48ff9640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fda340a2c40 0x7fda340a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:17.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.706+0000 7fda4b7fe640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fda340a2c40 0x7fda340a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:17.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.706+0000 7fda48ff9640 1 -- 172.21.15.22:0/3114188471 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fda400ef9c0 con 0x7fda4c104fd0 2024-09-10T08:08:17.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.707+0000 7fda4b7fe640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fda340a2c40 0x7fda340a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0058c0 tx=0x7fda3c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:17.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.710+0000 7fda48ff9640 1 -- 172.21.15.22:0/3114188471 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda400bc7c0 con 0x7fda4c104fd0 2024-09-10T08:08:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.902+0000 7fda51c39640 1 -- 172.21.15.22:0/3114188471 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fda4c062630 con 0x7fda340a2c40 2024-09-10T08:08:17.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.903+0000 7fda48ff9640 1 -- 172.21.15.22:0/3114188471 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fda4c062630 con 0x7fda340a2c40 2024-09-10T08:08:17.904 INFO:teuthology.orchestra.run.smithi022.stdout:Backend: cephadm 2024-09-10T08:08:17.904 INFO:teuthology.orchestra.run.smithi022.stdout:Available: Yes 2024-09-10T08:08:17.904 INFO:teuthology.orchestra.run.smithi022.stdout:Paused: No 2024-09-10T08:08:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.906+0000 7fda51c39640 1 -- 172.21.15.22:0/3114188471 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fda340a2c40 msgr2=0x7fda340a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.906+0000 7fda51c39640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fda340a2c40 0x7fda340a5100 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0058c0 tx=0x7fda3c005850 comp rx=0 tx=0).stop 2024-09-10T08:08:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.906+0000 7fda51c39640 1 -- 172.21.15.22:0/3114188471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda4c104fd0 msgr2=0x7fda4c1984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.906+0000 7fda51c39640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda4c104fd0 0x7fda4c1984e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fda40031610 tx=0x7fda400043b0 comp rx=0 tx=0).stop 2024-09-10T08:08:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.906+0000 7fda51c39640 1 -- 172.21.15.22:0/3114188471 shutdown_connections 2024-09-10T08:08:17.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.906+0000 7fda51c39640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fda340a2c40 0x7fda340a5100 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.906+0000 7fda51c39640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda4c107900 0x7fda4c19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.906+0000 7fda51c39640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda4c104fd0 0x7fda4c1984e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.906+0000 7fda51c39640 1 --2- 172.21.15.22:0/3114188471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda4c1026a0 0x7fda4c197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.906+0000 7fda51c39640 1 -- 172.21.15.22:0/3114188471 >> 172.21.15.22:0/3114188471 conn(0x7fda4c0fc2a0 msgr2=0x7fda4c102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.906+0000 7fda51c39640 1 -- 172.21.15.22:0/3114188471 shutdown_connections 2024-09-10T08:08:17.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:17.906+0000 7fda51c39640 1 -- 172.21.15.22:0/3114188471 wait complete. 2024-09-10T08:08:18.213 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:18 smithi022 ceph-mon[30854]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:08:18.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:18 smithi100 ceph-mon[35102]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:08:18.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:18 smithi153 ceph-mon[35609]: pgmap v321: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:08:18.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T08:08:18.809 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:19.202 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:19 smithi022 ceph-mon[30854]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:19.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.285+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3514078293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1c8107920 msgr2=0x7fb1c8109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:19.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.285+0000 7fb1cdd66640 1 --2- 172.21.15.22:0/3514078293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1c8107920 0x7fb1c8109d10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009ca0 tx=0x7fb1c002a8c0 comp rx=0 tx=0).stop 2024-09-10T08:08:19.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.285+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3514078293 shutdown_connections 2024-09-10T08:08:19.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.285+0000 7fb1cdd66640 1 --2- 172.21.15.22:0/3514078293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1c8107920 0x7fb1c8109d10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:19.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.285+0000 7fb1cdd66640 1 --2- 172.21.15.22:0/3514078293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1c8104ff0 0x7fb1c81073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:19.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.285+0000 7fb1cdd66640 1 --2- 172.21.15.22:0/3514078293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1c81026c0 0x7fb1c8104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:19.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.285+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3514078293 >> 172.21.15.22:0/3514078293 conn(0x7fb1c80fc280 msgr2=0x7fb1c80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:19.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.285+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3514078293 shutdown_connections 2024-09-10T08:08:19.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.285+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3514078293 wait complete. 2024-09-10T08:08:19.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.285+0000 7fb1cdd66640 1 Processor -- start 2024-09-10T08:08:19.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1cdd66640 1 -- start start 2024-09-10T08:08:19.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1cdd66640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1c81026c0 0x7fb1c8102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:19.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1cdd66640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1c8104ff0 0x7fb1c8100670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:19.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1cdd66640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1c8107920 0x7fb1c8100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:19.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1cdd66640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c810d880 con 0x7fb1c8104ff0 2024-09-10T08:08:19.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1cdd66640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c810d700 con 0x7fb1c8107920 2024-09-10T08:08:19.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1cdd66640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c810da00 con 0x7fb1c81026c0 2024-09-10T08:08:19.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1c6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1c8104ff0 0x7fb1c8100670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:19.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1c6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1c8104ff0 0x7fb1c8100670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54704/0 (socket says 172.21.15.22:54704) 2024-09-10T08:08:19.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1c6ffd640 1 -- 172.21.15.22:0/3246136550 learned_addr learned my addr 172.21.15.22:0/3246136550 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:19.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1c77fe640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1c81026c0 0x7fb1c8102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1c7fff640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1c8107920 0x7fb1c8100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1c6ffd640 1 -- 172.21.15.22:0/3246136550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1c81026c0 msgr2=0x7fb1c8102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1c6ffd640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1c81026c0 0x7fb1c8102020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1c6ffd640 1 -- 172.21.15.22:0/3246136550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1c8107920 msgr2=0x7fb1c8100bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1c6ffd640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1c8107920 0x7fb1c8100bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1c6ffd640 1 -- 172.21.15.22:0/3246136550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c8101470 con 0x7fb1c8104ff0 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.286+0000 7fb1c6ffd640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1c8104ff0 0x7fb1c8100670 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00c970 tx=0x7fb1bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.287+0000 7fb1c4ff9640 1 -- 172.21.15.22:0/3246136550 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc007bb0 con 0x7fb1c8104ff0 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.287+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3246136550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c81a2070 con 0x7fb1c8104ff0 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.287+0000 7fb1c4ff9640 1 -- 172.21.15.22:0/3246136550 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb1bc007d50 con 0x7fb1c8104ff0 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.287+0000 7fb1c4ff9640 1 -- 172.21.15.22:0/3246136550 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc00f450 con 0x7fb1c8104ff0 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.287+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3246136550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c81a2580 con 0x7fb1c8104ff0 2024-09-10T08:08:19.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.288+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3246136550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c80fdd70 con 0x7fb1c8104ff0 2024-09-10T08:08:19.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.289+0000 7fb1c4ff9640 1 -- 172.21.15.22:0/3246136550 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fb1bc004f90 con 0x7fb1c8104ff0 2024-09-10T08:08:19.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.290+0000 7fb1c4ff9640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb1b00a2c10 0x7fb1b00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:19.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.290+0000 7fb1c77fe640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb1b00a2c10 0x7fb1b00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:19.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.290+0000 7fb1c4ff9640 1 -- 172.21.15.22:0/3246136550 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fb1bc0ceeb0 con 0x7fb1c8104ff0 2024-09-10T08:08:19.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.290+0000 7fb1c77fe640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb1b00a2c10 0x7fb1b00a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8005fd0 tx=0x7fb1b800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:19.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.294+0000 7fb1c4ff9640 1 -- 172.21.15.22:0/3246136550 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb1bc014030 con 0x7fb1c8104ff0 2024-09-10T08:08:19.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:19 smithi100 ceph-mon[35102]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:19.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:19 smithi153 ceph-mon[35609]: from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:19.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.478+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3246136550 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb1c8062630 con 0x7fb1b00a2c10 2024-09-10T08:08:19.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.490+0000 7fb1c4ff9640 1 -- 172.21.15.22:0/3246136550 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7fb1c8062630 con 0x7fb1b00a2c10 2024-09-10T08:08:19.489 INFO:teuthology.orchestra.run.smithi022.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T08:08:19.489 INFO:teuthology.orchestra.run.smithi022.stdout:mds.a smithi022 running (98s) 20s ago 97s 17.9M - 19.1.1-305-g1cf819b7 41d671128357 420e377e7aa2 2024-09-10T08:08:19.489 INFO:teuthology.orchestra.run.smithi022.stdout:mds.b smithi100 running (95s) 28s ago 95s 25.7M - 19.1.1-305-g1cf819b7 41d671128357 36c787485dc0 2024-09-10T08:08:19.490 INFO:teuthology.orchestra.run.smithi022.stdout:mds.c smithi153 running (109s) 28s ago 109s 17.9M - 19.1.1-305-g1cf819b7 41d671128357 a0f9b70fa01a 2024-09-10T08:08:19.490 INFO:teuthology.orchestra.run.smithi022.stdout:mds.d smithi022 running (117s) 20s ago 117s 15.8M - 19.1.1-305-g1cf819b7 41d671128357 a8eafe1139db 2024-09-10T08:08:19.490 INFO:teuthology.orchestra.run.smithi022.stdout:mds.e smithi100 running (115s) 28s ago 114s 17.1M - 19.1.1-305-g1cf819b7 41d671128357 5f62ec514893 2024-09-10T08:08:19.490 INFO:teuthology.orchestra.run.smithi022.stdout:mds.f smithi153 running (112s) 28s ago 112s 16.9M - 19.1.1-305-g1cf819b7 41d671128357 21c336992fde 2024-09-10T08:08:19.490 INFO:teuthology.orchestra.run.smithi022.stdout:mds.g smithi022 running (101s) 20s ago 100s 17.1M - 19.1.1-305-g1cf819b7 41d671128357 c43e4ef5bdbb 2024-09-10T08:08:19.490 INFO:teuthology.orchestra.run.smithi022.stdout:mds.h smithi100 running (107s) 28s ago 106s 17.6M - 19.1.1-305-g1cf819b7 41d671128357 eb02af8bedc7 2024-09-10T08:08:19.490 INFO:teuthology.orchestra.run.smithi022.stdout:mds.i smithi153 running (104s) 28s ago 103s 19.2M - 19.1.1-305-g1cf819b7 41d671128357 e96d35fbf7a9 2024-09-10T08:08:19.490 INFO:teuthology.orchestra.run.smithi022.stdout:mds.j smithi022 running (2m) 20s ago 2m 15.9M - 19.1.1-305-g1cf819b7 41d671128357 561a585db1b7 2024-09-10T08:08:19.490 INFO:teuthology.orchestra.run.smithi022.stdout:mds.k smithi100 running (2m) 28s ago 2m 17.1M - 19.1.1-305-g1cf819b7 41d671128357 edd1477f2398 2024-09-10T08:08:19.490 INFO:teuthology.orchestra.run.smithi022.stdout:mds.l smithi153 running (2m) 28s ago 2m 18.5M - 19.1.1-305-g1cf819b7 41d671128357 3feb709348bc 2024-09-10T08:08:19.490 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.x smithi022 *:9283,8765 running (8m) 20s ago 8m 508M - 19.1.1-305-g1cf819b7 41d671128357 87cb76ffedbc 2024-09-10T08:08:19.490 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.y smithi100 *:8443,8765 running (7m) 28s ago 7m 442M - 19.1.1-305-g1cf819b7 41d671128357 eaba2fa9f5a5 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.z smithi153 *:8443,8765 running (7m) 28s ago 7m 441M - 19.1.1-305-g1cf819b7 41d671128357 b13d21273962 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:mon.a smithi022 running (9m) 20s ago 9m 51.2M 2048M 19.1.1-305-g1cf819b7 41d671128357 37fd5bc61b8b 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:mon.b smithi100 running (7m) 28s ago 7m 40.4M 2048M 19.1.1-305-g1cf819b7 41d671128357 38e99a0cc643 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:mon.c smithi153 running (7m) 28s ago 7m 38.5M 2048M 19.1.1-305-g1cf819b7 41d671128357 9207258945e9 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0 smithi022 running (7m) 20s ago 7m 44.7M 4273M 19.1.1-305-g1cf819b7 41d671128357 33c5b4dfb6a0 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1 smithi100 running (6m) 28s ago 6m 45.4M 4271M 19.1.1-305-g1cf819b7 41d671128357 d61e66fd19c2 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2 smithi153 running (6m) 28s ago 6m 58.6M 4272M 19.1.1-305-g1cf819b7 41d671128357 82054a018405 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3 smithi022 running (5m) 20s ago 5m 55.4M 4273M 19.1.1-305-g1cf819b7 41d671128357 43f421147512 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4 smithi100 running (5m) 28s ago 5m 44.2M 4271M 19.1.1-305-g1cf819b7 41d671128357 0c88344bfae1 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5 smithi153 running (4m) 28s ago 4m 58.1M 4272M 19.1.1-305-g1cf819b7 41d671128357 1083a96f5b49 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6 smithi022 running (4m) 20s ago 4m 42.6M 4273M 19.1.1-305-g1cf819b7 41d671128357 71b0766afd8b 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7 smithi100 running (4m) 28s ago 4m 54.7M 4271M 19.1.1-305-g1cf819b7 41d671128357 6171fe2cb953 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8 smithi153 running (3m) 28s ago 3m 41.7M 4272M 19.1.1-305-g1cf819b7 41d671128357 894fdbe0772d 2024-09-10T08:08:19.491 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9 smithi022 running (3m) 20s ago 3m 40.9M 4273M 19.1.1-305-g1cf819b7 41d671128357 4825cf707465 2024-09-10T08:08:19.492 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10 smithi100 running (2m) 28s ago 2m 43.2M 4271M 19.1.1-305-g1cf819b7 41d671128357 771865ff80e0 2024-09-10T08:08:19.492 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11 smithi153 running (2m) 28s ago 2m 53.2M 4272M 19.1.1-305-g1cf819b7 41d671128357 9f038d20a8d5 2024-09-10T08:08:19.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.493+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3246136550 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb1b00a2c10 msgr2=0x7fb1b00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:19.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.493+0000 7fb1cdd66640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb1b00a2c10 0x7fb1b00a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8005fd0 tx=0x7fb1b800b390 comp rx=0 tx=0).stop 2024-09-10T08:08:19.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.493+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3246136550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1c8104ff0 msgr2=0x7fb1c8100670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:19.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.493+0000 7fb1cdd66640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1c8104ff0 0x7fb1c8100670 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc00c970 tx=0x7fb1bc00ce30 comp rx=0 tx=0).stop 2024-09-10T08:08:19.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.493+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3246136550 shutdown_connections 2024-09-10T08:08:19.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.493+0000 7fb1cdd66640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fb1b00a2c10 0x7fb1b00a50d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:19.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.493+0000 7fb1cdd66640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1c8107920 0x7fb1c8100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:19.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.493+0000 7fb1cdd66640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb1c8104ff0 0x7fb1c8100670 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:19.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.493+0000 7fb1cdd66640 1 --2- 172.21.15.22:0/3246136550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1c81026c0 0x7fb1c8102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:19.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.493+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3246136550 >> 172.21.15.22:0/3246136550 conn(0x7fb1c80fc280 msgr2=0x7fb1c8102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:19.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.493+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3246136550 shutdown_connections 2024-09-10T08:08:19.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:19.493+0000 7fb1cdd66640 1 -- 172.21.15.22:0/3246136550 wait complete. 2024-09-10T08:08:20.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:20 smithi022 ceph-mon[30854]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T08:08:20.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:20 smithi022 ceph-mon[30854]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:20.142 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T08:08:20.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:20 smithi100 ceph-mon[35102]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T08:08:20.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:20 smithi100 ceph-mon[35102]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:20.396 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:20.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:20 smithi153 ceph-mon[35609]: pgmap v322: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T08:08:20.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:20 smithi153 ceph-mon[35609]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:20.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.869+0000 7f900a3a5640 1 -- 172.21.15.22:0/4008857199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9004107900 msgr2=0x7f9004109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:20.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.869+0000 7f900a3a5640 1 --2- 172.21.15.22:0/4008857199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9004107900 0x7f9004109d50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009ca0 tx=0x7f8ffc02a8c0 comp rx=0 tx=0).stop 2024-09-10T08:08:20.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.869+0000 7f900a3a5640 1 -- 172.21.15.22:0/4008857199 shutdown_connections 2024-09-10T08:08:20.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.869+0000 7f900a3a5640 1 --2- 172.21.15.22:0/4008857199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9004107900 0x7f9004109d50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:20.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.869+0000 7f900a3a5640 1 --2- 172.21.15.22:0/4008857199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9004104fd0 0x7f90041073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:20.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.869+0000 7f900a3a5640 1 --2- 172.21.15.22:0/4008857199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90041026a0 0x7f9004104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.869+0000 7f900a3a5640 1 -- 172.21.15.22:0/4008857199 >> 172.21.15.22:0/4008857199 conn(0x7f90040fc2a0 msgr2=0x7f90040fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.869+0000 7f900a3a5640 1 -- 172.21.15.22:0/4008857199 shutdown_connections 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.869+0000 7f900a3a5640 1 -- 172.21.15.22:0/4008857199 wait complete. 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.870+0000 7f900a3a5640 1 Processor -- start 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.870+0000 7f900a3a5640 1 -- start start 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.870+0000 7f900a3a5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90041026a0 0x7f9004198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.870+0000 7f900a3a5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9004104fd0 0x7f9004198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.870+0000 7f900a3a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9004107900 0x7f900419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.870+0000 7f900a3a5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f900410d9e0 con 0x7f9004107900 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.870+0000 7f900a3a5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f900410d860 con 0x7f90041026a0 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.870+0000 7f900a3a5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f900410db60 con 0x7f9004104fd0 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f9008942640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9004107900 0x7f900419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:20.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f9008942640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9004107900 0x7f900419f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54724/0 (socket says 172.21.15.22:54724) 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f9008942640 1 -- 172.21.15.22:0/776843736 learned_addr learned my addr 172.21.15.22:0/776843736 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f9003fff640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90041026a0 0x7f9004198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f90037fe640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9004104fd0 0x7f9004198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f9008942640 1 -- 172.21.15.22:0/776843736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9004104fd0 msgr2=0x7f9004198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f9008942640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9004104fd0 0x7f9004198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f9008942640 1 -- 172.21.15.22:0/776843736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90041026a0 msgr2=0x7f9004198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f9008942640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90041026a0 0x7f9004198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f9008942640 1 -- 172.21.15.22:0/776843736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900419fc70 con 0x7f9004107900 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f90037fe640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9004104fd0 0x7f9004198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f9003fff640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90041026a0 0x7f9004198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f9008942640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9004107900 0x7f900419f600 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc003ba0 tx=0x7f8ffc003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f90017fa640 1 -- 172.21.15.22:0/776843736 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc004040 con 0x7f9004107900 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f90017fa640 1 -- 172.21.15.22:0/776843736 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ffc0046c0 con 0x7f9004107900 2024-09-10T08:08:20.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f900a3a5640 1 -- 172.21.15.22:0/776843736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f900419ff00 con 0x7f9004107900 2024-09-10T08:08:20.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f90017fa640 1 -- 172.21.15.22:0/776843736 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc02fea0 con 0x7f9004107900 2024-09-10T08:08:20.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.871+0000 7f900a3a5640 1 -- 172.21.15.22:0/776843736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90041a0430 con 0x7f9004107900 2024-09-10T08:08:20.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.872+0000 7f900a3a5640 1 -- 172.21.15.22:0/776843736 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90040fdd90 con 0x7f9004107900 2024-09-10T08:08:20.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.873+0000 7f90017fa640 1 -- 172.21.15.22:0/776843736 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f8ffc02f610 con 0x7f9004107900 2024-09-10T08:08:20.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.874+0000 7f90017fa640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8fec0a2c40 0x7f8fec0a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:20.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.874+0000 7f9003fff640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8fec0a2c40 0x7f8fec0a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:20.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.874+0000 7f90017fa640 1 -- 172.21.15.22:0/776843736 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f8ffc0f0900 con 0x7f9004107900 2024-09-10T08:08:20.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.875+0000 7f9003fff640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8fec0a2c40 0x7f8fec0a5100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009930 tx=0x7f8ff4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:20.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:20.879+0000 7f90017fa640 1 -- 172.21.15.22:0/776843736 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8ffc0bd7d0 con 0x7f9004107900 2024-09-10T08:08:21.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.063+0000 7f900a3a5640 1 -- 172.21.15.22:0/776843736 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f9004062630 con 0x7f8fec0a2c40 2024-09-10T08:08:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.070+0000 7f90017fa640 1 -- 172.21.15.22:0/776843736 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f9004062630 con 0x7f8fec0a2c40 2024-09-10T08:08:21.070 INFO:teuthology.orchestra.run.smithi022.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T08:08:21.070 INFO:teuthology.orchestra.run.smithi022.stdout:mds.all 12/12 30s ago 2m smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-09-10T08:08:21.070 INFO:teuthology.orchestra.run.smithi022.stdout:mgr 3/3 30s ago 7m smithi022=x;smithi100=y;smithi153=z;count:3 2024-09-10T08:08:21.070 INFO:teuthology.orchestra.run.smithi022.stdout:mon 3/3 30s ago 7m smithi022:172.21.15.22=a;smithi100:172.21.15.100=b;smithi153:172.21.15.153=c;count:3 2024-09-10T08:08:21.070 INFO:teuthology.orchestra.run.smithi022.stdout:osd 12 30s ago - 2024-09-10T08:08:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.072+0000 7f900a3a5640 1 -- 172.21.15.22:0/776843736 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8fec0a2c40 msgr2=0x7f8fec0a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.072+0000 7f900a3a5640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8fec0a2c40 0x7f8fec0a5100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009930 tx=0x7f8ff4008040 comp rx=0 tx=0).stop 2024-09-10T08:08:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.072+0000 7f900a3a5640 1 -- 172.21.15.22:0/776843736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9004107900 msgr2=0x7f900419f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.072+0000 7f900a3a5640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9004107900 0x7f900419f600 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc003ba0 tx=0x7f8ffc003bd0 comp rx=0 tx=0).stop 2024-09-10T08:08:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.073+0000 7f900a3a5640 1 -- 172.21.15.22:0/776843736 shutdown_connections 2024-09-10T08:08:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.073+0000 7f900a3a5640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f8fec0a2c40 0x7f8fec0a5100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:21.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.073+0000 7f900a3a5640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9004107900 0x7f900419f600 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:21.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.073+0000 7f900a3a5640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9004104fd0 0x7f9004198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:21.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.073+0000 7f900a3a5640 1 --2- 172.21.15.22:0/776843736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90041026a0 0x7f9004198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:21.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.073+0000 7f900a3a5640 1 -- 172.21.15.22:0/776843736 >> 172.21.15.22:0/776843736 conn(0x7f90040fc2a0 msgr2=0x7f9004103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:21.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.073+0000 7f900a3a5640 1 -- 172.21.15.22:0/776843736 shutdown_connections 2024-09-10T08:08:21.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:21.073+0000 7f900a3a5640 1 -- 172.21.15.22:0/776843736 wait complete. 2024-09-10T08:08:21.704 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T08:08:21.962 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:22.329 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:22 smithi022 ceph-mon[30854]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:08:22.329 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:22 smithi022 ceph-mon[30854]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:22.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:22 smithi100 ceph-mon[35102]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:08:22.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:22 smithi100 ceph-mon[35102]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.413+0000 7f724ba31640 1 -- 172.21.15.22:0/3400648505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7244101c00 msgr2=0x7f7244102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.413+0000 7f724ba31640 1 --2- 172.21.15.22:0/3400648505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7244101c00 0x7f7244102000 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7240009900 tx=0x7f724002a410 comp rx=0 tx=0).stop 2024-09-10T08:08:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.413+0000 7f724ba31640 1 -- 172.21.15.22:0/3400648505 shutdown_connections 2024-09-10T08:08:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.413+0000 7f724ba31640 1 --2- 172.21.15.22:0/3400648505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72441037c0 0x7f724410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.413+0000 7f724ba31640 1 --2- 172.21.15.22:0/3400648505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7244102e00 0x7f7244103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.413+0000 7f724ba31640 1 --2- 172.21.15.22:0/3400648505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7244101c00 0x7f7244102000 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.413+0000 7f724ba31640 1 -- 172.21.15.22:0/3400648505 >> 172.21.15.22:0/3400648505 conn(0x7f72440fd390 msgr2=0x7f72440ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.413+0000 7f724ba31640 1 -- 172.21.15.22:0/3400648505 shutdown_connections 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.413+0000 7f724ba31640 1 -- 172.21.15.22:0/3400648505 wait complete. 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f724ba31640 1 Processor -- start 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f724ba31640 1 -- start start 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f724ba31640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7244101c00 0x7f7244075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f724ba31640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7244102e00 0x7f72440745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f724ba31640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72441037c0 0x7f7244074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f724ba31640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f724410d880 con 0x7f7244101c00 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f724ba31640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f724410d700 con 0x7f72441037c0 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f724ba31640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f724410da00 con 0x7f7244102e00 2024-09-10T08:08:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f72497cd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7244101c00 0x7f7244075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f72497cd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7244101c00 0x7f7244075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54742/0 (socket says 172.21.15.22:54742) 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f72497cd640 1 -- 172.21.15.22:0/435719952 learned_addr learned my addr 172.21.15.22:0/435719952 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f7248fcc640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7244102e00 0x7f72440745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f72497cd640 1 -- 172.21.15.22:0/435719952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7244102e00 msgr2=0x7f72440745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f72497cd640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7244102e00 0x7f72440745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f72497cd640 1 -- 172.21.15.22:0/435719952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72441037c0 msgr2=0x7f7244074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f72497cd640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72441037c0 0x7f7244074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f72497cd640 1 -- 172.21.15.22:0/435719952 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72440753e0 con 0x7f7244101c00 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.414+0000 7f72497cd640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7244101c00 0x7f7244075f90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7240031610 tx=0x7f72400043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.415+0000 7f723a7fc640 1 -- 172.21.15.22:0/435719952 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724003f030 con 0x7f7244101c00 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.415+0000 7f723a7fc640 1 -- 172.21.15.22:0/435719952 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7240003ce0 con 0x7f7244101c00 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.415+0000 7f723a7fc640 1 -- 172.21.15.22:0/435719952 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240035070 con 0x7f7244101c00 2024-09-10T08:08:22.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.415+0000 7f724ba31640 1 -- 172.21.15.22:0/435719952 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72441a20c0 con 0x7f7244101c00 2024-09-10T08:08:22.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.415+0000 7f724ba31640 1 -- 172.21.15.22:0/435719952 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72441a2570 con 0x7f7244101c00 2024-09-10T08:08:22.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.416+0000 7f724ba31640 1 -- 172.21.15.22:0/435719952 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7244109000 con 0x7f7244101c00 2024-09-10T08:08:22.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.417+0000 7f723a7fc640 1 -- 172.21.15.22:0/435719952 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f7240042030 con 0x7f7244101c00 2024-09-10T08:08:22.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.418+0000 7f723a7fc640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f72300a2c10 0x7f72300a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:22.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.418+0000 7f723a7fc640 1 -- 172.21.15.22:0/435719952 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f72400efa10 con 0x7f7244101c00 2024-09-10T08:08:22.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.418+0000 7f7248fcc640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f72300a2c10 0x7f72300a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:22.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.418+0000 7f7248fcc640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f72300a2c10 0x7f72300a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7234005fd0 tx=0x7f7234005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:22.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.421+0000 7f723a7fc640 1 -- 172.21.15.22:0/435719952 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f72400bc810 con 0x7f7244101c00 2024-09-10T08:08:22.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:22 smithi153 ceph-mon[35609]: pgmap v323: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:08:22.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:22 smithi153 ceph-mon[35609]: from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:22.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.605+0000 7f724ba31640 1 -- 172.21.15.22:0/435719952 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f7244062630 con 0x7f72300a2c10 2024-09-10T08:08:22.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.606+0000 7f723a7fc640 1 -- 172.21.15.22:0/435719952 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f7244062630 con 0x7f72300a2c10 2024-09-10T08:08:22.606 INFO:teuthology.orchestra.run.smithi022.stdout:HOST ADDR LABELS STATUS 2024-09-10T08:08:22.606 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022 172.21.15.22 2024-09-10T08:08:22.606 INFO:teuthology.orchestra.run.smithi022.stdout:smithi100 172.21.15.100 2024-09-10T08:08:22.606 INFO:teuthology.orchestra.run.smithi022.stdout:smithi153 172.21.15.153 2024-09-10T08:08:22.606 INFO:teuthology.orchestra.run.smithi022.stdout:3 hosts in cluster 2024-09-10T08:08:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.609+0000 7f724ba31640 1 -- 172.21.15.22:0/435719952 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f72300a2c10 msgr2=0x7f72300a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.609+0000 7f724ba31640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f72300a2c10 0x7f72300a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7234005fd0 tx=0x7f7234005850 comp rx=0 tx=0).stop 2024-09-10T08:08:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.609+0000 7f724ba31640 1 -- 172.21.15.22:0/435719952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7244101c00 msgr2=0x7f7244075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.609+0000 7f724ba31640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7244101c00 0x7f7244075f90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7240031610 tx=0x7f72400043b0 comp rx=0 tx=0).stop 2024-09-10T08:08:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.609+0000 7f724ba31640 1 -- 172.21.15.22:0/435719952 shutdown_connections 2024-09-10T08:08:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.609+0000 7f724ba31640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f72300a2c10 0x7f72300a50d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.609+0000 7f724ba31640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72441037c0 0x7f7244074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.609+0000 7f724ba31640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7244102e00 0x7f72440745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.609+0000 7f724ba31640 1 --2- 172.21.15.22:0/435719952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7244101c00 0x7f7244075f90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.609+0000 7f724ba31640 1 -- 172.21.15.22:0/435719952 >> 172.21.15.22:0/435719952 conn(0x7f72440fd390 msgr2=0x7f72441061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.609+0000 7f724ba31640 1 -- 172.21.15.22:0/435719952 shutdown_connections 2024-09-10T08:08:22.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:22.609+0000 7f724ba31640 1 -- 172.21.15.22:0/435719952 wait complete. 2024-09-10T08:08:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:23 smithi022 ceph-mon[30854]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:23.306 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T08:08:23.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:23 smithi100 ceph-mon[35102]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:23.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:23 smithi153 ceph-mon[35609]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:23.561 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.031+0000 7f5220d0f640 1 -- 172.21.15.22:0/3026832037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f521c101d10 msgr2=0x7f521c102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.031+0000 7f5220d0f640 1 --2- 172.21.15.22:0/3026832037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f521c101d10 0x7f521c102190 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5204009900 tx=0x7f520402a410 comp rx=0 tx=0).stop 2024-09-10T08:08:24.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.031+0000 7f5220d0f640 1 -- 172.21.15.22:0/3026832037 shutdown_connections 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.031+0000 7f5220d0f640 1 --2- 172.21.15.22:0/3026832037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f521c1026d0 0x7f521c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.031+0000 7f5220d0f640 1 --2- 172.21.15.22:0/3026832037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f521c101d10 0x7f521c102190 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.031+0000 7f5220d0f640 1 --2- 172.21.15.22:0/3026832037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100b10 0x7f521c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.031+0000 7f5220d0f640 1 -- 172.21.15.22:0/3026832037 >> 172.21.15.22:0/3026832037 conn(0x7f521c0fc2a0 msgr2=0x7f521c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.031+0000 7f5220d0f640 1 -- 172.21.15.22:0/3026832037 shutdown_connections 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.031+0000 7f5220d0f640 1 -- 172.21.15.22:0/3026832037 wait complete. 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f5220d0f640 1 Processor -- start 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f5220d0f640 1 -- start start 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f5220d0f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100b10 0x7f521c10b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f5220d0f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f521c101d10 0x7f521c109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f5220d0f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f521c1026d0 0x7f521c10a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f5220d0f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f521c10d9a0 con 0x7f521c101d10 2024-09-10T08:08:24.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f5220d0f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f521c10d820 con 0x7f521c100b10 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f5220d0f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f521c10db20 con 0x7f521c1026d0 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f5211d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f521c101d10 0x7f521c109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f5211d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f521c101d10 0x7f521c109ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33260/0 (socket says 172.21.15.22:33260) 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f5211d9b640 1 -- 172.21.15.22:0/1127885151 learned_addr learned my addr 172.21.15.22:0/1127885151 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f521a59c640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100b10 0x7f521c10b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f521ad9d640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f521c1026d0 0x7f521c10a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.032+0000 7f5211d9b640 1 -- 172.21.15.22:0/1127885151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f521c1026d0 msgr2=0x7f521c10a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.033+0000 7f5211d9b640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f521c1026d0 0x7f521c10a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.033+0000 7f5211d9b640 1 -- 172.21.15.22:0/1127885151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100b10 msgr2=0x7f521c10b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.033+0000 7f5211d9b640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100b10 0x7f521c10b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.033+0000 7f5211d9b640 1 -- 172.21.15.22:0/1127885151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f521c10a8e0 con 0x7f521c101d10 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.033+0000 7f521ad9d640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f521c1026d0 0x7f521c10a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:24.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.033+0000 7f521a59c640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100b10 0x7f521c10b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.033+0000 7f5211d9b640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f521c101d10 0x7f521c109ae0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5204009230 tx=0x7f5204004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.033+0000 7f5213fff640 1 -- 172.21.15.22:0/1127885151 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f520403f030 con 0x7f521c101d10 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.033+0000 7f5220d0f640 1 -- 172.21.15.22:0/1127885151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f521c1a21e0 con 0x7f521c101d10 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.033+0000 7f5213fff640 1 -- 172.21.15.22:0/1127885151 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5204003ce0 con 0x7f521c101d10 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.033+0000 7f5213fff640 1 -- 172.21.15.22:0/1127885151 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5204035070 con 0x7f521c101d10 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.033+0000 7f5220d0f640 1 -- 172.21.15.22:0/1127885151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f521c1a2760 con 0x7f521c101d10 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.034+0000 7f5220d0f640 1 -- 172.21.15.22:0/1127885151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f521c107fb0 con 0x7f521c101d10 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.035+0000 7f5213fff640 1 -- 172.21.15.22:0/1127885151 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f5204042030 con 0x7f521c101d10 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.036+0000 7f5213fff640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f52080a2c10 0x7f52080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.036+0000 7f521a59c640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f52080a2c10 0x7f52080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.036+0000 7f5213fff640 1 -- 172.21.15.22:0/1127885151 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f52040ef9d0 con 0x7f521c101d10 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.036+0000 7f521a59c640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f52080a2c10 0x7f52080a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f520c006fd0 tx=0x7f520c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:24.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.040+0000 7f5213fff640 1 -- 172.21.15.22:0/1127885151 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52040bc7d0 con 0x7f521c101d10 2024-09-10T08:08:24.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.236+0000 7f5220d0f640 1 -- 172.21.15.22:0/1127885151 --> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f521c062630 con 0x7f52080a2c10 2024-09-10T08:08:24.236 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:24 smithi022 ceph-mon[30854]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:08:24.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.238+0000 7f5213fff640 1 -- 172.21.15.22:0/1127885151 <== mgr.14150 v2:172.21.15.22:6800/1767260330 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f521c062630 con 0x7f52080a2c10 2024-09-10T08:08:24.237 INFO:teuthology.orchestra.run.smithi022.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T08:08:24.237 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747402EC480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-10T08:08:24.237 INFO:teuthology.orchestra.run.smithi022.stdout:smithi100 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WR400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T08:08:24.237 INFO:teuthology.orchestra.run.smithi022.stdout:smithi153 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300MV400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T08:08:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.240+0000 7f5220d0f640 1 -- 172.21.15.22:0/1127885151 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f52080a2c10 msgr2=0x7f52080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.240+0000 7f5220d0f640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f52080a2c10 0x7f52080a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f520c006fd0 tx=0x7f520c008040 comp rx=0 tx=0).stop 2024-09-10T08:08:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.240+0000 7f5220d0f640 1 -- 172.21.15.22:0/1127885151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f521c101d10 msgr2=0x7f521c109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.240+0000 7f5220d0f640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f521c101d10 0x7f521c109ae0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5204009230 tx=0x7f5204004430 comp rx=0 tx=0).stop 2024-09-10T08:08:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.240+0000 7f5220d0f640 1 -- 172.21.15.22:0/1127885151 shutdown_connections 2024-09-10T08:08:24.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.240+0000 7f5220d0f640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f52080a2c10 0x7f52080a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.240+0000 7f5220d0f640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f521c1026d0 0x7f521c10a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.240+0000 7f5220d0f640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f521c101d10 0x7f521c109ae0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.240+0000 7f5220d0f640 1 --2- 172.21.15.22:0/1127885151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f521c100b10 0x7f521c10b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.240+0000 7f5220d0f640 1 -- 172.21.15.22:0/1127885151 >> 172.21.15.22:0/1127885151 conn(0x7f521c0fc2a0 msgr2=0x7f521c105180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.240+0000 7f5220d0f640 1 -- 172.21.15.22:0/1127885151 shutdown_connections 2024-09-10T08:08:24.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:24.240+0000 7f5220d0f640 1 -- 172.21.15.22:0/1127885151 wait complete. 2024-09-10T08:08:24.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:24 smithi100 ceph-mon[35102]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:08:24.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:24 smithi153 ceph-mon[35609]: pgmap v324: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:08:24.902 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T08:08:24.911 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-10T08:08:24.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T08:08:25.172 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:25.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:25 smithi022 ceph-mon[30854]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:25.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:25 smithi100 ceph-mon[35102]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:25.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:25 smithi153 ceph-mon[35609]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:25.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.648+0000 7fa7dad1d640 1 -- 172.21.15.22:0/3183162037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d4101c00 msgr2=0x7fa7d4102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:25.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.648+0000 7fa7dad1d640 1 --2- 172.21.15.22:0/3183162037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d4101c00 0x7fa7d4102000 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009900 tx=0x7fa7c802a410 comp rx=0 tx=0).stop 2024-09-10T08:08:25.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.648+0000 7fa7dad1d640 1 -- 172.21.15.22:0/3183162037 shutdown_connections 2024-09-10T08:08:25.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.648+0000 7fa7dad1d640 1 --2- 172.21.15.22:0/3183162037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d41037c0 0x7fa7d410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:25.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.648+0000 7fa7dad1d640 1 --2- 172.21.15.22:0/3183162037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4102e00 0x7fa7d4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:25.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.648+0000 7fa7dad1d640 1 --2- 172.21.15.22:0/3183162037 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d4101c00 0x7fa7d4102000 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:25.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.648+0000 7fa7dad1d640 1 -- 172.21.15.22:0/3183162037 >> 172.21.15.22:0/3183162037 conn(0x7fa7d40fd390 msgr2=0x7fa7d40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.649+0000 7fa7dad1d640 1 -- 172.21.15.22:0/3183162037 shutdown_connections 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.649+0000 7fa7dad1d640 1 -- 172.21.15.22:0/3183162037 wait complete. 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7dad1d640 1 Processor -- start 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7dad1d640 1 -- start start 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7dad1d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4101c00 0x7fa7d4197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7dad1d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d4102e00 0x7fa7d4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7dad1d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d41037c0 0x7fa7d419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7dad1d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d410d930 con 0x7fa7d4102e00 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7dad1d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d410d7b0 con 0x7fa7d4101c00 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7dad1d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d410dab0 con 0x7fa7d41037c0 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d4102e00 0x7fa7d4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d4102e00 0x7fa7d4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33274/0 (socket says 172.21.15.22:33274) 2024-09-10T08:08:25.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7d3fff640 1 -- 172.21.15.22:0/2265965992 learned_addr learned my addr 172.21.15.22:0/2265965992 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7d8ab9640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4101c00 0x7fa7d4197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7d92ba640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d41037c0 0x7fa7d419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7d3fff640 1 -- 172.21.15.22:0/2265965992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d41037c0 msgr2=0x7fa7d419f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7d3fff640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d41037c0 0x7fa7d419f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7d3fff640 1 -- 172.21.15.22:0/2265965992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4101c00 msgr2=0x7fa7d4197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7d3fff640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4101c00 0x7fa7d4197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7d3fff640 1 -- 172.21.15.22:0/2265965992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d419fb80 con 0x7fa7d4102e00 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7d92ba640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d41037c0 0x7fa7d419f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.650+0000 7fa7d3fff640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d4102e00 0x7fa7d4198490 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000c890 tx=0x7fa7c000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.651+0000 7fa7d1ffb640 1 -- 172.21.15.22:0/2265965992 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0004220 con 0x7fa7d4102e00 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.651+0000 7fa7dad1d640 1 -- 172.21.15.22:0/2265965992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d419fe70 con 0x7fa7d4102e00 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.651+0000 7fa7d1ffb640 1 -- 172.21.15.22:0/2265965992 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa7c00043c0 con 0x7fa7d4102e00 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.651+0000 7fa7d1ffb640 1 -- 172.21.15.22:0/2265965992 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0004a00 con 0x7fa7d4102e00 2024-09-10T08:08:25.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.651+0000 7fa7dad1d640 1 -- 172.21.15.22:0/2265965992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d41a03a0 con 0x7fa7d4102e00 2024-09-10T08:08:25.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.652+0000 7fa7dad1d640 1 -- 172.21.15.22:0/2265965992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d4108fd0 con 0x7fa7d4102e00 2024-09-10T08:08:25.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.653+0000 7fa7d1ffb640 1 -- 172.21.15.22:0/2265965992 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fa7c00079b0 con 0x7fa7d4102e00 2024-09-10T08:08:25.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.653+0000 7fa7d1ffb640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7c40a2c40 0x7fa7c40a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:25.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.654+0000 7fa7d8ab9640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7c40a2c40 0x7fa7c40a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:25.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.654+0000 7fa7d1ffb640 1 -- 172.21.15.22:0/2265965992 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fa7c00cf230 con 0x7fa7d4102e00 2024-09-10T08:08:25.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.654+0000 7fa7d8ab9640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7c40a2c40 0x7fa7c40a5100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa7c802aa00 tx=0x7fa7c80315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:25.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.658+0000 7fa7d1ffb640 1 -- 172.21.15.22:0/2265965992 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa7c0014030 con 0x7fa7d4102e00 2024-09-10T08:08:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.871+0000 7fa7dad1d640 1 -- 172.21.15.22:0/2265965992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa7d402d970 con 0x7fa7d4102e00 2024-09-10T08:08:25.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.871+0000 7fa7d1ffb640 1 -- 172.21.15.22:0/2265965992 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3121 (secure 0 0 0) 0x7fa7c009bff0 con 0x7fa7d4102e00 2024-09-10T08:08:25.871 INFO:teuthology.orchestra.run.smithi022.stdout:e28 2024-09-10T08:08:25.871 INFO:teuthology.orchestra.run.smithi022.stdout:btime 2024-09-10T08:07:06:469020+0000 2024-09-10T08:08:25.871 INFO:teuthology.orchestra.run.smithi022.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T08:08:25.871 INFO:teuthology.orchestra.run.smithi022.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T08:08:25.871 INFO:teuthology.orchestra.run.smithi022.stdout:legacy client fscid: 1 2024-09-10T08:08:25.871 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:25.871 INFO:teuthology.orchestra.run.smithi022.stdout:Filesystem 'cephfs' (1) 2024-09-10T08:08:25.871 INFO:teuthology.orchestra.run.smithi022.stdout:fs_name cephfs 2024-09-10T08:08:25.871 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 28 2024-09-10T08:08:25.871 INFO:teuthology.orchestra.run.smithi022.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T08:08:25.871 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-09-10T08:06:54.609910+0000 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:modified 2024-09-10T08:07:06.044085+0000 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:tableserver 0 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:root 0 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:session_timeout 300 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:session_autoclose 300 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:max_file_size 1099511627776 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:max_xattr_size 65536 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:required_client_features {} 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:last_failure 0 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:last_failure_osd_epoch 0 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:max_mds 5 2024-09-10T08:08:25.872 INFO:teuthology.orchestra.run.smithi022.stdout:in 0,1,2,3,4 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:up {0=24512,1=24479,2=24469,3=24455,4=14622} 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:failed 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:damaged 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:stopped 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:data_pools [3] 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:metadata_pool 2 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:inline_data disabled 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:balancer 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:bal_rank_mask -1 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:standby_count_wanted 0 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:qdb_cluster leader: 24512 members: 14622,24455,24469,24479,24512 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b{0:24512} state up:active seq 4 addr [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c{0:24448} state up:standby-replay seq 1 addr [v2:172.21.15.153:6836/2417436521,v1:172.21.15.153:6837/2417436521] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T08:08:25.873 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.h{1:24479} state up:active seq 9 addr [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.f{1:24442} state up:standby-replay seq 1 addr [v2:172.21.15.153:6834/3505190925,v1:172.21.15.153:6835/3505190925] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.i{2:24469} state up:active seq 8 addr [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.k{2:24431} state up:standby-replay seq 1 addr [v2:172.21.15.100:6832/1178134620,v1:172.21.15.100:6833/1178134620] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.e{3:24455} state up:active seq 11 addr [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.l{3:24409} state up:standby-replay seq 1 addr [v2:172.21.15.153:6832/3705787109,v1:172.21.15.153:6833/3705787109] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a{4:14622} state up:active seq 7 addr [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.g{4:14616} state up:standby-replay seq 1 addr [v2:172.21.15.22:6838/896927555,v1:172.21.15.22:6839/896927555] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout:Standby daemons: 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.j{-1:14547} state up:standby seq 1 addr [v2:172.21.15.22:6834/343815013,v1:172.21.15.22:6835/343815013] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T08:08:25.874 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d{-1:14559} state up:standby seq 1 addr [v2:172.21.15.22:6836/959719178,v1:172.21.15.22:6837/959719178] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T08:08:25.875 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-10T08:08:25.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.873+0000 7fa7dad1d640 1 -- 172.21.15.22:0/2265965992 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7c40a2c40 msgr2=0x7fa7c40a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:25.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.873+0000 7fa7dad1d640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7c40a2c40 0x7fa7c40a5100 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa7c802aa00 tx=0x7fa7c80315b0 comp rx=0 tx=0).stop 2024-09-10T08:08:25.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.873+0000 7fa7dad1d640 1 -- 172.21.15.22:0/2265965992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d4102e00 msgr2=0x7fa7d4198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:25.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.873+0000 7fa7dad1d640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d4102e00 0x7fa7d4198490 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000c890 tx=0x7fa7c000cd50 comp rx=0 tx=0).stop 2024-09-10T08:08:25.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.873+0000 7fa7dad1d640 1 -- 172.21.15.22:0/2265965992 shutdown_connections 2024-09-10T08:08:25.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.873+0000 7fa7dad1d640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fa7c40a2c40 0x7fa7c40a5100 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:25.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.873+0000 7fa7dad1d640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7d41037c0 0x7fa7d419f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:25.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.873+0000 7fa7dad1d640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7d4102e00 0x7fa7d4198490 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:25.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.873+0000 7fa7dad1d640 1 --2- 172.21.15.22:0/2265965992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7d4101c00 0x7fa7d4197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:25.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.873+0000 7fa7dad1d640 1 -- 172.21.15.22:0/2265965992 >> 172.21.15.22:0/2265965992 conn(0x7fa7d40fd390 msgr2=0x7fa7d41061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:25.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.874+0000 7fa7dad1d640 1 -- 172.21.15.22:0/2265965992 shutdown_connections 2024-09-10T08:08:25.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:25.874+0000 7fa7dad1d640 1 -- 172.21.15.22:0/2265965992 wait complete. 2024-09-10T08:08:26.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:26 smithi022 ceph-mon[30854]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:08:26.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:26 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2265965992' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T08:08:26.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:26 smithi100 ceph-mon[35102]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:08:26.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:26 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2265965992' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T08:08:26.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:26 smithi153 ceph-mon[35609]: pgmap v325: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-09-10T08:08:26.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:26 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2265965992' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-10T08:08:26.612 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T08:08:26.871 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:27.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.357+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/2190681396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac1037c0 msgr2=0x7fe9ac10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:27.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.357+0000 7fe9b0b5e640 1 --2- 172.21.15.22:0/2190681396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac1037c0 0x7fe9ac10a050 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009ca0 tx=0x7fe9a402a8c0 comp rx=0 tx=0).stop 2024-09-10T08:08:27.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.357+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/2190681396 shutdown_connections 2024-09-10T08:08:27.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.357+0000 7fe9b0b5e640 1 --2- 172.21.15.22:0/2190681396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac1037c0 0x7fe9ac10a050 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:27.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.357+0000 7fe9b0b5e640 1 --2- 172.21.15.22:0/2190681396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9ac102e00 0x7fe9ac103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:27.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.357+0000 7fe9b0b5e640 1 --2- 172.21.15.22:0/2190681396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9ac101c00 0x7fe9ac102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:27.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.357+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/2190681396 >> 172.21.15.22:0/2190681396 conn(0x7fe9ac0fd390 msgr2=0x7fe9ac0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:27.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.357+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/2190681396 shutdown_connections 2024-09-10T08:08:27.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.357+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/2190681396 wait complete. 2024-09-10T08:08:27.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.358+0000 7fe9b0b5e640 1 Processor -- start 2024-09-10T08:08:27.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.358+0000 7fe9b0b5e640 1 -- start start 2024-09-10T08:08:27.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.358+0000 7fe9b0b5e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac101c00 0x7fe9ac197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:27.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.358+0000 7fe9b0b5e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9ac102e00 0x7fe9ac198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:27.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.358+0000 7fe9b0b5e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9ac1037c0 0x7fe9ac19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:27.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.358+0000 7fe9b0b5e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac10d860 con 0x7fe9ac101c00 2024-09-10T08:08:27.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.358+0000 7fe9b0b5e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac10d6e0 con 0x7fe9ac102e00 2024-09-10T08:08:27.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.358+0000 7fe9b0b5e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ac10d9e0 con 0x7fe9ac1037c0 2024-09-10T08:08:27.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9aa59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac101c00 0x7fe9ac197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:27.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9aa59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac101c00 0x7fe9ac197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33290/0 (socket says 172.21.15.22:33290) 2024-09-10T08:08:27.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9aa59c640 1 -- 172.21.15.22:0/1588250205 learned_addr learned my addr 172.21.15.22:0/1588250205 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:27.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9aad9d640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9ac1037c0 0x7fe9ac19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:27.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9a9d9b640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9ac102e00 0x7fe9ac198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:27.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9aa59c640 1 -- 172.21.15.22:0/1588250205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9ac1037c0 msgr2=0x7fe9ac19f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:27.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9aa59c640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9ac1037c0 0x7fe9ac19f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:27.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9aa59c640 1 -- 172.21.15.22:0/1588250205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9ac102e00 msgr2=0x7fe9ac198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:27.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9aa59c640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9ac102e00 0x7fe9ac198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9aa59c640 1 -- 172.21.15.22:0/1588250205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ac19fa00 con 0x7fe9ac101c00 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9a9d9b640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9ac102e00 0x7fe9ac198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9aa59c640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac101c00 0x7fe9ac197dd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00c970 tx=0x7fe99c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe99b7fe640 1 -- 172.21.15.22:0/1588250205 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c007c10 con 0x7fe9ac101c00 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe99b7fe640 1 -- 172.21.15.22:0/1588250205 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe99c007db0 con 0x7fe9ac101c00 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe99b7fe640 1 -- 172.21.15.22:0/1588250205 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c00f940 con 0x7fe9ac101c00 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/1588250205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ac19fcf0 con 0x7fe9ac101c00 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.359+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/1588250205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ac1a0180 con 0x7fe9ac101c00 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.360+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/1588250205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ac108f30 con 0x7fe9ac101c00 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.361+0000 7fe99b7fe640 1 -- 172.21.15.22:0/1588250205 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7fe99c00fae0 con 0x7fe9ac101c00 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.362+0000 7fe99b7fe640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe9940a2c40 0x7fe9940a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.362+0000 7fe9a9d9b640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe9940a2c40 0x7fe9940a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:27.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.362+0000 7fe99b7fe640 1 -- 172.21.15.22:0/1588250205 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe99c0cf5b0 con 0x7fe9ac101c00 2024-09-10T08:08:27.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.363+0000 7fe9a9d9b640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe9940a2c40 0x7fe9940a5100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00058c0 tx=0x7fe9a0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:27.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.366+0000 7fe99b7fe640 1 -- 172.21.15.22:0/1588250205 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe99c09c400 con 0x7fe9ac101c00 2024-09-10T08:08:27.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.545+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/1588250205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fe9ac062630 con 0x7fe9ac101c00 2024-09-10T08:08:27.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.546+0000 7fe99b7fe640 1 -- 172.21.15.22:0/1588250205 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v83) ==== 56+0+5313 (secure 0 0 0) 0x7fe99c09bd00 con 0x7fe9ac101c00 2024-09-10T08:08:27.545 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 83 2024-09-10T08:08:27.545 INFO:teuthology.orchestra.run.smithi022.stdout:fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:08:27.545 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-09-10T07:59:04.704048+0000 2024-09-10T08:08:27.545 INFO:teuthology.orchestra.run.smithi022.stdout:modified 2024-09-10T08:07:02.403174+0000 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:crush_version 26 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:full_ratio 0.95 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:backfillfull_ratio 0.9 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:nearfull_ratio 0.85 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:require_min_compat_client luminous 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:min_compat_client luminous 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:require_osd_release squid 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:stretch_mode_enabled false 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-10T08:08:27.546 INFO:teuthology.orchestra.run.smithi022.stdout:max_osd 12 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6802/4248555152,v1:172.21.15.22:6803/4248555152] [v2:172.21.15.22:6804/4248555152,v1:172.21.15.22:6805/4248555152] exists,up 8d296bd3-28a7-418c-ad73-343a5e806cfc 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1 up in weight 1 up_from 13 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6800/2078646052,v1:172.21.15.100:6801/2078646052] [v2:172.21.15.100:6802/2078646052,v1:172.21.15.100:6803/2078646052] exists,up c1e2b40e-b4ab-475a-8a9e-c67409f46b6f 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2 up in weight 1 up_from 18 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/2492419476,v1:172.21.15.153:6801/2492419476] [v2:172.21.15.153:6802/2492419476,v1:172.21.15.153:6803/2492419476] exists,up be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3 up in weight 1 up_from 25 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6810/3674495276,v1:172.21.15.22:6811/3674495276] [v2:172.21.15.22:6812/3674495276,v1:172.21.15.22:6813/3674495276] exists,up e980a3ba-c659-4473-9633-9cbe88296d70 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4 up in weight 1 up_from 32 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6808/3886932513,v1:172.21.15.100:6809/3886932513] [v2:172.21.15.100:6810/3886932513,v1:172.21.15.100:6811/3886932513] exists,up b37d0590-99b1-4566-96b4-9936890d4308 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5 up in weight 1 up_from 37 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6808/120732073,v1:172.21.15.153:6809/120732073] [v2:172.21.15.153:6810/120732073,v1:172.21.15.153:6811/120732073] exists,up 6cb989a0-80a1-4a9a-8b45-51b47772b203 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6 up in weight 1 up_from 44 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6818/3692536487,v1:172.21.15.22:6819/3692536487] [v2:172.21.15.22:6820/3692536487,v1:172.21.15.22:6821/3692536487] exists,up 294887f3-3e58-4b02-884d-4e0a70a86d16 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7 up in weight 1 up_from 49 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6816/1221175921,v1:172.21.15.100:6817/1221175921] [v2:172.21.15.100:6818/1221175921,v1:172.21.15.100:6819/1221175921] exists,up d0c0ec61-4055-46f3-a4b0-39f04c735452 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8 up in weight 1 up_from 56 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6816/1153053941,v1:172.21.15.153:6817/1153053941] [v2:172.21.15.153:6818/1153053941,v1:172.21.15.153:6819/1153053941] exists,up bda45a16-742e-4eda-b4d4-e01d6f3dc92e 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9 up in weight 1 up_from 63 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6826/3423218876,v1:172.21.15.22:6827/3423218876] [v2:172.21.15.22:6828/3423218876,v1:172.21.15.22:6829/3423218876] exists,up 48bd3544-9028-4535-801b-3d39ecadf48e 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10 up in weight 1 up_from 68 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6824/2024112643,v1:172.21.15.100:6825/2024112643] [v2:172.21.15.100:6826/2024112643,v1:172.21.15.100:6827/2024112643] exists,up c8716aa0-eb93-435d-a9d0-dd4c3dce1954 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11 up in weight 1 up_from 75 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6824/2245781783,v1:172.21.15.153:6825/2245781783] [v2:172.21.15.153:6826/2245781783,v1:172.21.15.153:6827/2245781783] exists,up 3c427cfe-8d7c-431e-9eb4-b03cfac3068d 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.b [8,11] 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.f [8,11] 2024-09-10T08:08:27.547 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.10 [2,4] 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.16 [2,4] 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.0 [5,9] 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.6 [4,6] 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.21 [4,8] 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.29 [3,9] 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.3c [4,9] 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/3072001022 expires 2024-09-11T08:00:00.858281+0000 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/1519904928 expires 2024-09-11T08:00:00.858281+0000 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6801/17773609 expires 2024-09-11T08:00:00.858281+0000 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6800/17773609 expires 2024-09-11T08:00:00.858281+0000 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/2108462626 expires 2024-09-11T08:00:00.858281+0000 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6800/3970835433 expires 2024-09-11T07:59:36.505631+0000 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/3337107310 expires 2024-09-11T07:59:36.505631+0000 2024-09-10T08:08:27.548 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6801/3970835433 expires 2024-09-11T07:59:36.505631+0000 2024-09-10T08:08:27.549 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/1708436544 expires 2024-09-11T07:59:36.505631+0000 2024-09-10T08:08:27.549 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/278091300 expires 2024-09-11T07:59:36.505631+0000 2024-09-10T08:08:27.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.548+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/1588250205 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe9940a2c40 msgr2=0x7fe9940a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:27.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.548+0000 7fe9b0b5e640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe9940a2c40 0x7fe9940a5100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00058c0 tx=0x7fe9a0005850 comp rx=0 tx=0).stop 2024-09-10T08:08:27.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.548+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/1588250205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac101c00 msgr2=0x7fe9ac197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:27.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.548+0000 7fe9b0b5e640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac101c00 0x7fe9ac197dd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe99c00c970 tx=0x7fe99c00ce30 comp rx=0 tx=0).stop 2024-09-10T08:08:27.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.548+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/1588250205 shutdown_connections 2024-09-10T08:08:27.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.548+0000 7fe9b0b5e640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe9940a2c40 0x7fe9940a5100 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:27.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.548+0000 7fe9b0b5e640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9ac1037c0 0x7fe9ac19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:27.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.548+0000 7fe9b0b5e640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9ac102e00 0x7fe9ac198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:27.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.548+0000 7fe9b0b5e640 1 --2- 172.21.15.22:0/1588250205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9ac101c00 0x7fe9ac197dd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:27.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.548+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/1588250205 >> 172.21.15.22:0/1588250205 conn(0x7fe9ac0fd390 msgr2=0x7fe9ac106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:27.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.548+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/1588250205 shutdown_connections 2024-09-10T08:08:27.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:27.548+0000 7fe9b0b5e640 1 -- 172.21.15.22:0/1588250205 wait complete. 2024-09-10T08:08:28.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:28 smithi022 ceph-mon[30854]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:08:28.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:28 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1588250205' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T08:08:28.337 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T08:08:28.350 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:08:28.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:28 smithi100 ceph-mon[35102]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:08:28.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:28 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1588250205' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T08:08:28.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:28 smithi153 ceph-mon[35609]: pgmap v326: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:08:28.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:28 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1588250205' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-10T08:08:28.607 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:29.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.120+0000 7f689a6c7640 1 -- 172.21.15.22:0/3003732391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6894101de0 msgr2=0x7f68941021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:29.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.120+0000 7f689a6c7640 1 --2- 172.21.15.22:0/3003732391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6894101de0 0x7f68941021c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6884009900 tx=0x7f688402a410 comp rx=0 tx=0).stop 2024-09-10T08:08:29.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.120+0000 7f689a6c7640 1 -- 172.21.15.22:0/3003732391 shutdown_connections 2024-09-10T08:08:29.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.120+0000 7f689a6c7640 1 --2- 172.21.15.22:0/3003732391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6894106f10 0x7f689410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:29.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.120+0000 7f689a6c7640 1 --2- 172.21.15.22:0/3003732391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894102790 0x7f68941067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:29.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.120+0000 7f689a6c7640 1 --2- 172.21.15.22:0/3003732391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6894101de0 0x7f68941021c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:29.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.120+0000 7f689a6c7640 1 -- 172.21.15.22:0/3003732391 >> 172.21.15.22:0/3003732391 conn(0x7f68940fd8c0 msgr2=0x7f68940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:29.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.120+0000 7f689a6c7640 1 -- 172.21.15.22:0/3003732391 shutdown_connections 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.120+0000 7f689a6c7640 1 -- 172.21.15.22:0/3003732391 wait complete. 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f689a6c7640 1 Processor -- start 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f689a6c7640 1 -- start start 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f689a6c7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6894101de0 0x7f6894198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f689a6c7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894102790 0x7f68941988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f689a6c7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6894106f10 0x7f689419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f689a6c7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6894111f70 con 0x7f6894106f10 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f689a6c7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6894111df0 con 0x7f6894102790 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f689a6c7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68941120f0 con 0x7f6894101de0 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f6898c64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6894106f10 0x7f689419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f6898c64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6894106f10 0x7f689419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33302/0 (socket says 172.21.15.22:33302) 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f6898c64640 1 -- 172.21.15.22:0/4009227851 learned_addr learned my addr 172.21.15.22:0/4009227851 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:29.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f6893fff640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6894101de0 0x7f6894198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:29.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.121+0000 7f68937fe640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894102790 0x7f68941988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:29.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.122+0000 7f6898c64640 1 -- 172.21.15.22:0/4009227851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6894101de0 msgr2=0x7f6894198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:29.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.122+0000 7f6898c64640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6894101de0 0x7f6894198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:29.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.122+0000 7f6898c64640 1 -- 172.21.15.22:0/4009227851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894102790 msgr2=0x7f68941988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:29.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.122+0000 7f6898c64640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894102790 0x7f68941988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:29.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.122+0000 7f6898c64640 1 -- 172.21.15.22:0/4009227851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f689419d320 con 0x7f6894106f10 2024-09-10T08:08:29.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.122+0000 7f6898c64640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6894106f10 0x7f689419cc40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f688c00eaa0 tx=0x7f688c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:29.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.122+0000 7f68917fa640 1 -- 172.21.15.22:0/4009227851 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c00cdb0 con 0x7f6894106f10 2024-09-10T08:08:29.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.122+0000 7f689a6c7640 1 -- 172.21.15.22:0/4009227851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f689419d610 con 0x7f6894106f10 2024-09-10T08:08:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.122+0000 7f68917fa640 1 -- 172.21.15.22:0/4009227851 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f688c005020 con 0x7f6894106f10 2024-09-10T08:08:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.122+0000 7f68917fa640 1 -- 172.21.15.22:0/4009227851 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688c0116d0 con 0x7f6894106f10 2024-09-10T08:08:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.122+0000 7f689a6c7640 1 -- 172.21.15.22:0/4009227851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68941a4ef0 con 0x7f6894106f10 2024-09-10T08:08:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.123+0000 7f689a6c7640 1 -- 172.21.15.22:0/4009227851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68941021c0 con 0x7f6894106f10 2024-09-10T08:08:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.124+0000 7f68917fa640 1 -- 172.21.15.22:0/4009227851 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f688c0054d0 con 0x7f6894106f10 2024-09-10T08:08:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.125+0000 7f68917fa640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f687c0a2c10 0x7f687c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.125+0000 7f6893fff640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f687c0a2c10 0x7f687c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.125+0000 7f68917fa640 1 -- 172.21.15.22:0/4009227851 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f688c0cf410 con 0x7f6894106f10 2024-09-10T08:08:29.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.125+0000 7f6893fff640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f687c0a2c10 0x7f687c0a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6884009230 tx=0x7f68840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:29.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.129+0000 7f68917fa640 1 -- 172.21.15.22:0/4009227851 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f688c016030 con 0x7f6894106f10 2024-09-10T08:08:29.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.341+0000 7f689a6c7640 1 -- 172.21.15.22:0/4009227851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f689410a150 con 0x7f6894106f10 2024-09-10T08:08:29.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.341+0000 7f68917fa640 1 -- 172.21.15.22:0/4009227851 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11963 (secure 0 0 0) 0x7f688c09c1d0 con 0x7f6894106f10 2024-09-10T08:08:29.341 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:29.341 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"btime":"2024-09-10T08:07:06:469020+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:06:54.609910+0000","modified":"2024-09-10T08:07:06.044085+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24512,"mds_1":24479,"mds_2":24469,"mds_3":24455,"mds_4":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/896927555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":896927555},{"type":"v1","addr":"172.21.15.22:6839","nonce":896927555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14622":{"gid":14622,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.22:6841/969125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":969125},{"type":"v1","addr":"172.21.15.22:6841","nonce":969125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/2417436521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2417436521},{"type":"v1","addr":"172.21.15.153:6837","nonce":2417436521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/1766856743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1766856743},{"type":"v1","addr":"172.21.15.153:6839","nonce":1766856743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/1987693702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1987693702},{"type":"v1","addr":"172.21.15.100:6837","nonce":1987693702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/2512683674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":2512683674},{"type":"v1","addr":"172.21.15.100:6839","nonce":2512683674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24512,"qdb_cluster":[14622,24455,24469,24479,24512]},"id":1}]} 2024-09-10T08:08:29.341 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-10T08:08:29.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.343+0000 7f689a6c7640 1 -- 172.21.15.22:0/4009227851 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f687c0a2c10 msgr2=0x7f687c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:29.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.343+0000 7f689a6c7640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f687c0a2c10 0x7f687c0a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6884009230 tx=0x7f68840058d0 comp rx=0 tx=0).stop 2024-09-10T08:08:29.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.343+0000 7f689a6c7640 1 -- 172.21.15.22:0/4009227851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6894106f10 msgr2=0x7f689419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:29.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.343+0000 7f689a6c7640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6894106f10 0x7f689419cc40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f688c00eaa0 tx=0x7f688c00ef60 comp rx=0 tx=0).stop 2024-09-10T08:08:29.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.344+0000 7f689a6c7640 1 -- 172.21.15.22:0/4009227851 shutdown_connections 2024-09-10T08:08:29.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.344+0000 7f689a6c7640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f687c0a2c10 0x7f687c0a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:29.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.344+0000 7f689a6c7640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6894106f10 0x7f689419cc40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.344+0000 7f689a6c7640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6894102790 0x7f68941988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.344+0000 7f689a6c7640 1 --2- 172.21.15.22:0/4009227851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6894101de0 0x7f6894198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.344+0000 7f689a6c7640 1 -- 172.21.15.22:0/4009227851 >> 172.21.15.22:0/4009227851 conn(0x7f68940fd8c0 msgr2=0x7f68940fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.344+0000 7f689a6c7640 1 -- 172.21.15.22:0/4009227851 shutdown_connections 2024-09-10T08:08:29.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:29.344+0000 7f689a6c7640 1 -- 172.21.15.22:0/4009227851 wait complete. 2024-09-10T08:08:30.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:08:30.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:30 smithi022 ceph-mon[30854]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T08:08:30.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:30 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/4009227851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:30.274 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:30.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:30 smithi100 ceph-mon[35102]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T08:08:30.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:30 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/4009227851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:30.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:30 smithi153 ceph-mon[35609]: pgmap v327: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-10T08:08:30.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:30 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/4009227851' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:30.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.720+0000 7f0b038c6640 1 -- 172.21.15.22:0/1777915346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0afc074eb0 msgr2=0x7f0afc112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:30.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.720+0000 7f0b038c6640 1 --2- 172.21.15.22:0/1777915346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0afc074eb0 0x7f0afc112650 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009900 tx=0x7f0af002a480 comp rx=0 tx=0).stop 2024-09-10T08:08:30.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.720+0000 7f0b038c6640 1 -- 172.21.15.22:0/1777915346 shutdown_connections 2024-09-10T08:08:30.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.720+0000 7f0b038c6640 1 --2- 172.21.15.22:0/1777915346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0afc112b90 0x7f0afc114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:30.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.720+0000 7f0b038c6640 1 --2- 172.21.15.22:0/1777915346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0afc074eb0 0x7f0afc112650 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:30.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.720+0000 7f0b038c6640 1 --2- 172.21.15.22:0/1777915346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0afc074590 0x7f0afc074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:30.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.720+0000 7f0b038c6640 1 -- 172.21.15.22:0/1777915346 >> 172.21.15.22:0/1777915346 conn(0x7f0afc0fd8c0 msgr2=0x7f0afc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:30.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.720+0000 7f0b038c6640 1 -- 172.21.15.22:0/1777915346 shutdown_connections 2024-09-10T08:08:30.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.720+0000 7f0b038c6640 1 -- 172.21.15.22:0/1777915346 wait complete. 2024-09-10T08:08:30.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.721+0000 7f0b038c6640 1 Processor -- start 2024-09-10T08:08:30.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.721+0000 7f0b038c6640 1 -- start start 2024-09-10T08:08:30.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.721+0000 7f0b038c6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0afc074590 0x7f0afc1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:30.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.721+0000 7f0b038c6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0afc074eb0 0x7f0afc1a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:30.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b038c6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0afc112b90 0x7f0afc19e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:30.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b038c6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc118540 con 0x7f0afc074eb0 2024-09-10T08:08:30.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b038c6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc1183c0 con 0x7f0afc112b90 2024-09-10T08:08:30.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b038c6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc1186c0 con 0x7f0afc074590 2024-09-10T08:08:30.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b00e61640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0afc074eb0 0x7f0afc1a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:30.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b00e61640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0afc074eb0 0x7f0afc1a4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33326/0 (socket says 172.21.15.22:33326) 2024-09-10T08:08:30.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b00e61640 1 -- 172.21.15.22:0/3530396866 learned_addr learned my addr 172.21.15.22:0/3530396866 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:30.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b01662640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0afc074590 0x7f0afc1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:30.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b01e63640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0afc112b90 0x7f0afc19e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b00e61640 1 -- 172.21.15.22:0/3530396866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0afc074590 msgr2=0x7f0afc1a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b00e61640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0afc074590 0x7f0afc1a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b00e61640 1 -- 172.21.15.22:0/3530396866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0afc112b90 msgr2=0x7f0afc19e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b00e61640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0afc112b90 0x7f0afc19e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b00e61640 1 -- 172.21.15.22:0/3530396866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0afc19f000 con 0x7f0afc074eb0 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b00e61640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0afc074eb0 0x7f0afc1a4c50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0af0006010 tx=0x7f0af00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0afa7fc640 1 -- 172.21.15.22:0/3530396866 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af003f030 con 0x7f0afc074eb0 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0afa7fc640 1 -- 172.21.15.22:0/3530396866 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0af0003ce0 con 0x7f0afc074eb0 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b038c6640 1 -- 172.21.15.22:0/3530396866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0afc19f290 con 0x7f0afc074eb0 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0afa7fc640 1 -- 172.21.15.22:0/3530396866 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0035070 con 0x7f0afc074eb0 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.722+0000 7f0b038c6640 1 -- 172.21.15.22:0/3530396866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0afc1ab5e0 con 0x7f0afc074eb0 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.723+0000 7f0b038c6640 1 -- 172.21.15.22:0/3530396866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0afc074970 con 0x7f0afc074eb0 2024-09-10T08:08:30.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.724+0000 7f0afa7fc640 1 -- 172.21.15.22:0/3530396866 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 137884+0+0 (secure 0 0 0) 0x7f0af0042030 con 0x7f0afc074eb0 2024-09-10T08:08:30.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.725+0000 7f0afa7fc640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0ae40a2c10 0x7f0ae40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:30.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.726+0000 7f0b01662640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0ae40a2c10 0x7f0ae40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:30.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.726+0000 7f0afa7fc640 1 -- 172.21.15.22:0/3530396866 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f0af00ef7e0 con 0x7f0afc074eb0 2024-09-10T08:08:30.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.726+0000 7f0b01662640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0ae40a2c10 0x7f0ae40a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0afc19fa10 tx=0x7f0aec009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:30.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.730+0000 7f0afa7fc640 1 -- 172.21.15.22:0/3530396866 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0af00bc050 con 0x7f0afc074eb0 2024-09-10T08:08:30.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.970+0000 7f0b038c6640 1 -- 172.21.15.22:0/3530396866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0afc105000 con 0x7f0afc074eb0 2024-09-10T08:08:30.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.971+0000 7f0afa7fc640 1 -- 172.21.15.22:0/3530396866 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11963 (secure 0 0 0) 0x7f0af00c0350 con 0x7f0afc074eb0 2024-09-10T08:08:30.970 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:30.971 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"btime":"2024-09-10T08:07:06:469020+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:06:54.609910+0000","modified":"2024-09-10T08:07:06.044085+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24512,"mds_1":24479,"mds_2":24469,"mds_3":24455,"mds_4":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/896927555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":896927555},{"type":"v1","addr":"172.21.15.22:6839","nonce":896927555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14622":{"gid":14622,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.22:6841/969125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":969125},{"type":"v1","addr":"172.21.15.22:6841","nonce":969125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/2417436521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2417436521},{"type":"v1","addr":"172.21.15.153:6837","nonce":2417436521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/1766856743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1766856743},{"type":"v1","addr":"172.21.15.153:6839","nonce":1766856743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/1987693702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1987693702},{"type":"v1","addr":"172.21.15.100:6837","nonce":1987693702}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/2512683674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":2512683674},{"type":"v1","addr":"172.21.15.100:6839","nonce":2512683674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24512,"qdb_cluster":[14622,24455,24469,24479,24512]},"id":1}]} 2024-09-10T08:08:30.971 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-10T08:08:30.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.973+0000 7f0b038c6640 1 -- 172.21.15.22:0/3530396866 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0ae40a2c10 msgr2=0x7f0ae40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:30.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.973+0000 7f0b038c6640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0ae40a2c10 0x7f0ae40a50d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0afc19fa10 tx=0x7f0aec009680 comp rx=0 tx=0).stop 2024-09-10T08:08:30.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.973+0000 7f0b038c6640 1 -- 172.21.15.22:0/3530396866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0afc074eb0 msgr2=0x7f0afc1a4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:30.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.973+0000 7f0b038c6640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0afc074eb0 0x7f0afc1a4c50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0af0006010 tx=0x7f0af00042f0 comp rx=0 tx=0).stop 2024-09-10T08:08:30.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.973+0000 7f0b038c6640 1 -- 172.21.15.22:0/3530396866 shutdown_connections 2024-09-10T08:08:30.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.973+0000 7f0b038c6640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f0ae40a2c10 0x7f0ae40a50d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:30.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.973+0000 7f0b038c6640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0afc112b90 0x7f0afc19e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:30.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.973+0000 7f0b038c6640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0afc074eb0 0x7f0afc1a4c50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:30.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.973+0000 7f0b038c6640 1 --2- 172.21.15.22:0/3530396866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0afc074590 0x7f0afc1a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:30.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.973+0000 7f0b038c6640 1 -- 172.21.15.22:0/3530396866 >> 172.21.15.22:0/3530396866 conn(0x7f0afc0fd8c0 msgr2=0x7f0afc0ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:30.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.974+0000 7f0b038c6640 1 -- 172.21.15.22:0/3530396866 shutdown_connections 2024-09-10T08:08:30.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:30.974+0000 7f0b038c6640 1 -- 172.21.15.22:0/3530396866 wait complete. 2024-09-10T08:08:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:31 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3530396866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:31.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:31 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3530396866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:31.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:31 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3530396866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:08:31.710 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T08:08:31.975 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:32.347 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:32 smithi022 ceph-mon[30854]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:08:32.347 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:32 smithi022 ceph-mon[30854]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T08:08:32.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:32 smithi100 ceph-mon[35102]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:08:32.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:32 smithi100 ceph-mon[35102]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T08:08:32.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:32 smithi153 ceph-mon[35609]: pgmap v328: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-10T08:08:32.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:32 smithi153 ceph-mon[35609]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-10T08:08:32.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.432+0000 7f3dbdf32640 1 -- 172.21.15.22:0/4129504567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3db8103660 msgr2=0x7f3db810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:32.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.432+0000 7f3dbdf32640 1 --2- 172.21.15.22:0/4129504567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3db8103660 0x7f3db810bb50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009900 tx=0x7f3dac02a480 comp rx=0 tx=0).stop 2024-09-10T08:08:32.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.432+0000 7f3dbdf32640 1 -- 172.21.15.22:0/4129504567 shutdown_connections 2024-09-10T08:08:32.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.432+0000 7f3dbdf32640 1 --2- 172.21.15.22:0/4129504567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3db810c170 0x7f3db810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:32.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.432+0000 7f3dbdf32640 1 --2- 172.21.15.22:0/4129504567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3db8103660 0x7f3db810bb50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:32.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.432+0000 7f3dbdf32640 1 --2- 172.21.15.22:0/4129504567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3db8102d40 0x7f3db8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:32.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.432+0000 7f3dbdf32640 1 -- 172.21.15.22:0/4129504567 >> 172.21.15.22:0/4129504567 conn(0x7f3db80fc7a0 msgr2=0x7f3db80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:32.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.432+0000 7f3dbdf32640 1 -- 172.21.15.22:0/4129504567 shutdown_connections 2024-09-10T08:08:32.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.432+0000 7f3dbdf32640 1 -- 172.21.15.22:0/4129504567 wait complete. 2024-09-10T08:08:32.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.432+0000 7f3dbdf32640 1 Processor -- start 2024-09-10T08:08:32.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3dbdf32640 1 -- start start 2024-09-10T08:08:32.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3dbdf32640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3db8102d40 0x7f3db8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3dbdf32640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3db8103660 0x7f3db8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3dbdf32640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3db810c170 0x7f3db819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3dbdf32640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3db8111fb0 con 0x7f3db8103660 2024-09-10T08:08:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3dbdf32640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3db8111e30 con 0x7f3db810c170 2024-09-10T08:08:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3dbdf32640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3db8112130 con 0x7f3db8102d40 2024-09-10T08:08:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3db6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3db8103660 0x7f3db8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3db6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3db8103660 0x7f3db8198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33350/0 (socket says 172.21.15.22:33350) 2024-09-10T08:08:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3db6ffd640 1 -- 172.21.15.22:0/1212595801 learned_addr learned my addr 172.21.15.22:0/1212595801 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3db7fff640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3db810c170 0x7f3db819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3db77fe640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3db8102d40 0x7f3db8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3db6ffd640 1 -- 172.21.15.22:0/1212595801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3db8102d40 msgr2=0x7f3db8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:32.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3db6ffd640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3db8102d40 0x7f3db8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3db6ffd640 1 -- 172.21.15.22:0/1212595801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3db810c170 msgr2=0x7f3db819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3db6ffd640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3db810c170 0x7f3db819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3db6ffd640 1 -- 172.21.15.22:0/1212595801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db819d3c0 con 0x7f3db8103660 2024-09-10T08:08:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.433+0000 7f3db7fff640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3db810c170 0x7f3db819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.434+0000 7f3db6ffd640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3db8103660 0x7f3db8198950 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3dac005ab0 tx=0x7f3dac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.434+0000 7f3db4ff9640 1 -- 172.21.15.22:0/1212595801 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac03f030 con 0x7f3db8103660 2024-09-10T08:08:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.434+0000 7f3dbdf32640 1 -- 172.21.15.22:0/1212595801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db819d650 con 0x7f3db8103660 2024-09-10T08:08:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.434+0000 7f3db4ff9640 1 -- 172.21.15.22:0/1212595801 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3dac003ce0 con 0x7f3db8103660 2024-09-10T08:08:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.434+0000 7f3db4ff9640 1 -- 172.21.15.22:0/1212595801 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac035070 con 0x7f3db8103660 2024-09-10T08:08:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.434+0000 7f3dbdf32640 1 -- 172.21.15.22:0/1212595801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db81a4f90 con 0x7f3db8103660 2024-09-10T08:08:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.435+0000 7f3dbdf32640 1 -- 172.21.15.22:0/1212595801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db8103120 con 0x7f3db8103660 2024-09-10T08:08:32.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.436+0000 7f3db4ff9640 1 -- 172.21.15.22:0/1212595801 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f3dac042030 con 0x7f3db8103660 2024-09-10T08:08:32.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.437+0000 7f3db4ff9640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3da00a2b80 0x7f3da00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:32.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.437+0000 7f3db77fe640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3da00a2b80 0x7f3da00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:32.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.437+0000 7f3db4ff9640 1 -- 172.21.15.22:0/1212595801 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f3dac0ef990 con 0x7f3db8103660 2024-09-10T08:08:32.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.437+0000 7f3db77fe640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3da00a2b80 0x7f3da00a5040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3da8005e10 tx=0x7f3da8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:32.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.441+0000 7f3db4ff9640 1 -- 172.21.15.22:0/1212595801 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3dac0bc8b0 con 0x7f3db8103660 2024-09-10T08:08:32.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.619+0000 7f3dbdf32640 1 -- 172.21.15.22:0/1212595801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3db81a5160 con 0x7f3db8103660 2024-09-10T08:08:32.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.620+0000 7f3db4ff9640 1 -- 172.21.15.22:0/1212595801 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22791 (secure 0 0 0) 0x7f3dac0bc1b0 con 0x7f3db8103660 2024-09-10T08:08:32.620 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:08:32.620 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":83,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","created":"2024-09-10T07:59:04.704048+0000","modified":"2024-09-10T08:07:02.403174+0000","last_up_change":"2024-09-10T08:06:02.535944+0000","last_in_change":"2024-09-10T08:05:39.070554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:02:15.371265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:06:50.358155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:06:52.896201+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d296bd3-28a7-418c-ad73-343a5e806cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6803","nonce":4248555152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6805","nonce":4248555152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6809","nonce":4248555152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6807","nonce":4248555152}]},"public_addr":"172.21.15.22:6803/4248555152","cluster_addr":"172.21.15.22:6805/4248555152","heartbeat_back_addr":"172.21.15.22:6809/4248555152","heartbeat_front_addr":"172.21.15.22:6807/4248555152","state":["exists","up"]},{"osd":1,"uuid":"c1e2b40e-b4ab-475a-8a9e-c67409f46b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6801","nonce":2078646052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6803","nonce":2078646052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6807","nonce":2078646052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6805","nonce":2078646052}]},"public_addr":"172.21.15.100:6801/2078646052","cluster_addr":"172.21.15.100:6803/2078646052","heartbeat_back_addr":"172.21.15.100:6807/2078646052","heartbeat_front_addr":"172.21.15.100:6805/2078646052","state":["exists","up"]},{"osd":2,"uuid":"be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6801","nonce":2492419476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6803","nonce":2492419476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6807","nonce":2492419476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6805","nonce":2492419476}]},"public_addr":"172.21.15.153:6801/2492419476","cluster_addr":"172.21.15.153:6803/2492419476","heartbeat_back_addr":"172.21.15.153:6807/2492419476","heartbeat_front_addr":"172.21.15.153:6805/2492419476","state":["exists","up"]},{"osd":3,"uuid":"e980a3ba-c659-4473-9633-9cbe88296d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6811","nonce":3674495276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6813","nonce":3674495276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6817","nonce":3674495276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6815","nonce":3674495276}]},"public_addr":"172.21.15.22:6811/3674495276","cluster_addr":"172.21.15.22:6813/3674495276","heartbeat_back_addr":"172.21.15.22:6817/3674495276","heartbeat_front_addr":"172.21.15.22:6815/3674495276","state":["exists","up"]},{"osd":4,"uuid":"b37d0590-99b1-4566-96b4-9936890d4308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6809","nonce":3886932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6811","nonce":3886932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6815","nonce":3886932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6813","nonce":3886932513}]},"public_addr":"172.21.15.100:6809/3886932513","cluster_addr":"172.21.15.100:6811/3886932513","heartbeat_back_addr":"172.21.15.100:6815/3886932513","heartbeat_front_addr":"172.21.15.100:6813/3886932513","state":["exists","up"]},{"osd":5,"uuid":"6cb989a0-80a1-4a9a-8b45-51b47772b203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6809","nonce":120732073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6811","nonce":120732073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6815","nonce":120732073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6813","nonce":120732073}]},"public_addr":"172.21.15.153:6809/120732073","cluster_addr":"172.21.15.153:6811/120732073","heartbeat_back_addr":"172.21.15.153:6815/120732073","heartbeat_front_addr":"172.21.15.153:6813/120732073","state":["exists","up"]},{"osd":6,"uuid":"294887f3-3e58-4b02-884d-4e0a70a86d16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6819","nonce":3692536487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6821","nonce":3692536487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6825","nonce":3692536487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6823","nonce":3692536487}]},"public_addr":"172.21.15.22:6819/3692536487","cluster_addr":"172.21.15.22:6821/3692536487","heartbeat_back_addr":"172.21.15.22:6825/3692536487","heartbeat_front_addr":"172.21.15.22:6823/3692536487","state":["exists","up"]},{"osd":7,"uuid":"d0c0ec61-4055-46f3-a4b0-39f04c735452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6817","nonce":1221175921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6819","nonce":1221175921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6823","nonce":1221175921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6821","nonce":1221175921}]},"public_addr":"172.21.15.100:6817/1221175921","cluster_addr":"172.21.15.100:6819/1221175921","heartbeat_back_addr":"172.21.15.100:6823/1221175921","heartbeat_front_addr":"172.21.15.100:6821/1221175921","state":["exists","up"]},{"osd":8,"uuid":"bda45a16-742e-4eda-b4d4-e01d6f3dc92e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6817","nonce":1153053941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6819","nonce":1153053941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6823","nonce":1153053941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6821","nonce":1153053941}]},"public_addr":"172.21.15.153:6817/1153053941","cluster_addr":"172.21.15.153:6819/1153053941","heartbeat_back_addr":"172.21.15.153:6823/1153053941","heartbeat_front_addr":"172.21.15.153:6821/1153053941","state":["exists","up"]},{"osd":9,"uuid":"48bd3544-9028-4535-801b-3d39ecadf48e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6827","nonce":3423218876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6829","nonce":3423218876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6833","nonce":3423218876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6831","nonce":3423218876}]},"public_addr":"172.21.15.22:6827/3423218876","cluster_addr":"172.21.15.22:6829/3423218876","heartbeat_back_addr":"172.21.15.22:6833/3423218876","heartbeat_front_addr":"172.21.15.22:6831/3423218876","state":["exists","up"]},{"osd":10,"uuid":"c8716aa0-eb93-435d-a9d0-dd4c3dce1954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6825","nonce":2024112643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6827","nonce":2024112643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6831","nonce":2024112643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6829","nonce":2024112643}]},"public_addr":"172.21.15.100:6825/2024112643","cluster_addr":"172.21.15.100:6827/2024112643","heartbeat_back_addr":"172.21.15.100:6831/2024112643","heartbeat_front_addr":"172.21.15.100:6829/2024112643","state":["exists","up"]},{"osd":11,"uuid":"3c427cfe-8d7c-431e-9eb4-b03cfac3068d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6825","nonce":2245781783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6827","nonce":2245781783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6831","nonce":2245781783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6829","nonce":2245781783}]},"public_addr":"172.21.15.153:6825/2245781783","cluster_addr":"172.21.15.153:6827/2245781783","heartbeat_back_addr":"172.21.15.153:6831/2245781783","heartbeat_front_addr":"172.21.15.153:6829/2245781783","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:23.001057+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:46.353182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:11.469840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:37.557521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:02.630783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:27.374057+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:53.758498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:19.507846+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:45.080789+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:10.286820+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:35.565950+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:06:00.633384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3072001022":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/1519904928":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6801/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/2108462626":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/3337107310":"2024-09-11T07:59:36.505631+0000","172.21.15.22:6801/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/1708436544":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/278091300":"2024-09-11T07:59:36.505631+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:08:32.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.623+0000 7f3dbdf32640 1 -- 172.21.15.22:0/1212595801 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3da00a2b80 msgr2=0x7f3da00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:32.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.623+0000 7f3dbdf32640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3da00a2b80 0x7f3da00a5040 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3da8005e10 tx=0x7f3da8005da0 comp rx=0 tx=0).stop 2024-09-10T08:08:32.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.623+0000 7f3dbdf32640 1 -- 172.21.15.22:0/1212595801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3db8103660 msgr2=0x7f3db8198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:32.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.623+0000 7f3dbdf32640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3db8103660 0x7f3db8198950 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3dac005ab0 tx=0x7f3dac0042f0 comp rx=0 tx=0).stop 2024-09-10T08:08:32.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.623+0000 7f3dbdf32640 1 -- 172.21.15.22:0/1212595801 shutdown_connections 2024-09-10T08:08:32.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.623+0000 7f3dbdf32640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f3da00a2b80 0x7f3da00a5040 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:32.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.623+0000 7f3dbdf32640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3db810c170 0x7f3db819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:32.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.623+0000 7f3dbdf32640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3db8103660 0x7f3db8198950 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:32.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.623+0000 7f3dbdf32640 1 --2- 172.21.15.22:0/1212595801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3db8102d40 0x7f3db8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:32.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.623+0000 7f3dbdf32640 1 -- 172.21.15.22:0/1212595801 >> 172.21.15.22:0/1212595801 conn(0x7f3db80fc7a0 msgr2=0x7f3db80fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:32.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.623+0000 7f3dbdf32640 1 -- 172.21.15.22:0/1212595801 shutdown_connections 2024-09-10T08:08:32.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:32.623+0000 7f3dbdf32640 1 -- 172.21.15.22:0/1212595801 wait complete. 2024-09-10T08:08:33.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:33 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1212595801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:08:33.329 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T08:06:54.609910+0000', 'modified': '2024-09-10T08:07:06.044085+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24512, 'mds_1': 24479, 'mds_2': 24469, 'mds_3': 24455, 'mds_4': 14622}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14616': {'gid': 14616, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.22:6839/896927555', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 896927555}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 896927555}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14622': {'gid': 14622, 'name': 'a', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.22:6841/969125', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6840', 'nonce': 969125}, {'type': 'v1', 'addr': '172.21.15.22:6841', 'nonce': 969125}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24409': {'gid': 24409, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6833/3705787109', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 3705787109}, {'type': 'v1', 'addr': '172.21.15.153:6833', 'nonce': 3705787109}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.100:6833/1178134620', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6832', 'nonce': 1178134620}, {'type': 'v1', 'addr': '172.21.15.100:6833', 'nonce': 1178134620}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6835/3505190925', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 3505190925}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 3505190925}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6837/2417436521', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 2417436521}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 2417436521}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.100:6835/800491506', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 800491506}, {'type': 'v1', 'addr': '172.21.15.100:6835', 'nonce': 800491506}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.153:6839/1766856743', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6838', 'nonce': 1766856743}, {'type': 'v1', 'addr': '172.21.15.153:6839', 'nonce': 1766856743}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24479': {'gid': 24479, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.100:6837/1987693702', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 1987693702}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 1987693702}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24512': {'gid': 24512, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6839/2512683674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 2512683674}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 2512683674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24512, 'qdb_cluster': [14622, 24455, 24469, 24479, 24512]} 2024-09-10T08:08:33.329 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-10T08:08:33.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell mds.a status 2024-09-10T08:08:33.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:33 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1212595801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:08:33.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:33 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1212595801' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:08:33.595 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:34.049 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.048+0000 7fc38769e640 1 -- 172.21.15.22:0/94175545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc380100e20 msgr2=0x7fc380101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:34.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.048+0000 7fc38769e640 1 --2- 172.21.15.22:0/94175545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc380100e20 0x7fc380101200 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009900 tx=0x7fc37c02a480 comp rx=0 tx=0).stop 2024-09-10T08:08:34.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.048+0000 7fc38769e640 1 -- 172.21.15.22:0/94175545 shutdown_connections 2024-09-10T08:08:34.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.048+0000 7fc38769e640 1 --2- 172.21.15.22:0/94175545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc380102ef0 0x7fc38010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.048+0000 7fc38769e640 1 --2- 172.21.15.22:0/94175545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc380102570 0x7fc3801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.048+0000 7fc38769e640 1 --2- 172.21.15.22:0/94175545 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc380100e20 0x7fc380101200 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.048+0000 7fc38769e640 1 -- 172.21.15.22:0/94175545 >> 172.21.15.22:0/94175545 conn(0x7fc3800fc7d0 msgr2=0x7fc3800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:34.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.048+0000 7fc38769e640 1 -- 172.21.15.22:0/94175545 shutdown_connections 2024-09-10T08:08:34.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.048+0000 7fc38769e640 1 -- 172.21.15.22:0/94175545 wait complete. 2024-09-10T08:08:34.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc38769e640 1 Processor -- start 2024-09-10T08:08:34.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc38769e640 1 -- start start 2024-09-10T08:08:34.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc38769e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc380100e20 0x7fc380103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc38769e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc380102570 0x7fc380103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc38769e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc380102ef0 0x7fc3801041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc38769e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc380110f80 con 0x7fc380102570 2024-09-10T08:08:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc38769e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc380110e00 con 0x7fc380100e20 2024-09-10T08:08:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc38769e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc380111100 con 0x7fc380102ef0 2024-09-10T08:08:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc384c39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc380102570 0x7fc380103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc384c39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc380102570 0x7fc380103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40914/0 (socket says 172.21.15.22:40914) 2024-09-10T08:08:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc384c39640 1 -- 172.21.15.22:0/2576440639 learned_addr learned my addr 172.21.15.22:0/2576440639 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc38543a640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc380100e20 0x7fc380103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc385c3b640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc380102ef0 0x7fc3801041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc384c39640 1 -- 172.21.15.22:0/2576440639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc380102ef0 msgr2=0x7fc3801041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:34.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc384c39640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc380102ef0 0x7fc3801041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc384c39640 1 -- 172.21.15.22:0/2576440639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc380100e20 msgr2=0x7fc380103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc384c39640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc380100e20 0x7fc380103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.049+0000 7fc384c39640 1 -- 172.21.15.22:0/2576440639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3801a6970 con 0x7fc380102570 2024-09-10T08:08:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.050+0000 7fc384c39640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc380102570 0x7fc380103c90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc37000c920 tx=0x7fc37000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.050+0000 7fc3767fc640 1 -- 172.21.15.22:0/2576440639 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370007c70 con 0x7fc380102570 2024-09-10T08:08:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.050+0000 7fc3767fc640 1 -- 172.21.15.22:0/2576440639 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc370007e10 con 0x7fc380102570 2024-09-10T08:08:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.050+0000 7fc38769e640 1 -- 172.21.15.22:0/2576440639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3801a6c60 con 0x7fc380102570 2024-09-10T08:08:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.050+0000 7fc3767fc640 1 -- 172.21.15.22:0/2576440639 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370018890 con 0x7fc380102570 2024-09-10T08:08:34.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.050+0000 7fc38769e640 1 -- 172.21.15.22:0/2576440639 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3801a71a0 con 0x7fc380102570 2024-09-10T08:08:34.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.052+0000 7fc3767fc640 1 -- 172.21.15.22:0/2576440639 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fc370018a70 con 0x7fc380102570 2024-09-10T08:08:34.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.052+0000 7fc389a77740 1 Processor -- start 2024-09-10T08:08:34.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc389a77740 1 -- start start 2024-09-10T08:08:34.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc389a77740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c30db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc389a77740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c3b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc389a77740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c3dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc389a77740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a73b97090 con 0x562a73c312f0 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc389a77740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562a73b3ea70 con 0x562a73c3bbb0 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc389a77740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562a73b93050 con 0x562a73c309d0 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc3767fc640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc36c0a2b80 0x7fc36c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc38543a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c3b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc38543a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c3b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40928/0 (socket says 172.21.15.22:40928) 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc38543a640 1 -- 172.21.15.22:0/967854642 learned_addr learned my addr 172.21.15.22:0/967854642 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc385c3b640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc36c0a2b80 0x7fc36c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc3767fc640 1 -- 172.21.15.22:0/2576440639 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc3700cf240 con 0x7fc380102570 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc385c3b640 1 --2- 172.21.15.22:0/967854642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c30db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc384c39640 1 --2- 172.21.15.22:0/967854642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c3dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc38543a640 1 -- 172.21.15.22:0/967854642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 msgr2=0x562a73c30db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc38543a640 1 --2- 172.21.15.22:0/967854642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c30db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc38543a640 1 -- 172.21.15.22:0/967854642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 msgr2=0x562a73c3dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc38543a640 1 --2- 172.21.15.22:0/967854642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c3dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc38543a640 1 -- 172.21.15.22:0/967854642 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a73b4b130 con 0x562a73c312f0 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.053+0000 7fc384c39640 1 --2- 172.21.15.22:0/967854642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c3dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.054+0000 7fc385c3b640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc36c0a2b80 0x7fc36c0a5040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc378005fd0 tx=0x7fc378009d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.054+0000 7fc38543a640 1 --2- 172.21.15.22:0/967854642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c3b670 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0314e0 tx=0x7fc37c004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82312e94cd41021 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.054+0000 7fc36b7fe640 1 -- 172.21.15.22:0/967854642 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c035030 con 0x562a73c312f0 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.054+0000 7fc36b7fe640 1 -- 172.21.15.22:0/967854642 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc37c005520 con 0x562a73c312f0 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.054+0000 7fc36b7fe640 1 -- 172.21.15.22:0/967854642 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c003850 con 0x562a73c312f0 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.055+0000 7fc389a77740 1 -- 172.21.15.22:0/967854642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 msgr2=0x562a73c3b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.055+0000 7fc389a77740 1 --2- 172.21.15.22:0/967854642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c3b670 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0314e0 tx=0x7fc37c004170 comp rx=0 tx=0).stop 2024-09-10T08:08:34.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.055+0000 7fc389a77740 1 -- 172.21.15.22:0/967854642 shutdown_connections 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.055+0000 7fc389a77740 1 --2- 172.21.15.22:0/967854642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c3dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.055+0000 7fc389a77740 1 --2- 172.21.15.22:0/967854642 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c3b670 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.055+0000 7fc389a77740 1 --2- 172.21.15.22:0/967854642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c30db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.055+0000 7fc389a77740 1 -- 172.21.15.22:0/967854642 >> 172.21.15.22:0/967854642 conn(0x562a73c2cf60 msgr2=0x562a73c2d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.055+0000 7fc389a77740 1 -- 172.21.15.22:0/967854642 shutdown_connections 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.055+0000 7fc389a77740 1 -- 172.21.15.22:0/967854642 wait complete. 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.055+0000 7fc389a77740 1 -- start start 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.055+0000 7fc389a77740 1 Processor -- start 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc389a77740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c3b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc389a77740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c312f0 0x562a73c38750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc389a77740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c3bbb0 0x562a73c38c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc389a77740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a73c3e780 con 0x562a73c3bbb0 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc389a77740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562a73b51f20 con 0x562a73c312f0 2024-09-10T08:08:34.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc389a77740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562a73c3e900 con 0x562a73c309d0 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc389a77740 10 client.0 _ll_register_callbacks cb 0x562a73b1b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc385c3b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c3bbb0 0x562a73c38c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc385c3b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c3bbb0 0x562a73c38c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40938/0 (socket says 172.21.15.22:40938) 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc385c3b640 1 -- 172.21.15.22:0/108051326 learned_addr learned my addr 172.21.15.22:0/108051326 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc384c39640 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c312f0 0x562a73c38750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc38543a640 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c3b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc385c3b640 1 -- 172.21.15.22:0/108051326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 msgr2=0x562a73c3b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc385c3b640 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c3b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc385c3b640 1 -- 172.21.15.22:0/108051326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c312f0 msgr2=0x562a73c38750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc385c3b640 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c312f0 0x562a73c38750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc385c3b640 1 -- 172.21.15.22:0/108051326 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a739082b0 con 0x562a73c3bbb0 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc385c3b640 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c3bbb0 0x562a73c38c90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc378011dc0 tx=0x7fc378009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee6142f2ad68594 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.056+0000 7fc368ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:34.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc368ff9640 1 -- 172.21.15.22:0/108051326 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc378026070 con 0x562a73c3bbb0 2024-09-10T08:08:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc389a77740 1 -- 172.21.15.22:0/108051326 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc37c005520 con 0x562a73c3bbb0 2024-09-10T08:08:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc368ff9640 1 -- 172.21.15.22:0/108051326 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc378004730 con 0x562a73c3bbb0 2024-09-10T08:08:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc368ff9640 1 -- 172.21.15.22:0/108051326 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc378032050 con 0x562a73c3bbb0 2024-09-10T08:08:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc389a77740 10 client.15132 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc389a77740 1 -- 172.21.15.22:0/108051326 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562a73c4a040 con 0x562a73c3bbb0 2024-09-10T08:08:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc368ff9640 1 -- 172.21.15.22:0/108051326 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc37c005520 con 0x562a73c3bbb0 2024-09-10T08:08:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc368ff9640 1 -- 172.21.15.22:0/108051326 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc378012450 con 0x562a73c3bbb0 2024-09-10T08:08:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc389a77740 10 client.15132 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc389a77740 10 client.15132 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:08:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc389a77740 20 client.15132 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc389a77740 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x562a73c4c630 0x562a73c4daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc389a77740 4 client.15132 mds_command: new command op to 14622 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc389a77740 1 -- 172.21.15.22:0/108051326 --> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a73ba4600 con 0x562a73c4c630 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.057+0000 7fc38543a640 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x562a73c4c630 0x562a73c4daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.058+0000 7fc368ff9640 10 client.15132 ms_handle_connect on v2:172.21.15.22:6840/969125 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.058+0000 7fc38543a640 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x562a73c4c630 0x562a73c4daa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=793ad538a61f9213 server_cookie=7f3fbfd1679771d4 in_seq=0 out_seq=0 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.058+0000 7fc368ff9640 1 -- 172.21.15.22:0/108051326 <== mds.4 v2:172.21.15.22:6840/969125 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a73ba4600 con 0x562a73c4c630 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.058+0000 7fc368ff9640 10 client.15132 handle_command_reply: tid=0 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.058+0000 7fc389a77740 1 client.15132 shutdown 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.059+0000 7fc389a77740 1 -- 172.21.15.22:0/108051326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c3bbb0 msgr2=0x562a73c38c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.059+0000 7fc389a77740 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c3bbb0 0x562a73c38c90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc378011dc0 tx=0x7fc378009240 comp rx=0 tx=0).stop 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.059+0000 7fc389a77740 1 -- 172.21.15.22:0/108051326 shutdown_connections 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.059+0000 7fc389a77740 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x562a73c4c630 0x562a73c4daa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.059+0000 7fc389a77740 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c3bbb0 0x562a73c38c90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.059+0000 7fc389a77740 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c312f0 0x562a73c38750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.059+0000 7fc389a77740 1 --2- 172.21.15.22:0/108051326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c3b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.059+0000 7fc389a77740 1 -- 172.21.15.22:0/108051326 >> 172.21.15.22:0/108051326 conn(0x562a73c2cf60 msgr2=0x562a73c32c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:34.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.059+0000 7fc368ff9640 0 client.15132 ms_handle_reset on v2:172.21.15.22:6840/969125 2024-09-10T08:08:34.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.059+0000 7fc389a77740 1 -- 172.21.15.22:0/108051326 shutdown_connections 2024-09-10T08:08:34.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.059+0000 7fc389a77740 1 -- 172.21.15.22:0/108051326 wait complete. 2024-09-10T08:08:34.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.059+0000 7fc389a77740 20 client.15132 trim_cache size 0 max 16384 2024-09-10T08:08:34.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc389a77740 1 Processor -- start 2024-09-10T08:08:34.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc389a77740 1 -- start start 2024-09-10T08:08:34.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc389a77740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c4cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc389a77740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c38710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc389a77740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c38c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc389a77740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a73c4bde0 con 0x562a73c312f0 2024-09-10T08:08:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc389a77740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562a73c4c4b0 con 0x562a73c3bbb0 2024-09-10T08:08:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc389a77740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562a73c4cb80 con 0x562a73c309d0 2024-09-10T08:08:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc384c39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c38710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc384c39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c38710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40942/0 (socket says 172.21.15.22:40942) 2024-09-10T08:08:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc384c39640 1 -- 172.21.15.22:0/1517397605 learned_addr learned my addr 172.21.15.22:0/1517397605 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc38543a640 1 --2- 172.21.15.22:0/1517397605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c4cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.077+0000 7fc385c3b640 1 --2- 172.21.15.22:0/1517397605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c38c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.078+0000 7fc38543a640 1 -- 172.21.15.22:0/1517397605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 msgr2=0x562a73c38c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.078+0000 7fc38543a640 1 --2- 172.21.15.22:0/1517397605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c38c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.078+0000 7fc38543a640 1 -- 172.21.15.22:0/1517397605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 msgr2=0x562a73c38710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:34.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.078+0000 7fc38543a640 1 --2- 172.21.15.22:0/1517397605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c38710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.078+0000 7fc38543a640 1 -- 172.21.15.22:0/1517397605 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a73c3e300 con 0x562a73c309d0 2024-09-10T08:08:34.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.078+0000 7fc384c39640 1 --2- 172.21.15.22:0/1517397605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c38710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:08:34.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.078+0000 7fc38543a640 1 --2- 172.21.15.22:0/1517397605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c4cd00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009900 tx=0x7fc37c004cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27649c84df2db781 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:34.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.081+0000 7fc36affd640 1 -- 172.21.15.22:0/1517397605 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c035040 con 0x562a73c309d0 2024-09-10T08:08:34.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.081+0000 7fc36affd640 1 -- 172.21.15.22:0/1517397605 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc37c053030 con 0x562a73c309d0 2024-09-10T08:08:34.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.081+0000 7fc36affd640 1 -- 172.21.15.22:0/1517397605 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c003850 con 0x562a73c309d0 2024-09-10T08:08:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.082+0000 7fc389a77740 1 -- 172.21.15.22:0/1517397605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 msgr2=0x562a73c4cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.082+0000 7fc389a77740 1 --2- 172.21.15.22:0/1517397605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c4cd00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009900 tx=0x7fc37c004cf0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.082+0000 7fc389a77740 1 -- 172.21.15.22:0/1517397605 shutdown_connections 2024-09-10T08:08:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.082+0000 7fc389a77740 1 --2- 172.21.15.22:0/1517397605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c38c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.082+0000 7fc389a77740 1 --2- 172.21.15.22:0/1517397605 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c38710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.082+0000 7fc389a77740 1 --2- 172.21.15.22:0/1517397605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c4cd00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.082+0000 7fc389a77740 1 -- 172.21.15.22:0/1517397605 >> 172.21.15.22:0/1517397605 conn(0x562a73c2cf60 msgr2=0x562a73c2d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:34.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.082+0000 7fc389a77740 1 -- 172.21.15.22:0/1517397605 shutdown_connections 2024-09-10T08:08:34.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.082+0000 7fc389a77740 1 -- 172.21.15.22:0/1517397605 wait complete. 2024-09-10T08:08:34.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.082+0000 7fc389a77740 1 -- start start 2024-09-10T08:08:34.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc389a77740 1 Processor -- start 2024-09-10T08:08:34.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc389a77740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c56440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc389a77740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c508f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc389a77740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c50e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc389a77740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562a73c4d920 con 0x562a73c312f0 2024-09-10T08:08:34.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc389a77740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562a73c4d250 con 0x562a73c3bbb0 2024-09-10T08:08:34.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc389a77740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x562a73c4dff0 con 0x562a73c309d0 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc389a77740 10 client.0 _ll_register_callbacks cb 0x7fc3780096d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc384c39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc384c39640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40946/0 (socket says 172.21.15.22:40946) 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc384c39640 1 -- 172.21.15.22:0/1911082067 learned_addr learned my addr 172.21.15.22:0/1911082067 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc38543a640 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c56440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.083+0000 7fc385c3b640 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c50e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc384c39640 1 -- 172.21.15.22:0/1911082067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 msgr2=0x562a73c56440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc384c39640 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c56440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc384c39640 1 -- 172.21.15.22:0/1911082067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 msgr2=0x562a73c50e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc384c39640 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c50e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc384c39640 1 -- 172.21.15.22:0/1911082067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a73c51660 con 0x562a73c312f0 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc384c39640 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c508f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc37000cfd0 tx=0x7fc37009baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f4d3e2e333d4b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:34.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc368ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc368ff9640 1 -- 172.21.15.22:0/1911082067 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3700b4060 con 0x562a73c312f0 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc368ff9640 1 -- 172.21.15.22:0/1911082067 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fc37000fb30 con 0x562a73c312f0 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc389a77740 1 -- 172.21.15.22:0/1911082067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc37c053030 con 0x562a73c312f0 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc368ff9640 1 -- 172.21.15.22:0/1911082067 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc3700af070 con 0x562a73c312f0 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc389a77740 10 client.15138 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc389a77740 1 -- 172.21.15.22:0/1911082067 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562a73cb5d20 con 0x562a73c312f0 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc368ff9640 1 -- 172.21.15.22:0/1911082067 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc37c053030 con 0x562a73c312f0 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc368ff9640 1 -- 172.21.15.22:0/1911082067 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc37009aef0 con 0x562a73c312f0 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc389a77740 10 client.15138 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc389a77740 10 client.15138 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc389a77740 20 client.15138 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.084+0000 7fc389a77740 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x562a73cba930 0x562a73cb9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc389a77740 4 client.15138 mds_command: new command op to 14622 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:08:34.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc389a77740 1 -- 172.21.15.22:0/1911082067 --> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] -- command(tid 0: {"prefix": "status"}) -- 0x562a73b9eb10 con 0x562a73cba930 2024-09-10T08:08:34.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc38543a640 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x562a73cba930 0x562a73cb9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:34.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc368ff9640 10 client.15138 ms_handle_connect on v2:172.21.15.22:6840/969125 2024-09-10T08:08:34.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc38543a640 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x562a73cba930 0x562a73cb9640 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c1a5158f73c3bf74 server_cookie=f29e7385b6eec1bd in_seq=0 out_seq=0 2024-09-10T08:08:34.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc368ff9640 1 -- 172.21.15.22:0/1911082067 <== mds.4 v2:172.21.15.22:6840/969125 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x562a73b9eb10 con 0x562a73cba930 2024-09-10T08:08:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc368ff9640 10 client.15138 handle_command_reply: tid=0 2024-09-10T08:08:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc389a77740 1 client.15138 shutdown 2024-09-10T08:08:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc389a77740 1 -- 172.21.15.22:0/1911082067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 msgr2=0x562a73c508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc389a77740 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c508f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc37000cfd0 tx=0x7fc37009baa0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc389a77740 1 -- 172.21.15.22:0/1911082067 shutdown_connections 2024-09-10T08:08:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc389a77740 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562a73c3bbb0 0x562a73c50e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc389a77740 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.22:6840/969125,v1:172.21.15.22:6841/969125] conn(0x562a73cba930 0x562a73cb9640 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc389a77740 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562a73c312f0 0x562a73c508f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc389a77740 1 --2- 172.21.15.22:0/1911082067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x562a73c309d0 0x562a73c56440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc389a77740 1 -- 172.21.15.22:0/1911082067 >> 172.21.15.22:0/1911082067 conn(0x562a73c2cf60 msgr2=0x562a73c4ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.085+0000 7fc368ff9640 0 client.15138 ms_handle_reset on v2:172.21.15.22:6840/969125 2024-09-10T08:08:34.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc389a77740 1 -- 172.21.15.22:0/1911082067 shutdown_connections 2024-09-10T08:08:34.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc389a77740 1 -- 172.21.15.22:0/1911082067 wait complete. 2024-09-10T08:08:34.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc389a77740 20 client.15138 trim_cache size 0 max 16384 2024-09-10T08:08:34.090 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:08:34.090 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T08:08:34.090 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 4, 2024-09-10T08:08:34.090 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 14622, 2024-09-10T08:08:34.090 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-10T08:08:34.090 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-10T08:08:34.090 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-10T08:08:34.090 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 89.629145738999995, 2024-09-10T08:08:34.090 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-10T08:08:34.091 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 83, 2024-09-10T08:08:34.091 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T08:08:34.091 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 112.54758328 2024-09-10T08:08:34.091 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:08:34.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc38769e640 1 -- 172.21.15.22:0/2576440639 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc36c0a2b80 msgr2=0x7fc36c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:34.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc38769e640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc36c0a2b80 0x7fc36c0a5040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc378005fd0 tx=0x7fc378009d30 comp rx=0 tx=0).stop 2024-09-10T08:08:34.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc38769e640 1 -- 172.21.15.22:0/2576440639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc380102570 msgr2=0x7fc380103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:34.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc38769e640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc380102570 0x7fc380103c90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc37000c920 tx=0x7fc37000cde0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc38769e640 1 -- 172.21.15.22:0/2576440639 shutdown_connections 2024-09-10T08:08:34.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc38769e640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fc36c0a2b80 0x7fc36c0a5040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc38769e640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc380102ef0 0x7fc3801041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc38769e640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc380102570 0x7fc380103c90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc38769e640 1 --2- 172.21.15.22:0/2576440639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc380100e20 0x7fc380103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:34.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.086+0000 7fc38769e640 1 -- 172.21.15.22:0/2576440639 >> 172.21.15.22:0/2576440639 conn(0x7fc3800fc7d0 msgr2=0x7fc38006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:34.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.087+0000 7fc38769e640 1 -- 172.21.15.22:0/2576440639 shutdown_connections 2024-09-10T08:08:34.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:34.087+0000 7fc38769e640 1 -- 172.21.15.22:0/2576440639 wait complete. 2024-09-10T08:08:34.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:34 smithi022 ceph-mon[30854]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-10T08:08:34.345 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:34 smithi153 ceph-mon[35609]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-10T08:08:34.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:34 smithi100 ceph-mon[35102]: pgmap v329: 97 pgs: 97 active+clean; 643 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-10T08:08:34.724 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell mds.e status 2024-09-10T08:08:34.982 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:35.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.458+0000 7fe9a43c0640 1 -- 172.21.15.22:0/2896051652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe99c102da0 msgr2=0x7fe99c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:35.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.458+0000 7fe9a43c0640 1 --2- 172.21.15.22:0/2896051652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe99c102da0 0x7fe99c103180 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe998009900 tx=0x7fe99802a480 comp rx=0 tx=0).stop 2024-09-10T08:08:35.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.458+0000 7fe9a43c0640 1 -- 172.21.15.22:0/2896051652 shutdown_connections 2024-09-10T08:08:35.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.458+0000 7fe9a43c0640 1 --2- 172.21.15.22:0/2896051652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe99c10c180 0x7fe99c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.458+0000 7fe9a43c0640 1 --2- 172.21.15.22:0/2896051652 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe99c1036c0 0x7fe99c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.458+0000 7fe9a43c0640 1 --2- 172.21.15.22:0/2896051652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe99c102da0 0x7fe99c103180 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.458+0000 7fe9a43c0640 1 -- 172.21.15.22:0/2896051652 >> 172.21.15.22:0/2896051652 conn(0x7fe99c0fc7a0 msgr2=0x7fe99c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:35.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.458+0000 7fe9a43c0640 1 -- 172.21.15.22:0/2896051652 shutdown_connections 2024-09-10T08:08:35.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.458+0000 7fe9a43c0640 1 -- 172.21.15.22:0/2896051652 wait complete. 2024-09-10T08:08:35.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a43c0640 1 Processor -- start 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a43c0640 1 -- start start 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a43c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe99c102da0 0x7fe99c1a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a43c0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe99c1036c0 0x7fe99c1a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a43c0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe99c10c180 0x7fe99c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a43c0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c112020 con 0x7fe99c102da0 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a43c0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c111ea0 con 0x7fe99c10c180 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a43c0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c1121a0 con 0x7fe99c1036c0 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a215c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe99c102da0 0x7fe99c1a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a215c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe99c102da0 0x7fe99c1a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40962/0 (socket says 172.21.15.22:40962) 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a215c640 1 -- 172.21.15.22:0/148791232 learned_addr learned my addr 172.21.15.22:0/148791232 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a195b640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe99c1036c0 0x7fe99c1a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a295d640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe99c10c180 0x7fe99c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a215c640 1 -- 172.21.15.22:0/148791232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe99c1036c0 msgr2=0x7fe99c1a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a215c640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe99c1036c0 0x7fe99c1a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a215c640 1 -- 172.21.15.22:0/148791232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe99c10c180 msgr2=0x7fe99c19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.459+0000 7fe9a215c640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe99c10c180 0x7fe99c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.460+0000 7fe9a215c640 1 -- 172.21.15.22:0/148791232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c19aea0 con 0x7fe99c102da0 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.460+0000 7fe9a215c640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe99c102da0 0x7fe99c1a0560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe998005ab0 tx=0x7fe9980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.460+0000 7fe9937fe640 1 -- 172.21.15.22:0/148791232 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99803f030 con 0x7fe99c102da0 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.460+0000 7fe9a43c0640 1 -- 172.21.15.22:0/148791232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99c19b130 con 0x7fe99c102da0 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.460+0000 7fe9937fe640 1 -- 172.21.15.22:0/148791232 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe998003ce0 con 0x7fe99c102da0 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.460+0000 7fe9937fe640 1 -- 172.21.15.22:0/148791232 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe998035070 con 0x7fe99c102da0 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.460+0000 7fe9a43c0640 1 -- 172.21.15.22:0/148791232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99c1a7310 con 0x7fe99c102da0 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.462+0000 7fe9937fe640 1 -- 172.21.15.22:0/148791232 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fe998042030 con 0x7fe99c102da0 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.462+0000 7fe9a6799740 1 Processor -- start 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a6799740 1 -- start start 2024-09-10T08:08:35.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a6799740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a6799740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354aa2f0 0x558a354b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a6799740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 0x558a354b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a6799740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558a35410090 con 0x558a354b4bb0 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a6799740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558a353b7a70 con 0x558a354aa2f0 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a6799740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558a3540c050 con 0x558a354a99d0 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9937fe640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe9880a2c00 0x7fe9880a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a195b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 0x558a354b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a295d640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe9880a2c00 0x7fe9880a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a195b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 0x558a354b6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40964/0 (socket says 172.21.15.22:40964) 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a195b640 1 -- 172.21.15.22:0/3190576745 learned_addr learned my addr 172.21.15.22:0/3190576745 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a295d640 1 --2- 172.21.15.22:0/3190576745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9937fe640 1 -- 172.21.15.22:0/148791232 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe9980ef940 con 0x7fe99c102da0 2024-09-10T08:08:35.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a215c640 1 --2- 172.21.15.22:0/3190576745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354aa2f0 0x558a354b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a195b640 1 -- 172.21.15.22:0/3190576745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 msgr2=0x558a354a9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a195b640 1 --2- 172.21.15.22:0/3190576745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354a9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a195b640 1 -- 172.21.15.22:0/3190576745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354aa2f0 msgr2=0x558a354b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a195b640 1 --2- 172.21.15.22:0/3190576745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354aa2f0 0x558a354b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a195b640 1 -- 172.21.15.22:0/3190576745 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a353c4130 con 0x558a354b4bb0 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a295d640 1 --2- 172.21.15.22:0/3190576745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.463+0000 7fe9a215c640 1 --2- 172.21.15.22:0/3190576745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354aa2f0 0x558a354b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.464+0000 7fe9a195b640 1 --2- 172.21.15.22:0/3190576745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 0x558a354b6fa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009a40 tx=0x7fe98c009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb45dc6962169b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.464+0000 7fe9a295d640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe9880a2c00 0x7fe9880a50c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe994014af0 tx=0x7fe994001450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.464+0000 7fe990dea640 1 -- 172.21.15.22:0/3190576745 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c017070 con 0x558a354b4bb0 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.464+0000 7fe990dea640 1 -- 172.21.15.22:0/3190576745 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe98c013470 con 0x558a354b4bb0 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.464+0000 7fe990dea640 1 -- 172.21.15.22:0/3190576745 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0125d0 con 0x558a354b4bb0 2024-09-10T08:08:35.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 -- 172.21.15.22:0/3190576745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 msgr2=0x558a354b6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:35.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 --2- 172.21.15.22:0/3190576745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 0x558a354b6fa0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009a40 tx=0x7fe98c009f00 comp rx=0 tx=0).stop 2024-09-10T08:08:35.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 -- 172.21.15.22:0/3190576745 shutdown_connections 2024-09-10T08:08:35.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 --2- 172.21.15.22:0/3190576745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 0x558a354b6fa0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 --2- 172.21.15.22:0/3190576745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354aa2f0 0x558a354b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 --2- 172.21.15.22:0/3190576745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354a9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 -- 172.21.15.22:0/3190576745 >> 172.21.15.22:0/3190576745 conn(0x558a354a5f60 msgr2=0x558a354a6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:35.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 -- 172.21.15.22:0/3190576745 shutdown_connections 2024-09-10T08:08:35.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 -- 172.21.15.22:0/3190576745 wait complete. 2024-09-10T08:08:35.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 -- start start 2024-09-10T08:08:35.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 Processor -- start 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354b4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354aa2f0 0x558a354b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 0x558a354b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558a354b7780 con 0x558a354b4bb0 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558a353caf20 con 0x558a354aa2f0 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558a354b7900 con 0x558a354a99d0 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a6799740 10 client.0 _ll_register_callbacks cb 0x558a35394030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a295d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 0x558a354b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a295d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 0x558a354b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40972/0 (socket says 172.21.15.22:40972) 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.465+0000 7fe9a295d640 1 -- 172.21.15.22:0/2419976574 learned_addr learned my addr 172.21.15.22:0/2419976574 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe9a215c640 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe9a195b640 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354aa2f0 0x558a354b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe9a295d640 1 -- 172.21.15.22:0/2419976574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 msgr2=0x558a354b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe9a295d640 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe9a295d640 1 -- 172.21.15.22:0/2419976574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354aa2f0 msgr2=0x558a354b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe9a295d640 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354aa2f0 0x558a354b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe9a295d640 1 -- 172.21.15.22:0/2419976574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a351812b0 con 0x558a354b4bb0 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe9a195b640 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354aa2f0 0x558a354b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe9a295d640 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 0x558a354b1b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe99401a700 tx=0x7fe994004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e050591b74d64b07 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe985ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe985ffb640 1 -- 172.21.15.22:0/2419976574 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994028060 con 0x558a354b4bb0 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe985ffb640 1 -- 172.21.15.22:0/2419976574 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe994018430 con 0x558a354b4bb0 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe9a6799740 1 -- 172.21.15.22:0/2419976574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe98c013470 con 0x558a354b4bb0 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe985ffb640 1 -- 172.21.15.22:0/2419976574 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe9940146e0 con 0x558a354b4bb0 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe9a6799740 10 client.15150 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:35.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.466+0000 7fe9a6799740 1 -- 172.21.15.22:0/2419976574 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a354c2ed0 con 0x558a354b4bb0 2024-09-10T08:08:35.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.467+0000 7fe985ffb640 1 -- 172.21.15.22:0/2419976574 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe98c013470 con 0x558a354b4bb0 2024-09-10T08:08:35.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.467+0000 7fe985ffb640 1 -- 172.21.15.22:0/2419976574 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe99402d070 con 0x558a354b4bb0 2024-09-10T08:08:35.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.467+0000 7fe9a6799740 10 client.15150 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:35.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.467+0000 7fe9a6799740 10 client.15150 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T08:08:35.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.467+0000 7fe9a6799740 20 client.15150 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:35.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.467+0000 7fe9a6799740 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x558a354c5610 0x558a354c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.467+0000 7fe9a6799740 4 client.15150 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:08:35.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.467+0000 7fe9a6799740 1 -- 172.21.15.22:0/2419976574 --> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a3541d600 con 0x558a354c5610 2024-09-10T08:08:35.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.467+0000 7fe9a215c640 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x558a354c5610 0x558a354c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.467+0000 7fe9a215c640 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x558a354c5610 0x558a354c6a80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=39f5e56095756e25 server_cookie=4181ccf5db682941 in_seq=0 out_seq=0 2024-09-10T08:08:35.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.467+0000 7fe985ffb640 10 client.15150 ms_handle_connect on v2:172.21.15.100:6834/800491506 2024-09-10T08:08:35.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe985ffb640 1 -- 172.21.15.22:0/2419976574 <== mds.3 v2:172.21.15.100:6834/800491506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a3541d600 con 0x558a354c5610 2024-09-10T08:08:35.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe985ffb640 10 client.15150 handle_command_reply: tid=0 2024-09-10T08:08:35.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe9a6799740 1 client.15150 shutdown 2024-09-10T08:08:35.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe9a6799740 1 -- 172.21.15.22:0/2419976574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 msgr2=0x558a354b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:35.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe9a6799740 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 0x558a354b1b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe99401a700 tx=0x7fe994004a40 comp rx=0 tx=0).stop 2024-09-10T08:08:35.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe9a6799740 1 -- 172.21.15.22:0/2419976574 shutdown_connections 2024-09-10T08:08:35.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe9a6799740 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x558a354c5610 0x558a354c6a80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe9a6799740 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354b4bb0 0x558a354b1b90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe9a6799740 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354aa2f0 0x558a354b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe985ffb640 0 client.15150 ms_handle_reset on v2:172.21.15.100:6834/800491506 2024-09-10T08:08:35.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe9a6799740 1 --2- 172.21.15.22:0/2419976574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe9a6799740 1 -- 172.21.15.22:0/2419976574 >> 172.21.15.22:0/2419976574 conn(0x558a354a5f60 msgr2=0x558a354abc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:35.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.468+0000 7fe9a6799740 1 -- 172.21.15.22:0/2419976574 shutdown_connections 2024-09-10T08:08:35.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.469+0000 7fe9a6799740 1 -- 172.21.15.22:0/2419976574 wait complete. 2024-09-10T08:08:35.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.469+0000 7fe9a6799740 20 client.15150 trim_cache size 0 max 16384 2024-09-10T08:08:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a6799740 1 Processor -- start 2024-09-10T08:08:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a6799740 1 -- start start 2024-09-10T08:08:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a6799740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a6799740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 0x558a354b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a6799740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354b4bb0 0x558a354b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a6799740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558a354c4dc0 con 0x558a354aa2f0 2024-09-10T08:08:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a6799740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558a354c5490 con 0x558a354b4bb0 2024-09-10T08:08:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a6799740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558a354c5b60 con 0x558a354a99d0 2024-09-10T08:08:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a195b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 0x558a354b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a195b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 0x558a354b1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40988/0 (socket says 172.21.15.22:40988) 2024-09-10T08:08:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a195b640 1 -- 172.21.15.22:0/742276540 learned_addr learned my addr 172.21.15.22:0/742276540 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a215c640 1 --2- 172.21.15.22:0/742276540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a295d640 1 --2- 172.21.15.22:0/742276540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354b4bb0 0x558a354b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a195b640 1 -- 172.21.15.22:0/742276540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 msgr2=0x558a354b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a195b640 1 --2- 172.21.15.22:0/742276540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a195b640 1 -- 172.21.15.22:0/742276540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354b4bb0 msgr2=0x558a354b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a195b640 1 --2- 172.21.15.22:0/742276540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354b4bb0 0x558a354b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a195b640 1 -- 172.21.15.22:0/742276540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a354b3f20 con 0x558a354aa2f0 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.487+0000 7fe9a295d640 1 --2- 172.21.15.22:0/742276540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354b4bb0 0x558a354b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.488+0000 7fe9a195b640 1 --2- 172.21.15.22:0/742276540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 0x558a354b1610 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe98c004810 tx=0x7fe98c0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e32ed4d6a4fb32 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.488+0000 7fe987fff640 1 -- 172.21.15.22:0/742276540 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c017070 con 0x558a354aa2f0 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.488+0000 7fe987fff640 1 -- 172.21.15.22:0/742276540 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe98c00ed40 con 0x558a354aa2f0 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.488+0000 7fe987fff640 1 -- 172.21.15.22:0/742276540 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c01c780 con 0x558a354aa2f0 2024-09-10T08:08:35.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 -- 172.21.15.22:0/742276540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 msgr2=0x558a354b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 --2- 172.21.15.22:0/742276540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 0x558a354b1610 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe98c004810 tx=0x7fe98c0095f0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 -- 172.21.15.22:0/742276540 shutdown_connections 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 --2- 172.21.15.22:0/742276540 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354b4bb0 0x558a354b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 --2- 172.21.15.22:0/742276540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 0x558a354b1610 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 --2- 172.21.15.22:0/742276540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354a99d0 0x558a354b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 -- 172.21.15.22:0/742276540 >> 172.21.15.22:0/742276540 conn(0x558a354a5f60 msgr2=0x558a354a6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 -- 172.21.15.22:0/742276540 shutdown_connections 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 -- 172.21.15.22:0/742276540 wait complete. 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 -- start start 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 Processor -- start 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354a99d0 0x558a354ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 0x558a354abd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354b4bb0 0x558a354cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558a354c6900 con 0x558a354aa2f0 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558a354c6230 con 0x558a354a99d0 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558a354c6fd0 con 0x558a354b4bb0 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.489+0000 7fe9a6799740 10 client.0 _ll_register_callbacks cb 0x7fe994008070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a195b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 0x558a354abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a195b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 0x558a354abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40996/0 (socket says 172.21.15.22:40996) 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a195b640 1 -- 172.21.15.22:0/829976360 learned_addr learned my addr 172.21.15.22:0/829976360 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a295d640 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354b4bb0 0x558a354cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a215c640 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354a99d0 0x558a354ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a195b640 1 -- 172.21.15.22:0/829976360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354b4bb0 msgr2=0x558a354cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a195b640 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354b4bb0 0x558a354cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a195b640 1 -- 172.21.15.22:0/829976360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354a99d0 msgr2=0x558a354ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a195b640 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354a99d0 0x558a354ab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a195b640 1 -- 172.21.15.22:0/829976360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a354ce210 con 0x558a354aa2f0 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a215c640 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354a99d0 0x558a354ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a295d640 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354b4bb0 0x558a354cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a195b640 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 0x558a354abd20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00ef50 tx=0x7fe98c00e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21e616c68a6274b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe985ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe985ffb640 1 -- 172.21.15.22:0/829976360 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c034060 con 0x558a354aa2f0 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe985ffb640 1 -- 172.21.15.22:0/829976360 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fe98c01c6d0 con 0x558a354aa2f0 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a6799740 1 -- 172.21.15.22:0/829976360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe98c00ed40 con 0x558a354aa2f0 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe985ffb640 1 -- 172.21.15.22:0/829976360 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe98c017040 con 0x558a354aa2f0 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a6799740 10 client.15156 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe9a6799740 1 -- 172.21.15.22:0/829976360 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558a354cf480 con 0x558a354aa2f0 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.490+0000 7fe985ffb640 1 -- 172.21.15.22:0/829976360 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe98c00ed40 con 0x558a354aa2f0 2024-09-10T08:08:35.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.491+0000 7fe985ffb640 1 -- 172.21.15.22:0/829976360 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fe98c039070 con 0x558a354aa2f0 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.491+0000 7fe9a6799740 10 client.15156 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.491+0000 7fe9a6799740 10 client.15156 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.491+0000 7fe9a6799740 20 client.15156 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.491+0000 7fe9a6799740 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x558a354c5610 0x558a35532600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.491+0000 7fe9a6799740 4 client.15156 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.491+0000 7fe9a6799740 1 -- 172.21.15.22:0/829976360 --> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] -- command(tid 0: {"prefix": "status"}) -- 0x558a35417b10 con 0x558a354c5610 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.491+0000 7fe9a215c640 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x558a354c5610 0x558a35532600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.491+0000 7fe985ffb640 10 client.15156 ms_handle_connect on v2:172.21.15.100:6834/800491506 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.491+0000 7fe9a215c640 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x558a354c5610 0x558a35532600 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=846a1fed1505d4e0 server_cookie=c328e187d53ce057 in_seq=0 out_seq=0 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe985ffb640 1 -- 172.21.15.22:0/829976360 <== mds.3 v2:172.21.15.100:6834/800491506 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558a35417b10 con 0x558a354c5610 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe985ffb640 10 client.15156 handle_command_reply: tid=0 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe9a6799740 1 client.15156 shutdown 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe9a6799740 1 -- 172.21.15.22:0/829976360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 msgr2=0x558a354abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:35.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe9a6799740 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 0x558a354abd20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00ef50 tx=0x7fe98c00e790 comp rx=0 tx=0).stop 2024-09-10T08:08:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe9a6799740 1 -- 172.21.15.22:0/829976360 shutdown_connections 2024-09-10T08:08:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe9a6799740 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.100:6834/800491506,v1:172.21.15.100:6835/800491506] conn(0x558a354c5610 0x558a35532600 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe9a6799740 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558a354b4bb0 0x558a354cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe9a6799740 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558a354aa2f0 0x558a354abd20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe9a6799740 1 --2- 172.21.15.22:0/829976360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558a354a99d0 0x558a354ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe9a6799740 1 -- 172.21.15.22:0/829976360 >> 172.21.15.22:0/829976360 conn(0x558a354a5f60 msgr2=0x558a354b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe985ffb640 0 client.15156 ms_handle_reset on v2:172.21.15.100:6834/800491506 2024-09-10T08:08:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe9a6799740 1 -- 172.21.15.22:0/829976360 shutdown_connections 2024-09-10T08:08:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe9a6799740 1 -- 172.21.15.22:0/829976360 wait complete. 2024-09-10T08:08:35.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.492+0000 7fe9a6799740 20 client.15156 trim_cache size 0 max 16384 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 3, 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24455, 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 91.057696096000001, 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 83, 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 130.680016717 2024-09-10T08:08:35.505 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:08:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.493+0000 7fe9a43c0640 1 -- 172.21.15.22:0/148791232 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe9880a2c00 msgr2=0x7fe9880a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.493+0000 7fe9a43c0640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe9880a2c00 0x7fe9880a50c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe994014af0 tx=0x7fe994001450 comp rx=0 tx=0).stop 2024-09-10T08:08:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.493+0000 7fe9a43c0640 1 -- 172.21.15.22:0/148791232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe99c102da0 msgr2=0x7fe99c1a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:35.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.493+0000 7fe9a43c0640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe99c102da0 0x7fe99c1a0560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe998005ab0 tx=0x7fe9980042f0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.493+0000 7fe9a43c0640 1 -- 172.21.15.22:0/148791232 shutdown_connections 2024-09-10T08:08:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.493+0000 7fe9a43c0640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fe9880a2c00 0x7fe9880a50c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.493+0000 7fe9a43c0640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe99c10c180 0x7fe99c19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.493+0000 7fe9a43c0640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe99c1036c0 0x7fe99c1a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.493+0000 7fe9a43c0640 1 --2- 172.21.15.22:0/148791232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe99c102da0 0x7fe99c1a0560 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.493+0000 7fe9a43c0640 1 -- 172.21.15.22:0/148791232 >> 172.21.15.22:0/148791232 conn(0x7fe99c0fc7a0 msgr2=0x7fe99c101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.493+0000 7fe9a43c0640 1 -- 172.21.15.22:0/148791232 shutdown_connections 2024-09-10T08:08:35.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:35.493+0000 7fe9a43c0640 1 -- 172.21.15.22:0/148791232 wait complete. 2024-09-10T08:08:36.213 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:36 smithi022 ceph-mon[30854]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T08:08:36.244 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T08:08:36.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:36 smithi100 ceph-mon[35102]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T08:08:36.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:36 smithi153 ceph-mon[35609]: pgmap v330: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T08:08:36.504 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:36.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.992+0000 7f43a6574640 1 -- 172.21.15.22:0/929649727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0101de0 msgr2=0x7f43a01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:36.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.992+0000 7f43a6574640 1 --2- 172.21.15.22:0/929649727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0101de0 0x7f43a01021c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4390009900 tx=0x7f439002a410 comp rx=0 tx=0).stop 2024-09-10T08:08:36.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.992+0000 7f43a6574640 1 -- 172.21.15.22:0/929649727 shutdown_connections 2024-09-10T08:08:36.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.992+0000 7f43a6574640 1 --2- 172.21.15.22:0/929649727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43a0106f10 0x7f43a010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:36.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.992+0000 7f43a6574640 1 --2- 172.21.15.22:0/929649727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a0102790 0x7f43a01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:36.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.992+0000 7f43a6574640 1 --2- 172.21.15.22:0/929649727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0101de0 0x7f43a01021c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:36.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.992+0000 7f43a6574640 1 -- 172.21.15.22:0/929649727 >> 172.21.15.22:0/929649727 conn(0x7f43a00fd8c0 msgr2=0x7f43a00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:36.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.992+0000 7f43a6574640 1 -- 172.21.15.22:0/929649727 shutdown_connections 2024-09-10T08:08:36.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.992+0000 7f43a6574640 1 -- 172.21.15.22:0/929649727 wait complete. 2024-09-10T08:08:36.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.993+0000 7f43a6574640 1 Processor -- start 2024-09-10T08:08:36.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.993+0000 7f43a6574640 1 -- start start 2024-09-10T08:08:36.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.993+0000 7f43a6574640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0101de0 0x7f43a01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:36.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.993+0000 7f43a6574640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43a0102790 0x7f43a0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:36.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.993+0000 7f43a6574640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a0106f10 0x7f43a019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:36.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.993+0000 7f43a6574640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43a0112010 con 0x7f43a0101de0 2024-09-10T08:08:36.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.993+0000 7f43a6574640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f43a0111e90 con 0x7f43a0106f10 2024-09-10T08:08:36.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.993+0000 7f43a6574640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f43a0112190 con 0x7f43a0102790 2024-09-10T08:08:36.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.993+0000 7f439ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0101de0 0x7f43a01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:36.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f439ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0101de0 0x7f43a01985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41020/0 (socket says 172.21.15.22:41020) 2024-09-10T08:08:36.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f439ffff640 1 -- 172.21.15.22:0/2023587725 learned_addr learned my addr 172.21.15.22:0/2023587725 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:36.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f43a4b11640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a0106f10 0x7f43a019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:36.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f4397fff640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43a0102790 0x7f43a0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:36.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f439ffff640 1 -- 172.21.15.22:0/2023587725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43a0102790 msgr2=0x7f43a0198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:36.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f439ffff640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43a0102790 0x7f43a0198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:36.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f439ffff640 1 -- 172.21.15.22:0/2023587725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a0106f10 msgr2=0x7f43a019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:36.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f439ffff640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a0106f10 0x7f43a019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:36.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f439ffff640 1 -- 172.21.15.22:0/2023587725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a019d560 con 0x7f43a0101de0 2024-09-10T08:08:36.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f43a4b11640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a0106f10 0x7f43a019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:36.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f439ffff640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0101de0 0x7f43a01985b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4390005ab0 tx=0x7f43900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:36.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f439dffb640 1 -- 172.21.15.22:0/2023587725 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439003f030 con 0x7f43a0101de0 2024-09-10T08:08:36.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f43a6574640 1 -- 172.21.15.22:0/2023587725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a019d7f0 con 0x7f43a0101de0 2024-09-10T08:08:36.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f439dffb640 1 -- 172.21.15.22:0/2023587725 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4390003ce0 con 0x7f43a0101de0 2024-09-10T08:08:36.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f439dffb640 1 -- 172.21.15.22:0/2023587725 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4390035070 con 0x7f43a0101de0 2024-09-10T08:08:36.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.994+0000 7f43a6574640 1 -- 172.21.15.22:0/2023587725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a01a5130 con 0x7f43a0101de0 2024-09-10T08:08:37.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f439dffb640 1 -- 172.21.15.22:0/2023587725 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f4390042030 con 0x7f43a0101de0 2024-09-10T08:08:37.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f43a894d740 1 Processor -- start 2024-09-10T08:08:37.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f43a894d740 1 -- start start 2024-09-10T08:08:37.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f43a894d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c657f9d0 0x5653c657fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f43a894d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 0x5653c658a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f43a894d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c658cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f43a894d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5653c64e6090 con 0x5653c65802f0 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f43a894d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5653c648da70 con 0x5653c658abb0 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f43a894d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5653c64e2050 con 0x5653c657f9d0 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f439ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 0x5653c658a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f439ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 0x5653c658a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41028/0 (socket says 172.21.15.22:41028) 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f439ffff640 1 -- 172.21.15.22:0/2359248780 learned_addr learned my addr 172.21.15.22:0/2359248780 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f4397fff640 1 --2- 172.21.15.22:0/2359248780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c658cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.997+0000 7f43a4b11640 1 --2- 172.21.15.22:0/2359248780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c657f9d0 0x5653c657fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f439ffff640 1 -- 172.21.15.22:0/2359248780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c657f9d0 msgr2=0x5653c657fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f439dffb640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f438c0a2b80 0x7f438c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f439ffff640 1 --2- 172.21.15.22:0/2359248780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c657f9d0 0x5653c657fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f439ffff640 1 -- 172.21.15.22:0/2359248780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 msgr2=0x5653c658cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f439ffff640 1 --2- 172.21.15.22:0/2359248780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c658cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f439ffff640 1 -- 172.21.15.22:0/2359248780 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653c649a130 con 0x5653c65802f0 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f4397fff640 1 --2- 172.21.15.22:0/2359248780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c658cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f43a4b11640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f438c0a2b80 0x7f438c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f439dffb640 1 -- 172.21.15.22:0/2023587725 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f43900efa00 con 0x7f43a0101de0 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f439ffff640 1 --2- 172.21.15.22:0/2359248780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 0x5653c658a670 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f43900c0a20 tx=0x7f43900b82f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bba24fe44bf5859 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f43967fc640 1 -- 172.21.15.22:0/2359248780 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43900dae60 con 0x5653c65802f0 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f43967fc640 1 -- 172.21.15.22:0/2359248780 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f43900c05d0 con 0x5653c65802f0 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.998+0000 7f43967fc640 1 -- 172.21.15.22:0/2359248780 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43900bbd60 con 0x5653c65802f0 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.999+0000 7f43a894d740 1 -- 172.21.15.22:0/2359248780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 msgr2=0x5653c658a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.999+0000 7f43a4b11640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f438c0a2b80 0x7f438c0a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f439800a5a0 tx=0x7f4398004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.999+0000 7f43a894d740 1 --2- 172.21.15.22:0/2359248780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 0x5653c658a670 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f43900c0a20 tx=0x7f43900b82f0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.999+0000 7f43a894d740 1 -- 172.21.15.22:0/2359248780 shutdown_connections 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.999+0000 7f43a894d740 1 --2- 172.21.15.22:0/2359248780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c658cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.999+0000 7f43a894d740 1 --2- 172.21.15.22:0/2359248780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 0x5653c658a670 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.999+0000 7f43a894d740 1 --2- 172.21.15.22:0/2359248780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c657f9d0 0x5653c657fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.999+0000 7f43a894d740 1 -- 172.21.15.22:0/2359248780 >> 172.21.15.22:0/2359248780 conn(0x5653c657bf60 msgr2=0x5653c657c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.999+0000 7f43a894d740 1 -- 172.21.15.22:0/2359248780 shutdown_connections 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.999+0000 7f43a894d740 1 -- 172.21.15.22:0/2359248780 wait complete. 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:36.999+0000 7f43a894d740 1 -- start start 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f43a894d740 1 Processor -- start 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f43a894d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 0x5653c658a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f43a894d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c65802f0 0x5653c6587810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f43a894d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c6587d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f43a894d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5653c6591950 con 0x5653c657f9d0 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f43a894d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5653c64a0f20 con 0x5653c658abb0 2024-09-10T08:08:37.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f43a894d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5653c6591ad0 con 0x5653c65802f0 2024-09-10T08:08:37.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f43a894d740 10 client.0 _ll_register_callbacks cb 0x5653c646a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:37.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f439ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 0x5653c658a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f439ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 0x5653c658a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41042/0 (socket says 172.21.15.22:41042) 2024-09-10T08:08:37.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f439ffff640 1 -- 172.21.15.22:0/2134783095 learned_addr learned my addr 172.21.15.22:0/2134783095 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:37.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f43a4b11640 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c6587d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f4397fff640 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c65802f0 0x5653c6587810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f439ffff640 1 -- 172.21.15.22:0/2134783095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c65802f0 msgr2=0x5653c6587810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:37.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f439ffff640 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c65802f0 0x5653c6587810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f439ffff640 1 -- 172.21.15.22:0/2134783095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 msgr2=0x5653c6587d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:37.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f439ffff640 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c6587d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.000+0000 7f439ffff640 1 -- 172.21.15.22:0/2134783095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653c62572b0 con 0x5653c657f9d0 2024-09-10T08:08:37.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f439ffff640 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 0x5653c658a4c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f439002a450 tx=0x7f43900f5620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6515ac8bcf90f2c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:37.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f437f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:37.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f437f7fe640 1 -- 172.21.15.22:0/2134783095 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4390049070 con 0x5653c657f9d0 2024-09-10T08:08:37.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f437f7fe640 1 -- 172.21.15.22:0/2134783095 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f439003bd70 con 0x5653c657f9d0 2024-09-10T08:08:37.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f43a894d740 1 -- 172.21.15.22:0/2134783095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5653c64f3600 con 0x5653c657f9d0 2024-09-10T08:08:37.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f437f7fe640 1 -- 172.21.15.22:0/2134783095 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f43900dae60 con 0x5653c657f9d0 2024-09-10T08:08:37.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f43a894d740 10 client.15168 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:37.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f43a894d740 1 -- 172.21.15.22:0/2134783095 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5653c6591950 con 0x5653c657f9d0 2024-09-10T08:08:37.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f437f7fe640 1 -- 172.21.15.22:0/2134783095 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5653c64f3600 con 0x5653c657f9d0 2024-09-10T08:08:37.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f437f7fe640 1 -- 172.21.15.22:0/2134783095 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f43900b8890 con 0x5653c657f9d0 2024-09-10T08:08:37.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f43a894d740 10 client.15168 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:37.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f43a894d740 10 client.15168 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T08:08:37.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f43a894d740 20 client.15168 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:37.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f43a894d740 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x5653c659f670 0x5653c65a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f43a894d740 4 client.15168 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:08:37.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.001+0000 7f43a894d740 1 -- 172.21.15.22:0/2134783095 --> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653c64edb10 con 0x5653c659f670 2024-09-10T08:08:37.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.002+0000 7f4397fff640 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x5653c659f670 0x5653c65a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.002+0000 7f437f7fe640 10 client.15168 ms_handle_connect on v2:172.21.15.153:6838/1766856743 2024-09-10T08:08:37.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.002+0000 7f4397fff640 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x5653c659f670 0x5653c65a0ae0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33f44d1d0815e0a server_cookie=af67b1f7440dd928 in_seq=0 out_seq=0 2024-09-10T08:08:37.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.003+0000 7f437f7fe640 1 -- 172.21.15.22:0/2134783095 <== mds.2 v2:172.21.15.153:6838/1766856743 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5653c64edb10 con 0x5653c659f670 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.003+0000 7f437f7fe640 10 client.15168 handle_command_reply: tid=0 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.003+0000 7f43a894d740 1 client.15168 shutdown 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.003+0000 7f43a894d740 1 -- 172.21.15.22:0/2134783095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 msgr2=0x5653c658a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.003+0000 7f43a894d740 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 0x5653c658a4c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f439002a450 tx=0x7f43900f5620 comp rx=0 tx=0).stop 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.003+0000 7f43a894d740 1 -- 172.21.15.22:0/2134783095 shutdown_connections 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.003+0000 7f43a894d740 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c6587d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.003+0000 7f43a894d740 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c65802f0 0x5653c6587810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.003+0000 7f43a894d740 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x5653c659f670 0x5653c65a0ae0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.003+0000 7f43a894d740 1 --2- 172.21.15.22:0/2134783095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 0x5653c658a4c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.003+0000 7f437f7fe640 0 client.15168 ms_handle_reset on v2:172.21.15.153:6838/1766856743 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.003+0000 7f43a894d740 1 -- 172.21.15.22:0/2134783095 >> 172.21.15.22:0/2134783095 conn(0x5653c657bf60 msgr2=0x5653c6581c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.004+0000 7f43a894d740 1 -- 172.21.15.22:0/2134783095 shutdown_connections 2024-09-10T08:08:37.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.004+0000 7f43a894d740 1 -- 172.21.15.22:0/2134783095 wait complete. 2024-09-10T08:08:37.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.004+0000 7f43a894d740 20 client.15168 trim_cache size 0 max 16384 2024-09-10T08:08:37.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.021+0000 7f43a894d740 1 Processor -- start 2024-09-10T08:08:37.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.021+0000 7f43a894d740 1 -- start start 2024-09-10T08:08:37.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f43a894d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c657f9d0 0x5653c65a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f43a894d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 0x5653c65a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f43a894d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c65a9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f43a894d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5653c659ee20 con 0x5653c65802f0 2024-09-10T08:08:37.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f43a894d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5653c659f4f0 con 0x5653c658abb0 2024-09-10T08:08:37.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f43a894d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5653c659fbc0 con 0x5653c657f9d0 2024-09-10T08:08:37.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f4397fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 0x5653c65a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f4397fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 0x5653c65a8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41046/0 (socket says 172.21.15.22:41046) 2024-09-10T08:08:37.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f4397fff640 1 -- 172.21.15.22:0/2200629513 learned_addr learned my addr 172.21.15.22:0/2200629513 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:37.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f43a4b11640 1 --2- 172.21.15.22:0/2200629513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c65a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f439ffff640 1 --2- 172.21.15.22:0/2200629513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c657f9d0 0x5653c65a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f4397fff640 1 -- 172.21.15.22:0/2200629513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c657f9d0 msgr2=0x5653c65a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:37.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f4397fff640 1 --2- 172.21.15.22:0/2200629513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c657f9d0 0x5653c65a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f4397fff640 1 -- 172.21.15.22:0/2200629513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 msgr2=0x5653c65a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:37.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f4397fff640 1 --2- 172.21.15.22:0/2200629513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c65a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f4397fff640 1 -- 172.21.15.22:0/2200629513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653c6580120 con 0x5653c65802f0 2024-09-10T08:08:37.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f439ffff640 1 --2- 172.21.15.22:0/2200629513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c657f9d0 0x5653c65a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:37.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f4397fff640 1 --2- 172.21.15.22:0/2200629513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 0x5653c65a8dc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x5653c657d2e0 tx=0x7f438800deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7faa9b9e34f4e284 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:37.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f4395ffb640 1 -- 172.21.15.22:0/2200629513 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388016a60 con 0x5653c65802f0 2024-09-10T08:08:37.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f4395ffb640 1 -- 172.21.15.22:0/2200629513 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f438801f030 con 0x5653c65802f0 2024-09-10T08:08:37.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.022+0000 7f4395ffb640 1 -- 172.21.15.22:0/2200629513 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43880143b0 con 0x5653c65802f0 2024-09-10T08:08:37.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.023+0000 7f43a894d740 1 -- 172.21.15.22:0/2200629513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 msgr2=0x5653c65a8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:37.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.023+0000 7f43a894d740 1 --2- 172.21.15.22:0/2200629513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 0x5653c65a8dc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x5653c657d2e0 tx=0x7f438800deb0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.023+0000 7f43a894d740 1 -- 172.21.15.22:0/2200629513 shutdown_connections 2024-09-10T08:08:37.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.023+0000 7f43a894d740 1 --2- 172.21.15.22:0/2200629513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c658abb0 0x5653c65a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.023+0000 7f43a894d740 1 --2- 172.21.15.22:0/2200629513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c65802f0 0x5653c65a8dc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.023+0000 7f43a894d740 1 --2- 172.21.15.22:0/2200629513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c657f9d0 0x5653c65a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.023+0000 7f43a894d740 1 -- 172.21.15.22:0/2200629513 >> 172.21.15.22:0/2200629513 conn(0x5653c657bf60 msgr2=0x5653c65860e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.023+0000 7f43a894d740 1 -- 172.21.15.22:0/2200629513 shutdown_connections 2024-09-10T08:08:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.023+0000 7f43a894d740 1 -- 172.21.15.22:0/2200629513 wait complete. 2024-09-10T08:08:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.023+0000 7f43a894d740 1 -- start start 2024-09-10T08:08:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f43a894d740 1 Processor -- start 2024-09-10T08:08:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f43a894d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 0x5653c65a3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f43a894d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c65802f0 0x5653c65a4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f43a894d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c658abb0 0x5653c65a4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f43a894d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5653c65a0960 con 0x5653c657f9d0 2024-09-10T08:08:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f43a894d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5653c65a0290 con 0x5653c65802f0 2024-09-10T08:08:37.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f43a894d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5653c65a1030 con 0x5653c658abb0 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f439ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 0x5653c65a3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f43a894d740 10 client.0 _ll_register_callbacks cb 0x7f43900f59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f439ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 0x5653c65a3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41062/0 (socket says 172.21.15.22:41062) 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f439ffff640 1 -- 172.21.15.22:0/4156343142 learned_addr learned my addr 172.21.15.22:0/4156343142 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f4397fff640 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c65802f0 0x5653c65a4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f43a4b11640 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c658abb0 0x5653c65a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f439ffff640 1 -- 172.21.15.22:0/4156343142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c658abb0 msgr2=0x5653c65a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.024+0000 7f439ffff640 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c658abb0 0x5653c65a4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f439ffff640 1 -- 172.21.15.22:0/4156343142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c65802f0 msgr2=0x5653c65a4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f439ffff640 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c65802f0 0x5653c65a4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f439ffff640 1 -- 172.21.15.22:0/4156343142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653c6607df0 con 0x5653c657f9d0 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f4397fff640 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c65802f0 0x5653c65a4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:37.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f439ffff640 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 0x5653c65a3b00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f43900b8bf0 tx=0x7f43900f5300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9aacc45f1eaa00e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f437f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f437f7fe640 1 -- 172.21.15.22:0/4156343142 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4390049040 con 0x5653c657f9d0 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f437f7fe640 1 -- 172.21.15.22:0/4156343142 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f43900ed5d0 con 0x5653c657f9d0 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f43a894d740 1 -- 172.21.15.22:0/4156343142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f438801f030 con 0x5653c657f9d0 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f43a4b11640 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c658abb0 0x5653c65a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f437f7fe640 1 -- 172.21.15.22:0/4156343142 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f43900bbb80 con 0x5653c657f9d0 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f43a894d740 10 client.15174 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f43a894d740 1 -- 172.21.15.22:0/4156343142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5653c6607df0 con 0x5653c657f9d0 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f437f7fe640 1 -- 172.21.15.22:0/4156343142 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f438801f030 con 0x5653c657f9d0 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f437f7fe640 1 -- 172.21.15.22:0/4156343142 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f439003b460 con 0x5653c657f9d0 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f43a894d740 10 client.15174 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f43a894d740 10 client.15174 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.025+0000 7f43a894d740 20 client.15174 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:37.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.026+0000 7f43a894d740 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x5653c660d850 0x5653c660c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.026+0000 7f43a894d740 4 client.15174 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.026+0000 7f43a894d740 1 -- 172.21.15.22:0/4156343142 --> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] -- command(tid 0: {"prefix": "status"}) -- 0x5653c646a0e0 con 0x5653c660d850 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.026+0000 7f4397fff640 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x5653c660d850 0x5653c660c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.026+0000 7f4397fff640 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x5653c660d850 0x5653c660c560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=58bc3e7ffa66f29e server_cookie=2f79e1ee97d90e70 in_seq=0 out_seq=0 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.026+0000 7f437f7fe640 10 client.15174 ms_handle_connect on v2:172.21.15.153:6838/1766856743 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.026+0000 7f437f7fe640 1 -- 172.21.15.22:0/4156343142 <== mds.2 v2:172.21.15.153:6838/1766856743 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5653c646a0e0 con 0x5653c660d850 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.026+0000 7f437f7fe640 10 client.15174 handle_command_reply: tid=0 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.026+0000 7f43a894d740 1 client.15174 shutdown 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.027+0000 7f43a894d740 1 -- 172.21.15.22:0/4156343142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 msgr2=0x5653c65a3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.027+0000 7f43a894d740 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 0x5653c65a3b00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f43900b8bf0 tx=0x7f43900f5300 comp rx=0 tx=0).stop 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.027+0000 7f43a894d740 1 -- 172.21.15.22:0/4156343142 shutdown_connections 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.027+0000 7f43a894d740 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653c658abb0 0x5653c65a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.027+0000 7f43a894d740 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5653c65802f0 0x5653c65a4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.027+0000 7f43a894d740 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.153:6838/1766856743,v1:172.21.15.153:6839/1766856743] conn(0x5653c660d850 0x5653c660c560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.027+0000 7f43a894d740 1 --2- 172.21.15.22:0/4156343142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5653c657f9d0 0x5653c65a3b00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.027+0000 7f43a894d740 1 -- 172.21.15.22:0/4156343142 >> 172.21.15.22:0/4156343142 conn(0x5653c657bf60 msgr2=0x5653c65864c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:37.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.027+0000 7f437f7fe640 0 client.15174 ms_handle_reset on v2:172.21.15.153:6838/1766856743 2024-09-10T08:08:37.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.027+0000 7f43a894d740 1 -- 172.21.15.22:0/4156343142 shutdown_connections 2024-09-10T08:08:37.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.027+0000 7f43a894d740 1 -- 172.21.15.22:0/4156343142 wait complete. 2024-09-10T08:08:37.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.027+0000 7f43a894d740 20 client.15174 trim_cache size 0 max 16384 2024-09-10T08:08:37.032 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:08:37.032 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T08:08:37.033 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 2, 2024-09-10T08:08:37.033 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24469, 2024-09-10T08:08:37.033 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-10T08:08:37.033 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-10T08:08:37.033 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-10T08:08:37.033 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 93.599440193000007, 2024-09-10T08:08:37.033 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-10T08:08:37.033 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 83, 2024-09-10T08:08:37.033 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T08:08:37.033 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 121.538052056 2024-09-10T08:08:37.033 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:08:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.028+0000 7f43a6574640 1 -- 172.21.15.22:0/2023587725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f438c0a2b80 msgr2=0x7f438c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.028+0000 7f43a6574640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f438c0a2b80 0x7f438c0a5040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f439800a5a0 tx=0x7f4398004a40 comp rx=0 tx=0).stop 2024-09-10T08:08:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.028+0000 7f43a6574640 1 -- 172.21.15.22:0/2023587725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0101de0 msgr2=0x7f43a01985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.028+0000 7f43a6574640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0101de0 0x7f43a01985b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4390005ab0 tx=0x7f43900042f0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.028+0000 7f43a6574640 1 -- 172.21.15.22:0/2023587725 shutdown_connections 2024-09-10T08:08:37.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.028+0000 7f43a6574640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f438c0a2b80 0x7f438c0a5040 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.028+0000 7f43a6574640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43a0106f10 0x7f43a019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.028+0000 7f43a6574640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43a0102790 0x7f43a0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.028+0000 7f43a6574640 1 --2- 172.21.15.22:0/2023587725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43a0101de0 0x7f43a01985b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.028+0000 7f43a6574640 1 -- 172.21.15.22:0/2023587725 >> 172.21.15.22:0/2023587725 conn(0x7f43a00fd8c0 msgr2=0x7f43a00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.028+0000 7f43a6574640 1 -- 172.21.15.22:0/2023587725 shutdown_connections 2024-09-10T08:08:37.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:37.028+0000 7f43a6574640 1 -- 172.21.15.22:0/2023587725 wait complete. 2024-09-10T08:08:37.878 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T08:08:38.137 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:38.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:38 smithi022 ceph-mon[30854]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T08:08:38.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:38 smithi100 ceph-mon[35102]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T08:08:38.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:38 smithi153 ceph-mon[35609]: pgmap v331: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T08:08:38.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.620+0000 7f02be920640 1 -- 172.21.15.22:0/3386413905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b8106f10 msgr2=0x7f02b810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:38.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.620+0000 7f02be920640 1 --2- 172.21.15.22:0/3386413905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b8106f10 0x7f02b810ea90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009ca0 tx=0x7f02b002a8c0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.620+0000 7f02be920640 1 -- 172.21.15.22:0/3386413905 shutdown_connections 2024-09-10T08:08:38.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.620+0000 7f02be920640 1 --2- 172.21.15.22:0/3386413905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b8106f10 0x7f02b810ea90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.620+0000 7f02be920640 1 --2- 172.21.15.22:0/3386413905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b8102790 0x7f02b81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.620+0000 7f02be920640 1 --2- 172.21.15.22:0/3386413905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02b8101de0 0x7f02b81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.620+0000 7f02be920640 1 -- 172.21.15.22:0/3386413905 >> 172.21.15.22:0/3386413905 conn(0x7f02b80fd8c0 msgr2=0x7f02b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:38.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.620+0000 7f02be920640 1 -- 172.21.15.22:0/3386413905 shutdown_connections 2024-09-10T08:08:38.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.620+0000 7f02be920640 1 -- 172.21.15.22:0/3386413905 wait complete. 2024-09-10T08:08:38.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.620+0000 7f02be920640 1 Processor -- start 2024-09-10T08:08:38.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02be920640 1 -- start start 2024-09-10T08:08:38.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02be920640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b8101de0 0x7f02b80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02be920640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b8102790 0x7f02b8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02be920640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02b8106f10 0x7f02b8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02be920640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f02b8111f70 con 0x7f02b8102790 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02be920640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f02b8111df0 con 0x7f02b8101de0 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02be920640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f02b81120f0 con 0x7f02b8106f10 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02b77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b8102790 0x7f02b8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02b77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b8102790 0x7f02b8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41076/0 (socket says 172.21.15.22:41076) 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02b77fe640 1 -- 172.21.15.22:0/1467977931 learned_addr learned my addr 172.21.15.22:0/1467977931 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02b7fff640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b8101de0 0x7f02b80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02bcebd640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02b8106f10 0x7f02b8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02b77fe640 1 -- 172.21.15.22:0/1467977931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02b8106f10 msgr2=0x7f02b8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02b77fe640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02b8106f10 0x7f02b8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02b77fe640 1 -- 172.21.15.22:0/1467977931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b8101de0 msgr2=0x7f02b80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02b77fe640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b8101de0 0x7f02b80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02b77fe640 1 -- 172.21.15.22:0/1467977931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b81a68e0 con 0x7f02b8102790 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02bcebd640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02b8106f10 0x7f02b8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.621+0000 7f02b7fff640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b8101de0 0x7f02b80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.622+0000 7f02b77fe640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b8102790 0x7f02b8074a30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00d950 tx=0x7f02ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.622+0000 7f02b57fa640 1 -- 172.21.15.22:0/1467977931 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac017070 con 0x7f02b8102790 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.622+0000 7f02be920640 1 -- 172.21.15.22:0/1467977931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02b81a6bd0 con 0x7f02b8102790 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.622+0000 7f02b57fa640 1 -- 172.21.15.22:0/1467977931 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02ac009c30 con 0x7f02b8102790 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.622+0000 7f02be920640 1 -- 172.21.15.22:0/1467977931 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02b81a7160 con 0x7f02b8102790 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.622+0000 7f02b57fa640 1 -- 172.21.15.22:0/1467977931 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00f6b0 con 0x7f02b8102790 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.624+0000 7f02b57fa640 1 -- 172.21.15.22:0/1467977931 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f02ac0109d0 con 0x7f02b8102790 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.624+0000 7f02c0cf9740 1 Processor -- start 2024-09-10T08:08:38.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02c0cf9740 1 -- start start 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02c0cf9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4829d0 0x55cd2d482db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02c0cf9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4832f0 0x55cd2d48d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02c0cf9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d48dbb0 0x55cd2d48ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02c0cf9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d3e9090 con 0x55cd2d4829d0 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02c0cf9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d390a70 con 0x55cd2d48dbb0 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02c0cf9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d3e5050 con 0x55cd2d4832f0 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02bcebd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4829d0 0x55cd2d482db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02bcebd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4829d0 0x55cd2d482db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41092/0 (socket says 172.21.15.22:41092) 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02bcebd640 1 -- 172.21.15.22:0/1545026835 learned_addr learned my addr 172.21.15.22:0/1545026835 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02b57fa640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f02a00a2b80 0x7f02a00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02b7fff640 1 --2- 172.21.15.22:0/1545026835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4832f0 0x55cd2d48d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02b77fe640 1 --2- 172.21.15.22:0/1545026835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d48dbb0 0x55cd2d48ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02bcebd640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f02a00a2b80 0x7f02a00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02b57fa640 1 -- 172.21.15.22:0/1467977931 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f02ac0cf050 con 0x7f02b8102790 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02bcebd640 1 -- 172.21.15.22:0/1545026835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4832f0 msgr2=0x55cd2d48d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02bcebd640 1 --2- 172.21.15.22:0/1545026835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4832f0 0x55cd2d48d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02bcebd640 1 -- 172.21.15.22:0/1545026835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d48dbb0 msgr2=0x55cd2d48ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.625+0000 7f02bcebd640 1 --2- 172.21.15.22:0/1545026835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d48dbb0 0x55cd2d48ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.626+0000 7f02bcebd640 1 -- 172.21.15.22:0/1545026835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd2d39d130 con 0x55cd2d4829d0 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.626+0000 7f02b77fe640 1 --2- 172.21.15.22:0/1545026835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d48dbb0 0x55cd2d48ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.626+0000 7f02bcebd640 1 --2- 172.21.15.22:0/1545026835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4829d0 0x55cd2d482db0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f02b0004af0 tx=0x7f02b0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c7043850b398e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.626+0000 7f029e7fc640 1 -- 172.21.15.22:0/1545026835 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b00098a0 con 0x55cd2d4829d0 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.626+0000 7f02bcebd640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f02a00a2b80 0x7f02a00a5040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f02b0046000 tx=0x7f02b0048000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.626+0000 7f029e7fc640 1 -- 172.21.15.22:0/1545026835 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02b0036070 con 0x55cd2d4829d0 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.626+0000 7f029e7fc640 1 -- 172.21.15.22:0/1545026835 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b002f9b0 con 0x55cd2d4829d0 2024-09-10T08:08:38.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.627+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1545026835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4829d0 msgr2=0x55cd2d482db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.627+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/1545026835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4829d0 0x55cd2d482db0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f02b0004af0 tx=0x7f02b0003970 comp rx=0 tx=0).stop 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.627+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1545026835 shutdown_connections 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.627+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/1545026835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d48dbb0 0x55cd2d48ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.627+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/1545026835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4832f0 0x55cd2d48d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.627+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/1545026835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4829d0 0x55cd2d482db0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.627+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1545026835 >> 172.21.15.22:0/1545026835 conn(0x55cd2d47ef60 msgr2=0x55cd2d47f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.627+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1545026835 shutdown_connections 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.627+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1545026835 wait complete. 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.627+0000 7f02c0cf9740 1 -- start start 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.627+0000 7f02c0cf9740 1 Processor -- start 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02c0cf9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4829d0 0x55cd2d48d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02c0cf9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d4832f0 0x55cd2d48a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02c0cf9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 0x55cd2d48ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02c0cf9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d490780 con 0x55cd2d48dbb0 2024-09-10T08:08:38.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02c0cf9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d3a3f20 con 0x55cd2d4832f0 2024-09-10T08:08:38.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02c0cf9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d490900 con 0x55cd2d4829d0 2024-09-10T08:08:38.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02c0cf9740 10 client.0 _ll_register_callbacks cb 0x55cd2d36d030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:38.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02bcebd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 0x55cd2d48ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02bcebd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 0x55cd2d48ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41098/0 (socket says 172.21.15.22:41098) 2024-09-10T08:08:38.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02bcebd640 1 -- 172.21.15.22:0/1512992691 learned_addr learned my addr 172.21.15.22:0/1512992691 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:38.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02b77fe640 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d4832f0 0x55cd2d48a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02b7fff640 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4829d0 0x55cd2d48d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02bcebd640 1 -- 172.21.15.22:0/1512992691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4829d0 msgr2=0x55cd2d48d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:38.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02bcebd640 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4829d0 0x55cd2d48d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02bcebd640 1 -- 172.21.15.22:0/1512992691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d4832f0 msgr2=0x55cd2d48a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:38.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02bcebd640 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d4832f0 0x55cd2d48a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02bcebd640 1 -- 172.21.15.22:0/1512992691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd2d15a2b0 con 0x55cd2d48dbb0 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02bcebd640 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 0x55cd2d48ac80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009bf0 tx=0x7f02b0004900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9137caf486fe28ad server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.628+0000 7f02977fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02977fe640 1 -- 172.21.15.22:0/1512992691 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0058030 con 0x55cd2d48dbb0 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1512992691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02b0036070 con 0x55cd2d48dbb0 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02977fe640 1 -- 172.21.15.22:0/1512992691 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f02b0031820 con 0x55cd2d48dbb0 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02977fe640 1 -- 172.21.15.22:0/1512992691 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02b0031bb0 con 0x55cd2d48dbb0 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02c0cf9740 10 client.15186 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1512992691 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd2d490780 con 0x55cd2d48dbb0 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02977fe640 1 -- 172.21.15.22:0/1512992691 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02b0036070 con 0x55cd2d48dbb0 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02977fe640 1 -- 172.21.15.22:0/1512992691 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f02b00305c0 con 0x55cd2d48dbb0 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02c0cf9740 10 client.15186 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02c0cf9740 10 client.15186 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T08:08:38.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02c0cf9740 20 client.15186 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55cd2d49e5d0 0x55cd2d49fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02c0cf9740 4 client.15186 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.629+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1512992691 --> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd2d3f6600 con 0x55cd2d49e5d0 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.630+0000 7f02b7fff640 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55cd2d49e5d0 0x55cd2d49fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.630+0000 7f02b7fff640 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55cd2d49e5d0 0x55cd2d49fa40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e47df4ce00b1ea0f server_cookie=2123f6e37bbc6d8e in_seq=0 out_seq=0 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.630+0000 7f02977fe640 10 client.15186 ms_handle_connect on v2:172.21.15.100:6836/1987693702 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02977fe640 1 -- 172.21.15.22:0/1512992691 <== mds.1 v2:172.21.15.100:6836/1987693702 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd2d3f6600 con 0x55cd2d49e5d0 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02977fe640 10 client.15186 handle_command_reply: tid=0 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02c0cf9740 1 client.15186 shutdown 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1512992691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 msgr2=0x55cd2d48ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 0x55cd2d48ac80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f02b0009bf0 tx=0x7f02b0004900 comp rx=0 tx=0).stop 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1512992691 shutdown_connections 2024-09-10T08:08:38.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 0x55cd2d48ac80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d4832f0 0x55cd2d48a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55cd2d49e5d0 0x55cd2d49fa40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02977fe640 0 client.15186 ms_handle_reset on v2:172.21.15.100:6836/1987693702 2024-09-10T08:08:38.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/1512992691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4829d0 0x55cd2d48d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1512992691 >> 172.21.15.22:0/1512992691 conn(0x55cd2d47ef60 msgr2=0x55cd2d484c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:38.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1512992691 shutdown_connections 2024-09-10T08:08:38.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02c0cf9740 1 -- 172.21.15.22:0/1512992691 wait complete. 2024-09-10T08:08:38.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.631+0000 7f02c0cf9740 20 client.15186 trim_cache size 0 max 16384 2024-09-10T08:08:38.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.649+0000 7f02c0cf9740 1 Processor -- start 2024-09-10T08:08:38.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.649+0000 7f02c0cf9740 1 -- start start 2024-09-10T08:08:38.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.649+0000 7f02c0cf9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d4829d0 0x55cd2d485610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.649+0000 7f02c0cf9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4832f0 0x55cd2d485b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.649+0000 7f02c0cf9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 0x55cd2d4879a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.649+0000 7f02c0cf9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d49dd80 con 0x55cd2d48dbb0 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.649+0000 7f02c0cf9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d49e450 con 0x55cd2d4829d0 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.649+0000 7f02c0cf9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d49eb20 con 0x55cd2d4832f0 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.649+0000 7f02bcebd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 0x55cd2d4879a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.649+0000 7f02bcebd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 0x55cd2d4879a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41112/0 (socket says 172.21.15.22:41112) 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.649+0000 7f02bcebd640 1 -- 172.21.15.22:0/3065974261 learned_addr learned my addr 172.21.15.22:0/3065974261 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.649+0000 7f02b77fe640 1 --2- 172.21.15.22:0/3065974261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4832f0 0x55cd2d485b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.650+0000 7f02b7fff640 1 --2- 172.21.15.22:0/3065974261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d4829d0 0x55cd2d485610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.650+0000 7f02bcebd640 1 -- 172.21.15.22:0/3065974261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4832f0 msgr2=0x55cd2d485b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.650+0000 7f02bcebd640 1 --2- 172.21.15.22:0/3065974261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4832f0 0x55cd2d485b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.650+0000 7f02bcebd640 1 -- 172.21.15.22:0/3065974261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d4829d0 msgr2=0x55cd2d485610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.650+0000 7f02bcebd640 1 --2- 172.21.15.22:0/3065974261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d4829d0 0x55cd2d485610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.650+0000 7f02bcebd640 1 -- 172.21.15.22:0/3065974261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd2d47fbf0 con 0x55cd2d48dbb0 2024-09-10T08:08:38.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.650+0000 7f02bcebd640 1 --2- 172.21.15.22:0/3065974261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 0x55cd2d4879a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f02b0031040 tx=0x7f02b0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f809bcf22e848629 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.650+0000 7f029dffb640 1 -- 172.21.15.22:0/3065974261 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b00098a0 con 0x55cd2d48dbb0 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.650+0000 7f029dffb640 1 -- 172.21.15.22:0/3065974261 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02b0036040 con 0x55cd2d48dbb0 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.650+0000 7f029dffb640 1 -- 172.21.15.22:0/3065974261 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0030c50 con 0x55cd2d48dbb0 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 -- 172.21.15.22:0/3065974261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 msgr2=0x55cd2d4879a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/3065974261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 0x55cd2d4879a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f02b0031040 tx=0x7f02b0009b80 comp rx=0 tx=0).stop 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 -- 172.21.15.22:0/3065974261 shutdown_connections 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/3065974261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d48dbb0 0x55cd2d4879a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/3065974261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4832f0 0x55cd2d485b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/3065974261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d4829d0 0x55cd2d485610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 -- 172.21.15.22:0/3065974261 >> 172.21.15.22:0/3065974261 conn(0x55cd2d47ef60 msgr2=0x55cd2d49d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 -- 172.21.15.22:0/3065974261 shutdown_connections 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 -- 172.21.15.22:0/3065974261 wait complete. 2024-09-10T08:08:38.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 -- start start 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 Processor -- start 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4829d0 0x55cd2d4a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.651+0000 7f02c0cf9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4832f0 0x55cd2d4a83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02c0cf9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d48dbb0 0x55cd2d4a1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02c0cf9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d49f8c0 con 0x55cd2d4832f0 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02c0cf9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d49f1f0 con 0x55cd2d48dbb0 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02c0cf9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d49ff90 con 0x55cd2d4829d0 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02c0cf9740 10 client.0 _ll_register_callbacks cb 0x7f02a800b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02b77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4832f0 0x55cd2d4a83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02b77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4832f0 0x55cd2d4a83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41114/0 (socket says 172.21.15.22:41114) 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02b77fe640 1 -- 172.21.15.22:0/552590559 learned_addr learned my addr 172.21.15.22:0/552590559 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02b7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4829d0 0x55cd2d4a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02bcebd640 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d48dbb0 0x55cd2d4a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02b77fe640 1 -- 172.21.15.22:0/552590559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4829d0 msgr2=0x55cd2d4a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02b77fe640 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4829d0 0x55cd2d4a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02b77fe640 1 -- 172.21.15.22:0/552590559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d48dbb0 msgr2=0x55cd2d4a1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02b77fe640 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d48dbb0 0x55cd2d4a1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02b77fe640 1 -- 172.21.15.22:0/552590559 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd2d4a1880 con 0x55cd2d4832f0 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02b7fff640 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4829d0 0x55cd2d4a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02b77fe640 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4832f0 0x55cd2d4a83c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f02ac010fd0 tx=0x7f02ac01fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5802ea90f29ad3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02977fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02977fe640 1 -- 172.21.15.22:0/552590559 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac09b870 con 0x55cd2d4832f0 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02977fe640 1 -- 172.21.15.22:0/552590559 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f02ac097ee0 con 0x55cd2d4832f0 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.652+0000 7f02c0cf9740 1 -- 172.21.15.22:0/552590559 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02b0036040 con 0x55cd2d4832f0 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.653+0000 7f02977fe640 1 -- 172.21.15.22:0/552590559 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f02ac09fc20 con 0x55cd2d4832f0 2024-09-10T08:08:38.664 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.653+0000 7f02c0cf9740 10 client.15192 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.653+0000 7f02c0cf9740 1 -- 172.21.15.22:0/552590559 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cd2d4a6170 con 0x55cd2d4832f0 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.653+0000 7f02977fe640 1 -- 172.21.15.22:0/552590559 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02b0036040 con 0x55cd2d4832f0 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.653+0000 7f02977fe640 1 -- 172.21.15.22:0/552590559 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f02ac0860b0 con 0x55cd2d4832f0 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.653+0000 7f02c0cf9740 10 client.15192 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.653+0000 7f02c0cf9740 10 client.15192 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.653+0000 7f02c0cf9740 20 client.15192 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.653+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55cd2d50d1d0 0x55cd2d50bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.653+0000 7f02c0cf9740 4 client.15192 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.653+0000 7f02c0cf9740 1 -- 172.21.15.22:0/552590559 --> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] -- command(tid 0: {"prefix": "status"}) -- 0x55cd2d3f0b10 con 0x55cd2d50d1d0 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.653+0000 7f02b7fff640 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55cd2d50d1d0 0x55cd2d50bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02977fe640 10 client.15192 ms_handle_connect on v2:172.21.15.100:6836/1987693702 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02b7fff640 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55cd2d50d1d0 0x55cd2d50bee0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=55e02a3b0869c4bd server_cookie=7bfd506e77672a0 in_seq=0 out_seq=0 2024-09-10T08:08:38.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02977fe640 1 -- 172.21.15.22:0/552590559 <== mds.1 v2:172.21.15.100:6836/1987693702 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55cd2d3f0b10 con 0x55cd2d50d1d0 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02977fe640 10 client.15192 handle_command_reply: tid=0 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02c0cf9740 1 client.15192 shutdown 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02c0cf9740 1 -- 172.21.15.22:0/552590559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4832f0 msgr2=0x55cd2d4a83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4832f0 0x55cd2d4a83c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f02ac010fd0 tx=0x7f02ac01fb40 comp rx=0 tx=0).stop 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02c0cf9740 1 -- 172.21.15.22:0/552590559 shutdown_connections 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd2d48dbb0 0x55cd2d4a1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cd2d4832f0 0x55cd2d4a83c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.100:6836/1987693702,v1:172.21.15.100:6837/1987693702] conn(0x55cd2d50d1d0 0x55cd2d50bee0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02c0cf9740 1 --2- 172.21.15.22:0/552590559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cd2d4829d0 0x55cd2d4a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02c0cf9740 1 -- 172.21.15.22:0/552590559 >> 172.21.15.22:0/552590559 conn(0x55cd2d47ef60 msgr2=0x55cd2d48be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02977fe640 0 client.15192 ms_handle_reset on v2:172.21.15.100:6836/1987693702 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02c0cf9740 1 -- 172.21.15.22:0/552590559 shutdown_connections 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02c0cf9740 1 -- 172.21.15.22:0/552590559 wait complete. 2024-09-10T08:08:38.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.654+0000 7f02c0cf9740 20 client.15192 trim_cache size 0 max 16384 2024-09-10T08:08:38.667 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:08:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T08:08:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 1, 2024-09-10T08:08:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24479, 2024-09-10T08:08:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-10T08:08:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-10T08:08:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-10T08:08:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 96.235167423999997, 2024-09-10T08:08:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-10T08:08:38.667 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 83, 2024-09-10T08:08:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T08:08:38.668 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 125.893232559 2024-09-10T08:08:38.668 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:08:38.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.655+0000 7f02be920640 1 -- 172.21.15.22:0/1467977931 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f02a00a2b80 msgr2=0x7f02a00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:38.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.655+0000 7f02be920640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f02a00a2b80 0x7f02a00a5040 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f02b0046000 tx=0x7f02b0048000 comp rx=0 tx=0).stop 2024-09-10T08:08:38.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.655+0000 7f02be920640 1 -- 172.21.15.22:0/1467977931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b8102790 msgr2=0x7f02b8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:38.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.655+0000 7f02be920640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b8102790 0x7f02b8074a30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00d950 tx=0x7f02ac00de10 comp rx=0 tx=0).stop 2024-09-10T08:08:38.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.655+0000 7f02be920640 1 -- 172.21.15.22:0/1467977931 shutdown_connections 2024-09-10T08:08:38.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.655+0000 7f02be920640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f02a00a2b80 0x7f02a00a5040 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.655+0000 7f02be920640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02b8106f10 0x7f02b8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.655+0000 7f02be920640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02b8102790 0x7f02b8074a30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.655+0000 7f02be920640 1 --2- 172.21.15.22:0/1467977931 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02b8101de0 0x7f02b80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:38.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.655+0000 7f02be920640 1 -- 172.21.15.22:0/1467977931 >> 172.21.15.22:0/1467977931 conn(0x7f02b80fd8c0 msgr2=0x7f02b80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:38.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.655+0000 7f02be920640 1 -- 172.21.15.22:0/1467977931 shutdown_connections 2024-09-10T08:08:38.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:38.655+0000 7f02be920640 1 -- 172.21.15.22:0/1467977931 wait complete. 2024-09-10T08:08:39.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T08:08:39.722 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:40.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:40 smithi022 ceph-mon[30854]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T08:08:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.197+0000 7f2861d4c640 1 -- 172.21.15.22:0/316158684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c101400 msgr2=0x7f285c10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.197+0000 7f2861d4c640 1 --2- 172.21.15.22:0/316158684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c101400 0x7f285c10d930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2854009cd0 tx=0x7f285402a8e0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.197+0000 7f2861d4c640 1 -- 172.21.15.22:0/316158684 shutdown_connections 2024-09-10T08:08:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.197+0000 7f2861d4c640 1 --2- 172.21.15.22:0/316158684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c101400 0x7f285c10d930 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.197+0000 7f2861d4c640 1 --2- 172.21.15.22:0/316158684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f285c100a60 0x7f285c100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.197+0000 7f2861d4c640 1 --2- 172.21.15.22:0/316158684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f285c106a60 0x7f285c106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.197+0000 7f2861d4c640 1 -- 172.21.15.22:0/316158684 >> 172.21.15.22:0/316158684 conn(0x7f285c0fc780 msgr2=0x7f285c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.197+0000 7f2861d4c640 1 -- 172.21.15.22:0/316158684 shutdown_connections 2024-09-10T08:08:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.197+0000 7f2861d4c640 1 -- 172.21.15.22:0/316158684 wait complete. 2024-09-10T08:08:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.197+0000 7f2861d4c640 1 Processor -- start 2024-09-10T08:08:40.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.197+0000 7f2861d4c640 1 -- start start 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f2861d4c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c100a60 0x7f285c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f2861d4c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f285c101400 0x7f285c1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f2861d4c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f285c106a60 0x7f285c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f2861d4c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f285c110e60 con 0x7f285c100a60 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f2861d4c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f285c110ce0 con 0x7f285c101400 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f2861d4c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f285c110fe0 con 0x7f285c106a60 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c100a60 0x7f285c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c100a60 0x7f285c198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41134/0 (socket says 172.21.15.22:41134) 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285b7fe640 1 -- 172.21.15.22:0/2417593604 learned_addr learned my addr 172.21.15.22:0/2417593604 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285affd640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f285c101400 0x7f285c1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285bfff640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f285c106a60 0x7f285c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285b7fe640 1 -- 172.21.15.22:0/2417593604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f285c106a60 msgr2=0x7f285c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285b7fe640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f285c106a60 0x7f285c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285b7fe640 1 -- 172.21.15.22:0/2417593604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f285c101400 msgr2=0x7f285c1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285b7fe640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f285c101400 0x7f285c1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285b7fe640 1 -- 172.21.15.22:0/2417593604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285c19d340 con 0x7f285c100a60 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285bfff640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f285c106a60 0x7f285c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285affd640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f285c101400 0x7f285c1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f285b7fe640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c100a60 0x7f285c198390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f284c00d950 tx=0x7f284c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f2858ff9640 1 -- 172.21.15.22:0/2417593604 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c017070 con 0x7f285c100a60 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f2861d4c640 1 -- 172.21.15.22:0/2417593604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f285c19d630 con 0x7f285c100a60 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f2858ff9640 1 -- 172.21.15.22:0/2417593604 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f284c009c30 con 0x7f285c100a60 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.198+0000 7f2858ff9640 1 -- 172.21.15.22:0/2417593604 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c00f6b0 con 0x7f285c100a60 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.199+0000 7f2861d4c640 1 -- 172.21.15.22:0/2417593604 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f285c1a4f10 con 0x7f285c100a60 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.201+0000 7f2858ff9640 1 -- 172.21.15.22:0/2417593604 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7f284c0109d0 con 0x7f285c100a60 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.201+0000 7f2864125740 1 Processor -- start 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.201+0000 7f2864125740 1 -- start start 2024-09-10T08:08:40.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.201+0000 7f2864125740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.201+0000 7f2864125740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.201+0000 7f2864125740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.201+0000 7f2864125740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563c0a223090 con 0x563c0a2bd2f0 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.201+0000 7f2864125740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563c0a1caa70 con 0x563c0a2c7bb0 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.201+0000 7f2864125740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563c0a21f050 con 0x563c0a2bc9d0 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.201+0000 7f285b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.201+0000 7f285b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41144/0 (socket says 172.21.15.22:41144) 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.201+0000 7f285b7fe640 1 -- 172.21.15.22:0/2321711989 learned_addr learned my addr 172.21.15.22:0/2321711989 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f2858ff9640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f28440a2b80 0x7f28440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f285bfff640 1 --2- 172.21.15.22:0/2321711989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f285affd640 1 --2- 172.21.15.22:0/2321711989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f285b7fe640 1 -- 172.21.15.22:0/2321711989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 msgr2=0x563c0a2bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:40.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f285b7fe640 1 --2- 172.21.15.22:0/2321711989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2bcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f285b7fe640 1 -- 172.21.15.22:0/2321711989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 msgr2=0x563c0a2c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f285b7fe640 1 --2- 172.21.15.22:0/2321711989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f285b7fe640 1 -- 172.21.15.22:0/2321711989 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c0a1d7130 con 0x563c0a2bd2f0 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f285bfff640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f28440a2b80 0x7f28440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f2858ff9640 1 -- 172.21.15.22:0/2417593604 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f284c0cecf0 con 0x7f285c100a60 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f285b7fe640 1 --2- 172.21.15.22:0/2321711989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c7670 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f284c05aca0 tx=0x7f284c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871107a5c1d83c6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f2841ffb640 1 -- 172.21.15.22:0/2321711989 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c020020 con 0x563c0a2bd2f0 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f2841ffb640 1 -- 172.21.15.22:0/2321711989 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f284c05c250 con 0x563c0a2bd2f0 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f285bfff640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f28440a2b80 0x7f28440a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2854005e30 tx=0x7f28540095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.202+0000 7f2841ffb640 1 -- 172.21.15.22:0/2321711989 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c09bc50 con 0x563c0a2bd2f0 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.203+0000 7f2864125740 1 -- 172.21.15.22:0/2321711989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 msgr2=0x563c0a2c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.203+0000 7f2864125740 1 --2- 172.21.15.22:0/2321711989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c7670 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f284c05aca0 tx=0x7f284c00bf60 comp rx=0 tx=0).stop 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.203+0000 7f2864125740 1 -- 172.21.15.22:0/2321711989 shutdown_connections 2024-09-10T08:08:40.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.203+0000 7f2864125740 1 --2- 172.21.15.22:0/2321711989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.203+0000 7f2864125740 1 --2- 172.21.15.22:0/2321711989 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c7670 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.203+0000 7f2864125740 1 --2- 172.21.15.22:0/2321711989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2bcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.203+0000 7f2864125740 1 -- 172.21.15.22:0/2321711989 >> 172.21.15.22:0/2321711989 conn(0x563c0a2b8f60 msgr2=0x563c0a2b9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.203+0000 7f2864125740 1 -- 172.21.15.22:0/2321711989 shutdown_connections 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.203+0000 7f2864125740 1 -- 172.21.15.22:0/2321711989 wait complete. 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.203+0000 7f2864125740 1 -- start start 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f2864125740 1 Processor -- start 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f2864125740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bc9d0 0x563c0a2c7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f2864125740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f2864125740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f2864125740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563c0a2ca720 con 0x563c0a2bc9d0 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f2864125740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563c0a1ddf20 con 0x563c0a2c7bb0 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f2864125740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563c0a2ca8a0 con 0x563c0a2bd2f0 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f2864125740 10 client.0 _ll_register_callbacks cb 0x563c0a1a7030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:40.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f285b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bc9d0 0x563c0a2c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f285b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bc9d0 0x563c0a2c7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41146/0 (socket says 172.21.15.22:41146) 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f285b7fe640 1 -- 172.21.15.22:0/2583807637 learned_addr learned my addr 172.21.15.22:0/2583807637 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f285bfff640 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f285affd640 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f285b7fe640 1 -- 172.21.15.22:0/2583807637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bd2f0 msgr2=0x563c0a2c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f285b7fe640 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f285b7fe640 1 -- 172.21.15.22:0/2583807637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 msgr2=0x563c0a2c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f285b7fe640 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f285b7fe640 1 -- 172.21.15.22:0/2583807637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c09f942b0 con 0x563c0a2bc9d0 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f285affd640 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f285b7fe640 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bc9d0 0x563c0a2c7450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f284c000c00 tx=0x7f284c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5cdb56e1184f4a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.204+0000 7f283affd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:40.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f283affd640 1 -- 172.21.15.22:0/2583807637 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f284c0d1070 con 0x563c0a2bc9d0 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f283affd640 1 -- 172.21.15.22:0/2583807637 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f284c097320 con 0x563c0a2bc9d0 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f2864125740 1 -- 172.21.15.22:0/2583807637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c0a230600 con 0x563c0a2bc9d0 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f283affd640 1 -- 172.21.15.22:0/2583807637 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f284c020040 con 0x563c0a2bc9d0 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f2864125740 10 client.15204 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f2864125740 1 -- 172.21.15.22:0/2583807637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c0a2d6040 con 0x563c0a2bc9d0 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f283affd640 1 -- 172.21.15.22:0/2583807637 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563c0a230600 con 0x563c0a2bc9d0 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f283affd640 1 -- 172.21.15.22:0/2583807637 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f284c097bc0 con 0x563c0a2bc9d0 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f2864125740 10 client.15204 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f2864125740 10 client.15204 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f2864125740 20 client.15204 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f2864125740 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x563c0a2d8300 0x563c0a2d9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f2864125740 4 client.15204 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.205+0000 7f2864125740 1 -- 172.21.15.22:0/2583807637 --> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c0a22ab10 con 0x563c0a2d8300 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.206+0000 7f285affd640 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x563c0a2d8300 0x563c0a2d9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.206+0000 7f285affd640 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x563c0a2d8300 0x563c0a2d9770 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a626360094b09543 server_cookie=603e4c2532fa9ca9 in_seq=0 out_seq=0 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.206+0000 7f283affd640 10 client.15204 ms_handle_connect on v2:172.21.15.100:6838/2512683674 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f283affd640 1 -- 172.21.15.22:0/2583807637 <== mds.0 v2:172.21.15.100:6838/2512683674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c0a22ab10 con 0x563c0a2d8300 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f283affd640 10 client.15204 handle_command_reply: tid=0 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f2864125740 1 client.15204 shutdown 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f2864125740 1 -- 172.21.15.22:0/2583807637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bc9d0 msgr2=0x563c0a2c7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f2864125740 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bc9d0 0x563c0a2c7450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f284c000c00 tx=0x7f284c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f2864125740 1 -- 172.21.15.22:0/2583807637 shutdown_connections 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f2864125740 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x563c0a2d8300 0x563c0a2d9770 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f2864125740 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f2864125740 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f2864125740 1 --2- 172.21.15.22:0/2583807637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bc9d0 0x563c0a2c7450 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f2864125740 1 -- 172.21.15.22:0/2583807637 >> 172.21.15.22:0/2583807637 conn(0x563c0a2b8f60 msgr2=0x563c0a2bec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f283affd640 0 client.15204 ms_handle_reset on v2:172.21.15.100:6838/2512683674 2024-09-10T08:08:40.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f2864125740 1 -- 172.21.15.22:0/2583807637 shutdown_connections 2024-09-10T08:08:40.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f2864125740 1 -- 172.21.15.22:0/2583807637 wait complete. 2024-09-10T08:08:40.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.207+0000 7f2864125740 20 client.15204 trim_cache size 0 max 16384 2024-09-10T08:08:40.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f2864125740 1 Processor -- start 2024-09-10T08:08:40.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f2864125740 1 -- start start 2024-09-10T08:08:40.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f2864125740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2d90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f2864125740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f2864125740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f2864125740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563c0a2d7ab0 con 0x563c0a2bd2f0 2024-09-10T08:08:40.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f2864125740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563c0a2d8180 con 0x563c0a2c7bb0 2024-09-10T08:08:40.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f2864125740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563c0a2d8850 con 0x563c0a2bc9d0 2024-09-10T08:08:40.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f285affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f285affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41152/0 (socket says 172.21.15.22:41152) 2024-09-10T08:08:40.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f285affd640 1 -- 172.21.15.22:0/3150139363 learned_addr learned my addr 172.21.15.22:0/3150139363 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:40.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f285b7fe640 1 --2- 172.21.15.22:0/3150139363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2d90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f285bfff640 1 --2- 172.21.15.22:0/3150139363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f285affd640 1 -- 172.21.15.22:0/3150139363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 msgr2=0x563c0a2d90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f285affd640 1 --2- 172.21.15.22:0/3150139363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2d90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f285affd640 1 -- 172.21.15.22:0/3150139363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 msgr2=0x563c0a2c1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.225+0000 7f285affd640 1 --2- 172.21.15.22:0/3150139363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f285affd640 1 -- 172.21.15.22:0/3150139363 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c0a2ba0f0 con 0x563c0a2bd2f0 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f285b7fe640 1 --2- 172.21.15.22:0/3150139363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2d90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f285bfff640 1 --2- 172.21.15.22:0/3150139363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f285affd640 1 --2- 172.21.15.22:0/3150139363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c6600 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2850005fd0 tx=0x7f2850005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e564a18acde0010 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f28417fa640 1 -- 172.21.15.22:0/3150139363 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850019330 con 0x563c0a2bd2f0 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f28417fa640 1 -- 172.21.15.22:0/3150139363 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28500199b0 con 0x563c0a2bd2f0 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f28417fa640 1 -- 172.21.15.22:0/3150139363 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2850010940 con 0x563c0a2bd2f0 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f2864125740 1 -- 172.21.15.22:0/3150139363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 msgr2=0x563c0a2c6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:40.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f2864125740 1 --2- 172.21.15.22:0/3150139363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c6600 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2850005fd0 tx=0x7f2850005850 comp rx=0 tx=0).stop 2024-09-10T08:08:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f2864125740 1 -- 172.21.15.22:0/3150139363 shutdown_connections 2024-09-10T08:08:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f2864125740 1 --2- 172.21.15.22:0/3150139363 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2c7bb0 0x563c0a2c1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f2864125740 1 --2- 172.21.15.22:0/3150139363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2bd2f0 0x563c0a2c6600 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f2864125740 1 --2- 172.21.15.22:0/3150139363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2d90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.226+0000 7f2864125740 1 -- 172.21.15.22:0/3150139363 >> 172.21.15.22:0/3150139363 conn(0x563c0a2b8f60 msgr2=0x563c0a2c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.227+0000 7f2864125740 1 -- 172.21.15.22:0/3150139363 shutdown_connections 2024-09-10T08:08:40.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.227+0000 7f2864125740 1 -- 172.21.15.22:0/3150139363 wait complete. 2024-09-10T08:08:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.227+0000 7f2864125740 1 -- start start 2024-09-10T08:08:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.227+0000 7f2864125740 1 Processor -- start 2024-09-10T08:08:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.227+0000 7f2864125740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2e21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.227+0000 7f2864125740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2bd2f0 0x563c0a2dd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.227+0000 7f2864125740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2c7bb0 0x563c0a2dda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.227+0000 7f2864125740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563c0a2d95f0 con 0x563c0a2c7bb0 2024-09-10T08:08:40.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.227+0000 7f2864125740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563c0a2d8f20 con 0x563c0a2bd2f0 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.227+0000 7f2864125740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563c0a2d9cc0 con 0x563c0a2bc9d0 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f2864125740 10 client.0 _ll_register_callbacks cb 0x7f284c0976b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f285bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2c7bb0 0x563c0a2dda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f285bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2c7bb0 0x563c0a2dda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41156/0 (socket says 172.21.15.22:41156) 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f285bfff640 1 -- 172.21.15.22:0/1632940601 learned_addr learned my addr 172.21.15.22:0/1632940601 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f285affd640 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2bd2f0 0x563c0a2dd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f285b7fe640 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2e21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f285bfff640 1 -- 172.21.15.22:0/1632940601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 msgr2=0x563c0a2e21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f285bfff640 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2e21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f285bfff640 1 -- 172.21.15.22:0/1632940601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2bd2f0 msgr2=0x563c0a2dd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f285bfff640 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2bd2f0 0x563c0a2dd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f285bfff640 1 -- 172.21.15.22:0/1632940601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c0a2de270 con 0x563c0a2c7bb0 2024-09-10T08:08:40.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f285bfff640 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2c7bb0 0x563c0a2dda70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2854003bf0 tx=0x7f285402a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907b0ba5ba896e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f283affd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f283affd640 1 -- 172.21.15.22:0/1632940601 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2854003e50 con 0x563c0a2c7bb0 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f283affd640 1 -- 172.21.15.22:0/1632940601 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f2854004250 con 0x563c0a2c7bb0 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f2864125740 1 -- 172.21.15.22:0/1632940601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28500199b0 con 0x563c0a2c7bb0 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.228+0000 7f283affd640 1 -- 172.21.15.22:0/1632940601 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2854004450 con 0x563c0a2c7bb0 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.229+0000 7f2864125740 10 client.15210 fetch_fsmap learned FSMap version 28 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.229+0000 7f2864125740 1 -- 172.21.15.22:0/1632940601 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563c0a3429b0 con 0x563c0a2c7bb0 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.229+0000 7f283affd640 1 -- 172.21.15.22:0/1632940601 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f28500199b0 con 0x563c0a2c7bb0 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.229+0000 7f283affd640 1 -- 172.21.15.22:0/1632940601 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f2854030070 con 0x563c0a2c7bb0 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.229+0000 7f2864125740 10 client.15210 fetch_fsmap finished waiting for FSMap version 28 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.229+0000 7f2864125740 10 client.15210 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.229+0000 7f2864125740 20 client.15210 populate_metadata read hostname 'smithi022' 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.229+0000 7f2864125740 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x563c0a347660 0x563c0a346370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:40.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.229+0000 7f2864125740 4 client.15210 mds_command: new command op to 24512 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.229+0000 7f2864125740 1 -- 172.21.15.22:0/1632940601 --> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] -- command(tid 0: {"prefix": "status"}) -- 0x563c0a1a70e0 con 0x563c0a347660 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.229+0000 7f285b7fe640 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x563c0a347660 0x563c0a346370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f285b7fe640 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x563c0a347660 0x563c0a346370 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24770738731aa889 server_cookie=b8ee6b9bf5feb9fa in_seq=0 out_seq=0 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f283affd640 10 client.15210 ms_handle_connect on v2:172.21.15.100:6838/2512683674 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f283affd640 1 -- 172.21.15.22:0/1632940601 <== mds.0 v2:172.21.15.100:6838/2512683674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x563c0a1a70e0 con 0x563c0a347660 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f283affd640 10 client.15210 handle_command_reply: tid=0 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f2864125740 1 client.15210 shutdown 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f2864125740 1 -- 172.21.15.22:0/1632940601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2c7bb0 msgr2=0x563c0a2dda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f2864125740 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2c7bb0 0x563c0a2dda70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2854003bf0 tx=0x7f285402a8e0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f2864125740 1 -- 172.21.15.22:0/1632940601 shutdown_connections 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f2864125740 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.100:6838/2512683674,v1:172.21.15.100:6839/2512683674] conn(0x563c0a347660 0x563c0a346370 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f2864125740 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563c0a2c7bb0 0x563c0a2dda70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f2864125740 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c0a2bd2f0 0x563c0a2dd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f2864125740 1 --2- 172.21.15.22:0/1632940601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c0a2bc9d0 0x563c0a2e21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f2864125740 1 -- 172.21.15.22:0/1632940601 >> 172.21.15.22:0/1632940601 conn(0x563c0a2b8f60 msgr2=0x563c0a2b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.230+0000 7f283affd640 0 client.15210 ms_handle_reset on v2:172.21.15.100:6838/2512683674 2024-09-10T08:08:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2864125740 1 -- 172.21.15.22:0/1632940601 shutdown_connections 2024-09-10T08:08:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2864125740 1 -- 172.21.15.22:0/1632940601 wait complete. 2024-09-10T08:08:40.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2864125740 20 client.15210 trim_cache size 0 max 16384 2024-09-10T08:08:40.235 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:08:40.235 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "71bf679e-6f4a-11ef-bcea-c7b262605968", 2024-09-10T08:08:40.235 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-09-10T08:08:40.235 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24512, 2024-09-10T08:08:40.235 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-10T08:08:40.236 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-10T08:08:40.236 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-10T08:08:40.236 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 104.857569258, 2024-09-10T08:08:40.236 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-10T08:08:40.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 83, 2024-09-10T08:08:40.236 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-10T08:08:40.236 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 116.088380452 2024-09-10T08:08:40.236 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:08:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2861d4c640 1 -- 172.21.15.22:0/2417593604 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f28440a2b80 msgr2=0x7f28440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2861d4c640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f28440a2b80 0x7f28440a5040 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2854005e30 tx=0x7f28540095c0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2861d4c640 1 -- 172.21.15.22:0/2417593604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c100a60 msgr2=0x7f285c198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2861d4c640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c100a60 0x7f285c198390 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f284c00d950 tx=0x7f284c00de10 comp rx=0 tx=0).stop 2024-09-10T08:08:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2861d4c640 1 -- 172.21.15.22:0/2417593604 shutdown_connections 2024-09-10T08:08:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2861d4c640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f28440a2b80 0x7f28440a5040 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2861d4c640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f285c106a60 0x7f285c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2861d4c640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f285c101400 0x7f285c1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2861d4c640 1 --2- 172.21.15.22:0/2417593604 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c100a60 0x7f285c198390 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2861d4c640 1 -- 172.21.15.22:0/2417593604 >> 172.21.15.22:0/2417593604 conn(0x7f285c0fc780 msgr2=0x7f285c104810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2861d4c640 1 -- 172.21.15.22:0/2417593604 shutdown_connections 2024-09-10T08:08:40.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:40.231+0000 7f2861d4c640 1 -- 172.21.15.22:0/2417593604 wait complete. 2024-09-10T08:08:40.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:40 smithi100 ceph-mon[35102]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T08:08:40.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:40 smithi153 ceph-mon[35609]: pgmap v332: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-10T08:08:41.049 INFO:teuthology.run_tasks:Running task sequential... 2024-09-10T08:08:41.060 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-10T08:08:41.060 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T08:08:41.060 INFO:teuthology.task.print:Enabling mgr modules 2024-09-10T08:08:41.060 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-10T08:08:41.061 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T08:08:41.061 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-10T08:08:41.061 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-10T08:08:41.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.167+0000 7fbd16d23640 1 -- 172.21.15.22:0/4091177263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd10103140 msgr2=0x7fbd10103540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.167+0000 7fbd16d23640 1 --2- 172.21.15.22:0/4091177263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd10103140 0x7fbd10103540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbd04009930 tx=0x7fbd0402a420 comp rx=0 tx=0).stop 2024-09-10T08:08:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.167+0000 7fbd16d23640 1 -- 172.21.15.22:0/4091177263 shutdown_connections 2024-09-10T08:08:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.167+0000 7fbd16d23640 1 --2- 172.21.15.22:0/4091177263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10100570 0x7fbd1010a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.167+0000 7fbd16d23640 1 --2- 172.21.15.22:0/4091177263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd100ffbb0 0x7fbd10100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.167+0000 7fbd16d23640 1 --2- 172.21.15.22:0/4091177263 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd10103140 0x7fbd10103540 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.167+0000 7fbd16d23640 1 -- 172.21.15.22:0/4091177263 >> 172.21.15.22:0/4091177263 conn(0x7fbd100fb980 msgr2=0x7fbd100fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.167+0000 7fbd16d23640 1 -- 172.21.15.22:0/4091177263 shutdown_connections 2024-09-10T08:08:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.167+0000 7fbd16d23640 1 -- 172.21.15.22:0/4091177263 wait complete. 2024-09-10T08:08:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.168+0000 7fbd16d23640 1 Processor -- start 2024-09-10T08:08:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.168+0000 7fbd16d23640 1 -- start start 2024-09-10T08:08:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.168+0000 7fbd16d23640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd100ffbb0 0x7fbd10197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:41.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.168+0000 7fbd16d23640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10100570 0x7fbd101983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.168+0000 7fbd16d23640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd10103140 0x7fbd1019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.168+0000 7fbd16d23640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1010d8b0 con 0x7fbd10103140 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.168+0000 7fbd16d23640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1010d730 con 0x7fbd100ffbb0 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.168+0000 7fbd16d23640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbd1010da30 con 0x7fbd10100570 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.168+0000 7fbd152c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd10103140 0x7fbd1019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.168+0000 7fbd152c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd10103140 0x7fbd1019f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41172/0 (socket says 172.21.15.22:41172) 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.168+0000 7fbd152c0640 1 -- 172.21.15.22:0/1930255638 learned_addr learned my addr 172.21.15.22:0/1930255638 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.168+0000 7fbd14abf640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd100ffbb0 0x7fbd10197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.169+0000 7fbd152c0640 1 -- 172.21.15.22:0/1930255638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10100570 msgr2=0x7fbd101983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.169+0000 7fbd152c0640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10100570 0x7fbd101983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.169+0000 7fbd152c0640 1 -- 172.21.15.22:0/1930255638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd100ffbb0 msgr2=0x7fbd10197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.169+0000 7fbd152c0640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd100ffbb0 0x7fbd10197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:41.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.169+0000 7fbd152c0640 1 -- 172.21.15.22:0/1930255638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1019fad0 con 0x7fbd10103140 2024-09-10T08:08:41.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.169+0000 7fbd152c0640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd10103140 0x7fbd1019f460 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800b970 tx=0x7fbd0800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:41.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.169+0000 7fbd0dffb640 1 -- 172.21.15.22:0/1930255638 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08019070 con 0x7fbd10103140 2024-09-10T08:08:41.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.169+0000 7fbd0dffb640 1 -- 172.21.15.22:0/1930255638 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd0800cb40 con 0x7fbd10103140 2024-09-10T08:08:41.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.169+0000 7fbd0dffb640 1 -- 172.21.15.22:0/1930255638 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd08007650 con 0x7fbd10103140 2024-09-10T08:08:41.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.169+0000 7fbd16d23640 1 -- 172.21.15.22:0/1930255638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1019fdc0 con 0x7fbd10103140 2024-09-10T08:08:41.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.169+0000 7fbd16d23640 1 -- 172.21.15.22:0/1930255638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd101a03b0 con 0x7fbd10103140 2024-09-10T08:08:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.170+0000 7fbd16d23640 1 -- 172.21.15.22:0/1930255638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd10109070 con 0x7fbd10103140 2024-09-10T08:08:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.171+0000 7fbd0dffb640 1 -- 172.21.15.22:0/1930255638 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 137833+0+0 (secure 0 0 0) 0x7fbd0801c070 con 0x7fbd10103140 2024-09-10T08:08:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.172+0000 7fbd0dffb640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbd000a2cb0 0x7fbd000a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.172+0000 7fbd14abf640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbd000a2cb0 0x7fbd000a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.172+0000 7fbd0dffb640 1 -- 172.21.15.22:0/1930255638 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbd080ce4f0 con 0x7fbd10103140 2024-09-10T08:08:41.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.173+0000 7fbd14abf640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbd000a2cb0 0x7fbd000a5170 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbd04009230 tx=0x7fbd04031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:41.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.176+0000 7fbd0dffb640 1 -- 172.21.15.22:0/1930255638 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbd0809ae00 con 0x7fbd10103140 2024-09-10T08:08:41.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:41.402+0000 7fbd16d23640 1 -- 172.21.15.22:0/1930255638 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fbd10062e90 con 0x7fbd10103140 2024-09-10T08:08:42.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.094+0000 7fbd0dffb640 1 -- 172.21.15.22:0/1930255638 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7fbd0809f100 con 0x7fbd10103140 2024-09-10T08:08:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.097+0000 7fbd16d23640 1 -- 172.21.15.22:0/1930255638 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbd000a2cb0 msgr2=0x7fbd000a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.097+0000 7fbd16d23640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbd000a2cb0 0x7fbd000a5170 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbd04009230 tx=0x7fbd04031400 comp rx=0 tx=0).stop 2024-09-10T08:08:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.097+0000 7fbd16d23640 1 -- 172.21.15.22:0/1930255638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd10103140 msgr2=0x7fbd1019f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.097+0000 7fbd16d23640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd10103140 0x7fbd1019f460 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800b970 tx=0x7fbd0800be30 comp rx=0 tx=0).stop 2024-09-10T08:08:42.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.097+0000 7fbd16d23640 1 -- 172.21.15.22:0/1930255638 shutdown_connections 2024-09-10T08:08:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.097+0000 7fbd16d23640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbd000a2cb0 0x7fbd000a5170 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.097+0000 7fbd16d23640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd10103140 0x7fbd1019f460 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.097+0000 7fbd16d23640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd10100570 0x7fbd101983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.097+0000 7fbd16d23640 1 --2- 172.21.15.22:0/1930255638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbd100ffbb0 0x7fbd10197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.097+0000 7fbd16d23640 1 -- 172.21.15.22:0/1930255638 >> 172.21.15.22:0/1930255638 conn(0x7fbd100fb980 msgr2=0x7fbd10106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.097+0000 7fbd16d23640 1 -- 172.21.15.22:0/1930255638 shutdown_connections 2024-09-10T08:08:42.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:42.098+0000 7fbd16d23640 1 -- 172.21.15.22:0/1930255638 wait complete. 2024-09-10T08:08:42.116 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T08:08:42.142 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T08:08:42.142 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T08:08:42.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:08:42.143 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-10T08:08:42.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:08:42.161 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-09-10T08:08:42.230 INFO:teuthology.orchestra.run.smithi022.stderr:Cannot find device "ceph-brx" 2024-09-10T08:08:42.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:08:42.232 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-10T08:08:42.232 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T08:08:42.232 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:08:42.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T08:08:42.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:42 smithi100 ceph-mon[35102]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T08:08:42.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:42 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1930255638' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-10T08:08:42.369 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: ignoring --setuser ceph since I am not root 2024-09-10T08:08:42.369 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: ignoring --setgroup ceph since I am not root 2024-09-10T08:08:42.369 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:42 smithi100 ceph-mgr[36491]: -- 172.21.15.100:0/395464487 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559cef65b0e0 con 0x559cef638800 2024-09-10T08:08:42.369 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:42.243+0000 7ff75a0ca040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:08:42.369 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:42.300+0000 7ff75a0ca040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:08:42.397 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:42 smithi022 ceph-mon[30854]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T08:08:42.398 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:42 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1930255638' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-10T08:08:42.398 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: ignoring --setuser ceph since I am not root 2024-09-10T08:08:42.398 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: ignoring --setgroup ceph since I am not root 2024-09-10T08:08:42.398 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:42.256+0000 7f6530af1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:08:42.398 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:42.318+0000 7f6530af1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:08:42.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:42 smithi153 ceph-mon[35609]: pgmap v333: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-10T08:08:42.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:42 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1930255638' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-10T08:08:42.444 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: ignoring --setuser ceph since I am not root 2024-09-10T08:08:42.444 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: ignoring --setgroup ceph since I am not root 2024-09-10T08:08:42.444 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:42 smithi153 ceph-mgr[37421]: -- 172.21.15.153:0/3769983667 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604dd6470e0 con 0x5604dd625400 2024-09-10T08:08:42.444 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:42.246+0000 7f5c51bd1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:08:42.444 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:42.304+0000 7f5c51bd1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:08:42.543 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:08:42.664 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:42.488+0000 7f6530af1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:08:42.665 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:42.567+0000 7f6530af1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:08:42.800 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:42.448+0000 7ff75a0ca040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:08:42.800 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:42.513+0000 7ff75a0ca040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:08:42.800 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:42.659+0000 7ff75a0ca040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:08:42.800 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:42.800+0000 7ff75a0ca040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:08:42.807 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:42.452+0000 7f5c51bd1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:08:42.807 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:42.519+0000 7f5c51bd1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:08:42.807 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:42.666+0000 7f5c51bd1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:08:42.807 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:42.806+0000 7f5c51bd1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:08:42.935 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:42.727+0000 7f6530af1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:08:42.935 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:42.879+0000 7f6530af1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:08:43.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.019+0000 7f86bf7f3640 1 -- 172.21.15.22:0/2401496233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b8102570 msgr2=0x7f86b81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:43.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.019+0000 7f86bf7f3640 1 --2- 172.21.15.22:0/2401496233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b8102570 0x7f86b81029b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f86a8009900 tx=0x7f86a802a480 comp rx=0 tx=0).stop 2024-09-10T08:08:43.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.019+0000 7f86bf7f3640 1 -- 172.21.15.22:0/2401496233 shutdown_connections 2024-09-10T08:08:43.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.019+0000 7f86bf7f3640 1 --2- 172.21.15.22:0/2401496233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86b8102ef0 0x7f86b810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:43.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.019+0000 7f86bf7f3640 1 --2- 172.21.15.22:0/2401496233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b8102570 0x7f86b81029b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:43.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.019+0000 7f86bf7f3640 1 --2- 172.21.15.22:0/2401496233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b8100e20 0x7f86b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:43.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.019+0000 7f86bf7f3640 1 -- 172.21.15.22:0/2401496233 >> 172.21.15.22:0/2401496233 conn(0x7f86b80fc7d0 msgr2=0x7f86b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:43.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.019+0000 7f86bf7f3640 1 -- 172.21.15.22:0/2401496233 shutdown_connections 2024-09-10T08:08:43.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.019+0000 7f86bf7f3640 1 -- 172.21.15.22:0/2401496233 wait complete. 2024-09-10T08:08:43.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bf7f3640 1 Processor -- start 2024-09-10T08:08:43.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bf7f3640 1 -- start start 2024-09-10T08:08:43.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bf7f3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b8100e20 0x7f86b81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:43.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bf7f3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b8102570 0x7f86b8198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:43.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bf7f3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86b8102ef0 0x7f86b819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:43.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bf7f3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f86b8110f80 con 0x7f86b8102570 2024-09-10T08:08:43.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bf7f3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f86b8110e00 con 0x7f86b8100e20 2024-09-10T08:08:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bf7f3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86b8111100 con 0x7f86b8102ef0 2024-09-10T08:08:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bcd8e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b8102570 0x7f86b8198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bcd8e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b8102570 0x7f86b8198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41204/0 (socket says 172.21.15.22:41204) 2024-09-10T08:08:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bcd8e640 1 -- 172.21.15.22:0/708820725 learned_addr learned my addr 172.21.15.22:0/708820725 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bd58f640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b8100e20 0x7f86b81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.020+0000 7f86bdd90640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86b8102ef0 0x7f86b819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.021+0000 7f86bcd8e640 1 -- 172.21.15.22:0/708820725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86b8102ef0 msgr2=0x7f86b819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.021+0000 7f86bcd8e640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86b8102ef0 0x7f86b819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.021+0000 7f86bcd8e640 1 -- 172.21.15.22:0/708820725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b8100e20 msgr2=0x7f86b81984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.021+0000 7f86bcd8e640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b8100e20 0x7f86b81984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.021+0000 7f86bcd8e640 1 -- 172.21.15.22:0/708820725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86b819d490 con 0x7f86b8102570 2024-09-10T08:08:43.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.021+0000 7f86bcd8e640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b8102570 0x7f86b8198a20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f86a8006010 tx=0x7f86a8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.021+0000 7f86ae7fc640 1 -- 172.21.15.22:0/708820725 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a803f070 con 0x7f86b8102570 2024-09-10T08:08:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.021+0000 7f86ae7fc640 1 -- 172.21.15.22:0/708820725 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86a8031c30 con 0x7f86b8102570 2024-09-10T08:08:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.021+0000 7f86bf7f3640 1 -- 172.21.15.22:0/708820725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86b819d720 con 0x7f86b8102570 2024-09-10T08:08:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.021+0000 7f86ae7fc640 1 -- 172.21.15.22:0/708820725 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86a8035030 con 0x7f86b8102570 2024-09-10T08:08:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.021+0000 7f86bf7f3640 1 -- 172.21.15.22:0/708820725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86b81a5060 con 0x7f86b8102570 2024-09-10T08:08:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.023+0000 7f86bf7f3640 1 -- 172.21.15.22:0/708820725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86b8101200 con 0x7f86b8102570 2024-09-10T08:08:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.023+0000 7f86ae7fc640 1 -- 172.21.15.22:0/708820725 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f86a8042070 con 0x7f86b8102570 2024-09-10T08:08:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.024+0000 7f86ae7fc640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f86a40a2c50 0x7f86a40a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.024+0000 7f86bd58f640 1 -- 172.21.15.22:0/708820725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f86a40a2c50 msgr2=0x7f86a40a5110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/1767260330 2024-09-10T08:08:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.025+0000 7f86ae7fc640 1 -- 172.21.15.22:0/708820725 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f86a80ef7d0 con 0x7f86b8102570 2024-09-10T08:08:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.025+0000 7f86bd58f640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f86a40a2c50 0x7f86a40a5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:08:43.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.029+0000 7f86ae7fc640 1 -- 172.21.15.22:0/708820725 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f86a8031de0 con 0x7f86b8102570 2024-09-10T08:08:43.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.226+0000 7f86bd58f640 1 -- 172.21.15.22:0/708820725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f86a40a2c50 msgr2=0x7f86a40a5110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/1767260330 2024-09-10T08:08:43.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.226+0000 7f86bd58f640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f86a40a2c50 0x7f86a40a5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:08:43.225 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:43 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1930255638' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T08:08:43.225 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:43 smithi022 ceph-mon[30854]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-10T08:08:43.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.298+0000 7f86bf7f3640 1 -- 172.21.15.22:0/708820725 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f86b810a0a0 con 0x7f86b8102570 2024-09-10T08:08:43.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.298+0000 7f86ae7fc640 1 -- 172.21.15.22:0/708820725 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f86a80bc0e0 con 0x7f86b8102570 2024-09-10T08:08:43.298 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:08:43.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.301+0000 7f86bf7f3640 1 -- 172.21.15.22:0/708820725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f86a40a2c50 msgr2=0x7f86a40a5110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:08:43.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.301+0000 7f86bf7f3640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f86a40a2c50 0x7f86a40a5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:43.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.301+0000 7f86bf7f3640 1 -- 172.21.15.22:0/708820725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b8102570 msgr2=0x7f86b8198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:43.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.301+0000 7f86bf7f3640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b8102570 0x7f86b8198a20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f86a8006010 tx=0x7f86a8003c10 comp rx=0 tx=0).stop 2024-09-10T08:08:43.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.301+0000 7f86bf7f3640 1 -- 172.21.15.22:0/708820725 shutdown_connections 2024-09-10T08:08:43.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.301+0000 7f86bf7f3640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f86a40a2c50 0x7f86a40a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:43.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.301+0000 7f86bf7f3640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86b8102ef0 0x7f86b819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:43.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.301+0000 7f86bf7f3640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f86b8102570 0x7f86b8198a20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:43.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.301+0000 7f86bf7f3640 1 --2- 172.21.15.22:0/708820725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86b8100e20 0x7f86b81984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:43.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.301+0000 7f86bf7f3640 1 -- 172.21.15.22:0/708820725 >> 172.21.15.22:0/708820725 conn(0x7f86b80fc7d0 msgr2=0x7f86b806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:43.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.301+0000 7f86bf7f3640 1 -- 172.21.15.22:0/708820725 shutdown_connections 2024-09-10T08:08:43.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:43.301+0000 7f86bf7f3640 1 -- 172.21.15.22:0/708820725 wait complete. 2024-09-10T08:08:43.355 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:43 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1930255638' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T08:08:43.355 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:43 smithi100 ceph-mon[35102]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-10T08:08:43.355 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:43 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:43.112+0000 7ff75a0ca040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:08:43.355 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:43 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:43.172+0000 7ff75a0ca040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:08:43.355 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:43 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:43.355+0000 7ff75a0ca040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:08:43.366 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:43 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1930255638' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-10T08:08:43.367 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:43 smithi153 ceph-mon[35609]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-10T08:08:43.367 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:43 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:43.119+0000 7f5c51bd1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:08:43.367 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:43 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:43.180+0000 7f5c51bd1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:08:43.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:43 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:43.254+0000 7f6530af1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:08:43.503 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:43 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:43.320+0000 7f6530af1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:08:43.693 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:43 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:43.366+0000 7f5c51bd1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:08:44.003 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:43 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:43.517+0000 7f6530af1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:08:44.110 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T08:08:44.111 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:08:44.111 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2024-09-10T08:08:44.111 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:08:44.111 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:08:44.111 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T08:08:44.111 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T08:08:44.111 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:08:44.111 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:08:44.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:08:44.111 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2024-09-10T08:08:44.128 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:08:44.129 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:08:44.130 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2024-09-10T08:08:44.130 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:08:44.130 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42189sec preferred_lft 42189sec 2024-09-10T08:08:44.130 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2024-09-10T08:08:44.130 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:08:44.130 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:08:44.130 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:08:44.130 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2024-09-10T08:08:44.130 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T08:08:44.131 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:08:44.131 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-10T08:08:44.131 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2024-09-10T08:08:44.131 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2024-09-10T08:08:44.131 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2024-09-10T08:08:44.131 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T08:08:44.131 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-10T08:08:44.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:08:44.338 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:44 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/708820725' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T08:08:44.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:08:44.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:08:44.350 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:08:44.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:44 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/708820725' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T08:08:44.368 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:44 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:44.237+0000 7ff75a0ca040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:08:44.368 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:44 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:44.304+0000 7ff75a0ca040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:08:44.377 INFO:teuthology.orchestra.run.smithi022.stdout:1 2024-09-10T08:08:44.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:08:44.379 DEBUG:teuthology.orchestra.run.smithi022:> route 2024-09-10T08:08:44.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:44 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/708820725' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-10T08:08:44.444 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:44 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:44.261+0000 7f5c51bd1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:08:44.444 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:44 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:44.329+0000 7f5c51bd1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:08:44.445 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2024-09-10T08:08:44.445 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:08:44.445 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:08:44.445 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:08:44.445 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:08:44.446 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:08:44.446 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-10T08:08:44.446 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:08:44.446 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:08:44.446 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:08:44.446 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-10T08:08:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:08:44.682 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:44 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:44.472+0000 7f6530af1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:08:44.682 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:44 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:44.546+0000 7f6530af1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:08:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:08:44.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:08:44.788 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-10T08:08:44.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:08:44.805 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2024-09-10T08:08:44.861 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:08:44.862 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-10T08:08:44.862 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:08:44.862 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T08:08:44.862 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-10T08:08:44.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:08:44.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:08:44.987 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T08:08:44.988 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:08:44.988 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-10T08:08:44.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T08:08:44.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T08:08:44.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T08:08:44.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T08:08:44.988 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T08:08:44.988 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-10T08:08:45.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:08:45.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:08:45.123 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:08:45.124 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-10T08:08:45.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2024-09-10T08:08:45.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T08:08:45.124 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-10T08:08:45.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:08:45.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:08:45.207 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:08:45.207 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:08:45.224 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:08:45.224 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:08:45.224 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:08:45.266 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:45.010+0000 7ff75a0ca040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:08:45.266 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:45.124+0000 7ff75a0ca040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:08:45.281 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T08:08:45.281 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T08:08:45.281 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/ed8de887-cb34-4648-b138-9c2b0ae19cf9 2024-09-10T08:08:45.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:08:45.281 DEBUG:teuthology.orchestra.run.smithi022:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/ed8de887-cb34-4648-b138-9c2b0ae19cf9 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,nofallback 2024-09-10T08:08:45.305 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:45.043+0000 7f5c51bd1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:08:45.305 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:45.161+0000 7f5c51bd1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:08:45.410 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,nofallback 2024-09-10T08:08:45.411 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync". 2024-09-10T08:08:45.544 INFO:teuthology.orchestra.run.smithi022.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,nowsync,nofallback 2024-09-10T08:08:45.544 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync". 2024-09-10T08:08:45.545 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: resolved to: "172.21.15.22:3300,172.21.15.100:3300,172.21.15.153:3300" 2024-09-10T08:08:45.545 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: trying mount with new device syntax: 0@71bf679e-6f4a-11ef-bcea-c7b262605968.cephfs=/volumes/qa/sv_1/ed8de887-cb34-4648-b138-9c2b0ae19cf9 2024-09-10T08:08:45.545 INFO:teuthology.orchestra.run.smithi022.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,nowsync,name=0,key=0,mon_addr=172.21.15.22:3300/172.21.15.100:3300/172.21.15.153:3300" will pass to kernel 2024-09-10T08:08:45.545 INFO:teuthology.orchestra.run.smithi022.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:08:45.545 INFO:teuthology.orchestra.run.smithi022.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:08:45.546 INFO:teuthology.orchestra.run.smithi022.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:08:45.546 INFO:teuthology.orchestra.run.smithi022.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:08:45.546 INFO:teuthology.orchestra.run.smithi022.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:08:45.546 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:45.267+0000 7ff75a0ca040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:08:45.546 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:45.328+0000 7ff75a0ca040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:08:45.546 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:45.478+0000 7ff75a0ca040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:08:45.546 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:45.547+0000 7ff75a0ca040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:08:45.547 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:08:45.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:08:45.547 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:08:45.574 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:08:45.587 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:45.305+0000 7f5c51bd1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:08:45.587 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:45.366+0000 7f5c51bd1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:08:45.587 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:45.516+0000 7f5c51bd1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:08:45.587 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:45.586+0000 7f5c51bd1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:08:45.617 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:45.338+0000 7f6530af1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:08:45.617 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:45.463+0000 7f6530af1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:08:45.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:08:45.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:08:45.673 INFO:teuthology.orchestra.run.smithi022.stdout:client24874 2024-09-10T08:08:45.673 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T08:08:45.673 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:08:45.690 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:08:45.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:08:45.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:08:45.790 INFO:teuthology.orchestra.run.smithi022.stdout:client24874 2024-09-10T08:08:45.790 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:08:45.833 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:45.607+0000 7ff75a0ca040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:08:45.833 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:45.767+0000 7ff75a0ca040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:08:45.833 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:45.833+0000 7ff75a0ca040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:08:45.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:08:45.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:08:45.847 INFO:teuthology.orchestra.run.smithi022.stdout:client24874 2024-09-10T08:08:45.848 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968.client24874/status') 2024-09-10T08:08:45.871 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:45.647+0000 7f5c51bd1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:08:45.871 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:45.805+0000 7f5c51bd1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:08:45.872 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:45.871+0000 7f5c51bd1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:08:45.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:08:45.907 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:45.617+0000 7f6530af1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:08:45.907 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:45.684+0000 7f6530af1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:08:45.907 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:45.846+0000 7f6530af1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:08:45.909 INFO:teuthology.orchestra.run.smithi022.stdout:instance: client.24874 (3)172.21.15.22:0/2074773420 2024-09-10T08:08:45.909 INFO:teuthology.orchestra.run.smithi022.stdout:blocklisted: false 2024-09-10T08:08:45.909 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records in 2024-09-10T08:08:45.909 INFO:teuthology.orchestra.run.smithi022.stderr:0+1 records out 2024-09-10T08:08:45.909 INFO:teuthology.orchestra.run.smithi022.stderr:71 bytes copied, 2.4624e-05 s, 2.9 MB/s 2024-09-10T08:08:45.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:08:45.917 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T08:08:45.926 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T08:08:45.926 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-10T08:08:45.926 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-10T08:08:46.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.034+0000 7f11937d6640 1 -- 172.21.15.22:0/1141193195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c101c30 msgr2=0x7f118c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.034+0000 7f11937d6640 1 --2- 172.21.15.22:0/1141193195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c101c30 0x7f118c1020b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f117c009900 tx=0x7f117c02a410 comp rx=0 tx=0).stop 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.034+0000 7f11937d6640 1 -- 172.21.15.22:0/1141193195 shutdown_connections 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.034+0000 7f11937d6640 1 --2- 172.21.15.22:0/1141193195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c1025f0 0x7f118c108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.034+0000 7f11937d6640 1 --2- 172.21.15.22:0/1141193195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c101c30 0x7f118c1020b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.034+0000 7f11937d6640 1 --2- 172.21.15.22:0/1141193195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f118c100a40 0x7f118c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.034+0000 7f11937d6640 1 -- 172.21.15.22:0/1141193195 >> 172.21.15.22:0/1141193195 conn(0x7f118c0fc1e0 msgr2=0x7f118c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.034+0000 7f11937d6640 1 -- 172.21.15.22:0/1141193195 shutdown_connections 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.034+0000 7f11937d6640 1 -- 172.21.15.22:0/1141193195 wait complete. 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f11937d6640 1 Processor -- start 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f11937d6640 1 -- start start 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f11937d6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f118c100a40 0x7f118c06a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f11937d6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c101c30 0x7f118c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:46.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f11937d6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c1025f0 0x7f118c1a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f11937d6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f118c10c6a0 con 0x7f118c101c30 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f11937d6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f118c10c520 con 0x7f118c1025f0 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f11937d6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f118c10c820 con 0x7f118c100a40 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f1190d71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c101c30 0x7f118c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f1190d71640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c101c30 0x7f118c19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59030/0 (socket says 172.21.15.22:59030) 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f1190d71640 1 -- 172.21.15.22:0/512606842 learned_addr learned my addr 172.21.15.22:0/512606842 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f1191572640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f118c100a40 0x7f118c06a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f1191d73640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c1025f0 0x7f118c1a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f1190d71640 1 -- 172.21.15.22:0/512606842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f118c100a40 msgr2=0x7f118c06a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f1190d71640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f118c100a40 0x7f118c06a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f1190d71640 1 -- 172.21.15.22:0/512606842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c1025f0 msgr2=0x7f118c1a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f1190d71640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c1025f0 0x7f118c1a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f1190d71640 1 -- 172.21.15.22:0/512606842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118c1a1c50 con 0x7f118c101c30 2024-09-10T08:08:46.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.035+0000 7f1191572640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f118c100a40 0x7f118c06a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:08:46.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.036+0000 7f1190d71640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c101c30 0x7f118c19ef10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f117c009230 tx=0x7f117c031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:46.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.036+0000 7f11827fc640 1 -- 172.21.15.22:0/512606842 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c03f030 con 0x7f118c101c30 2024-09-10T08:08:46.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.036+0000 7f11827fc640 1 -- 172.21.15.22:0/512606842 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f117c003ad0 con 0x7f118c101c30 2024-09-10T08:08:46.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.036+0000 7f11937d6640 1 -- 172.21.15.22:0/512606842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118c1a1e80 con 0x7f118c101c30 2024-09-10T08:08:46.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.036+0000 7f11827fc640 1 -- 172.21.15.22:0/512606842 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c035070 con 0x7f118c101c30 2024-09-10T08:08:46.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.036+0000 7f11937d6640 1 -- 172.21.15.22:0/512606842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f118c1a22f0 con 0x7f118c101c30 2024-09-10T08:08:46.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.037+0000 7f11937d6640 1 -- 172.21.15.22:0/512606842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f118c107de0 con 0x7f118c101c30 2024-09-10T08:08:46.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.039+0000 7f11827fc640 1 -- 172.21.15.22:0/512606842 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f117c042030 con 0x7f118c101c30 2024-09-10T08:08:46.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.040+0000 7f11827fc640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f11780a2d30 0x7f11780a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:46.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.040+0000 7f1191572640 1 -- 172.21.15.22:0/512606842 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f11780a2d30 msgr2=0x7f11780a51f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/1767260330 2024-09-10T08:08:46.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.040+0000 7f11827fc640 1 -- 172.21.15.22:0/512606842 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f117c0ef4f0 con 0x7f118c101c30 2024-09-10T08:08:46.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.040+0000 7f1191572640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f11780a2d30 0x7f11780a51f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:08:46.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.044+0000 7f11827fc640 1 -- 172.21.15.22:0/512606842 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f117c0bbdc0 con 0x7f118c101c30 2024-09-10T08:08:46.104 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:45.899+0000 7ff75a0ca040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:08:46.104 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:45.985+0000 7ff75a0ca040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:08:46.104 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:46 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:46.045+0000 7ff75a0ca040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:08:46.104 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:46 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:46.104+0000 7ff75a0ca040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:08:46.142 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:45.941+0000 7f5c51bd1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:08:46.142 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:46 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:46.023+0000 7f5c51bd1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:08:46.143 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:46 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:46.083+0000 7f5c51bd1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:08:46.143 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:46 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:46.142+0000 7f5c51bd1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:08:46.159 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:45.921+0000 7f6530af1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:08:46.159 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:45.988+0000 7f6530af1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:08:46.159 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:46.159+0000 7f6530af1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:08:46.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.241+0000 7f1191572640 1 -- 172.21.15.22:0/512606842 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f11780a2d30 msgr2=0x7f11780a51f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/1767260330 2024-09-10T08:08:46.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.241+0000 7f1191572640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f11780a2d30 0x7f11780a51f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:08:46.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.263+0000 7f11937d6640 1 -- 172.21.15.22:0/512606842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f118c062e90 con 0x7f118c101c30 2024-09-10T08:08:46.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.315+0000 7f11827fc640 1 -- 172.21.15.22:0/512606842 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7f117c0c00c0 con 0x7f118c101c30 2024-09-10T08:08:46.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.318+0000 7f11937d6640 1 -- 172.21.15.22:0/512606842 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f11780a2d30 msgr2=0x7f11780a51f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:08:46.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.318+0000 7f11937d6640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f11780a2d30 0x7f11780a51f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.318+0000 7f11937d6640 1 -- 172.21.15.22:0/512606842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c101c30 msgr2=0x7f118c19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:46.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.318+0000 7f11937d6640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c101c30 0x7f118c19ef10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f117c009230 tx=0x7f117c031b60 comp rx=0 tx=0).stop 2024-09-10T08:08:46.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.318+0000 7f11937d6640 1 -- 172.21.15.22:0/512606842 shutdown_connections 2024-09-10T08:08:46.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.318+0000 7f11937d6640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f11780a2d30 0x7f11780a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.318+0000 7f11937d6640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f118c1025f0 0x7f118c1a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.318+0000 7f11937d6640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f118c101c30 0x7f118c19ef10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.318+0000 7f11937d6640 1 --2- 172.21.15.22:0/512606842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f118c100a40 0x7f118c06a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.318+0000 7f11937d6640 1 -- 172.21.15.22:0/512606842 >> 172.21.15.22:0/512606842 conn(0x7f118c0fc1e0 msgr2=0x7f118c104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:46.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.318+0000 7f11937d6640 1 -- 172.21.15.22:0/512606842 shutdown_connections 2024-09-10T08:08:46.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.318+0000 7f11937d6640 1 -- 172.21.15.22:0/512606842 wait complete. 2024-09-10T08:08:46.329 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T08:08:46.339 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T08:08:46.347 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T08:08:46.347 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-10T08:08:46.348 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-10T08:08:46.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:46 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/512606842' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T08:08:46.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:46 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/512606842' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T08:08:46.453 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:46 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/512606842' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-09-10T08:08:46.454 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:46.228+0000 7f6530af1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:08:46.454 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:46.298+0000 7f6530af1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:08:46.454 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:46.388+0000 7f6530af1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:08:46.454 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:46.454+0000 7f6530af1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:08:46.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.457+0000 7f7409398640 1 -- 172.21.15.22:0/2624107359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7404102d50 msgr2=0x7f74041031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:46.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.457+0000 7f7409398640 1 --2- 172.21.15.22:0/2624107359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7404102d50 0x7f74041031d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009860 tx=0x7f73f802a340 comp rx=0 tx=0).stop 2024-09-10T08:08:46.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.457+0000 7f7409398640 1 -- 172.21.15.22:0/2624107359 shutdown_connections 2024-09-10T08:08:46.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.457+0000 7f7409398640 1 --2- 172.21.15.22:0/2624107359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7404103710 0x7f7404109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.457+0000 7f7409398640 1 --2- 172.21.15.22:0/2624107359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7404102d50 0x7f74041031d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.457+0000 7f7409398640 1 --2- 172.21.15.22:0/2624107359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7404101b60 0x7f7404101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.457+0000 7f7409398640 1 -- 172.21.15.22:0/2624107359 >> 172.21.15.22:0/2624107359 conn(0x7f74040fd2e0 msgr2=0x7f74040ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:46.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.457+0000 7f7409398640 1 -- 172.21.15.22:0/2624107359 shutdown_connections 2024-09-10T08:08:46.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.457+0000 7f7409398640 1 -- 172.21.15.22:0/2624107359 wait complete. 2024-09-10T08:08:46.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.457+0000 7f7409398640 1 Processor -- start 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.457+0000 7f7409398640 1 -- start start 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7409398640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7404101b60 0x7f7404197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7409398640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7404102d50 0x7f7404198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7409398640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7404103710 0x7f740419f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7409398640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f740410d7e0 con 0x7f7404101b60 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7409398640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f740410d660 con 0x7f7404103710 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7409398640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f740410d960 con 0x7f7404102d50 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7402ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7404101b60 0x7f7404197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7402ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7404101b60 0x7f7404197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59050/0 (socket says 172.21.15.22:59050) 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7402ffd640 1 -- 172.21.15.22:0/2539003150 learned_addr learned my addr 172.21.15.22:0/2539003150 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f74027fc640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7404102d50 0x7f7404198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f74037fe640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7404103710 0x7f740419f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:46.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7402ffd640 1 -- 172.21.15.22:0/2539003150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7404102d50 msgr2=0x7f7404198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:46.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7402ffd640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7404102d50 0x7f7404198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7402ffd640 1 -- 172.21.15.22:0/2539003150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7404103710 msgr2=0x7f740419f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:46.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7402ffd640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7404103710 0x7f740419f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7402ffd640 1 -- 172.21.15.22:0/2539003150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740419fa00 con 0x7f7404101b60 2024-09-10T08:08:46.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7402ffd640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7404101b60 0x7f7404197de0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f73f400e9c0 tx=0x7f73f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:46.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f73ebfff640 1 -- 172.21.15.22:0/2539003150 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f400cd80 con 0x7f7404101b60 2024-09-10T08:08:46.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f73ebfff640 1 -- 172.21.15.22:0/2539003150 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73f40035f0 con 0x7f7404101b60 2024-09-10T08:08:46.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f7409398640 1 -- 172.21.15.22:0/2539003150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740419fcf0 con 0x7f7404101b60 2024-09-10T08:08:46.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.458+0000 7f73ebfff640 1 -- 172.21.15.22:0/2539003150 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4010690 con 0x7f7404101b60 2024-09-10T08:08:46.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.459+0000 7f7409398640 1 -- 172.21.15.22:0/2539003150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74041a01c0 con 0x7f7404101b60 2024-09-10T08:08:46.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.460+0000 7f7409398640 1 -- 172.21.15.22:0/2539003150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7404108f50 con 0x7f7404101b60 2024-09-10T08:08:46.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.461+0000 7f73ebfff640 1 -- 172.21.15.22:0/2539003150 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7f73f40037a0 con 0x7f7404101b60 2024-09-10T08:08:46.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.461+0000 7f73ebfff640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f73ec0a2c80 0x7f73ec0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:46.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.461+0000 7f74027fc640 1 -- 172.21.15.22:0/2539003150 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f73ec0a2c80 msgr2=0x7f73ec0a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/1767260330 2024-09-10T08:08:46.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.461+0000 7f73ebfff640 1 -- 172.21.15.22:0/2539003150 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7f73f40cf3f0 con 0x7f7404101b60 2024-09-10T08:08:46.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.461+0000 7f74027fc640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f73ec0a2c80 0x7f73ec0a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:08:46.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.465+0000 7f73ebfff640 1 -- 172.21.15.22:0/2539003150 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f73f409c350 con 0x7f7404101b60 2024-09-10T08:08:46.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.654+0000 7f7409398640 1 -- 172.21.15.22:0/2539003150 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f740402d7c0 con 0x7f7404101b60 2024-09-10T08:08:46.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.658+0000 7f73ebfff640 1 -- 172.21.15.22:0/2539003150 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v28)=0 v28) ==== 129+0+0 (secure 0 0 0) 0x7f740402d7c0 con 0x7f7404101b60 2024-09-10T08:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.660+0000 7f7409398640 1 -- 172.21.15.22:0/2539003150 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f73ec0a2c80 msgr2=0x7f73ec0a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.660+0000 7f7409398640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f73ec0a2c80 0x7f73ec0a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.660+0000 7f7409398640 1 -- 172.21.15.22:0/2539003150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7404101b60 msgr2=0x7f7404197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.660+0000 7f7409398640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7404101b60 0x7f7404197de0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f73f400e9c0 tx=0x7f73f400ee80 comp rx=0 tx=0).stop 2024-09-10T08:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.660+0000 7f7409398640 1 -- 172.21.15.22:0/2539003150 shutdown_connections 2024-09-10T08:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.660+0000 7f7409398640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7f73ec0a2c80 0x7f73ec0a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.660+0000 7f7409398640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7404103710 0x7f740419f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.660+0000 7f7409398640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7404102d50 0x7f7404198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.660+0000 7f7409398640 1 --2- 172.21.15.22:0/2539003150 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7404101b60 0x7f7404197de0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.660+0000 7f7409398640 1 -- 172.21.15.22:0/2539003150 >> 172.21.15.22:0/2539003150 conn(0x7f74040fd2e0 msgr2=0x7f7404106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.660+0000 7f7409398640 1 -- 172.21.15.22:0/2539003150 shutdown_connections 2024-09-10T08:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.660+0000 7f7409398640 1 -- 172.21.15.22:0/2539003150 wait complete. 2024-09-10T08:08:46.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-10T08:08:46.753 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:46.528+0000 7f6530af1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:08:46.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.776+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1799338478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb90100a40 msgr2=0x7fbb90100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:46.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.776+0000 7fbb95f9f640 1 --2- 172.21.15.22:0/1799338478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb90100a40 0x7fbb90100e40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009860 tx=0x7fbb8002a340 comp rx=0 tx=0).stop 2024-09-10T08:08:46.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.776+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1799338478 shutdown_connections 2024-09-10T08:08:46.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.776+0000 7fbb95f9f640 1 --2- 172.21.15.22:0/1799338478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb901025f0 0x7fbb90108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.776+0000 7fbb95f9f640 1 --2- 172.21.15.22:0/1799338478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb90101c30 0x7fbb901020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.776+0000 7fbb95f9f640 1 --2- 172.21.15.22:0/1799338478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb90100a40 0x7fbb90100e40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.776+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1799338478 >> 172.21.15.22:0/1799338478 conn(0x7fbb900fc1e0 msgr2=0x7fbb900fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:46.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.776+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1799338478 shutdown_connections 2024-09-10T08:08:46.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.776+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1799338478 wait complete. 2024-09-10T08:08:46.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.777+0000 7fbb95f9f640 1 Processor -- start 2024-09-10T08:08:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.777+0000 7fbb95f9f640 1 -- start start 2024-09-10T08:08:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.777+0000 7fbb95f9f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb90100a40 0x7fbb90104b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.777+0000 7fbb95f9f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb90101c30 0x7fbb901031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.777+0000 7fbb95f9f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb901025f0 0x7fbb901036f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.777+0000 7fbb95f9f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9010c6a0 con 0x7fbb90101c30 2024-09-10T08:08:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.777+0000 7fbb95f9f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9010c520 con 0x7fbb901025f0 2024-09-10T08:08:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.777+0000 7fbb95f9f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9010c820 con 0x7fbb90100a40 2024-09-10T08:08:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.777+0000 7fbb87fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb90101c30 0x7fbb901031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.777+0000 7fbb87fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb90101c30 0x7fbb901031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59074/0 (socket says 172.21.15.22:59074) 2024-09-10T08:08:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.777+0000 7fbb87fff640 1 -- 172.21.15.22:0/1350947810 learned_addr learned my addr 172.21.15.22:0/1350947810 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.777+0000 7fbb8f7fe640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb90100a40 0x7fbb90104b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:46.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb8ffff640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb901025f0 0x7fbb901036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb8f7fe640 1 -- 172.21.15.22:0/1350947810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb901025f0 msgr2=0x7fbb901036f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb8f7fe640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb901025f0 0x7fbb901036f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb8f7fe640 1 -- 172.21.15.22:0/1350947810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb90101c30 msgr2=0x7fbb901031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb8f7fe640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb90101c30 0x7fbb901031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb8f7fe640 1 -- 172.21.15.22:0/1350947810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb90103f80 con 0x7fbb90100a40 2024-09-10T08:08:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb87fff640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb90101c30 0x7fbb901031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:08:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb8f7fe640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb90100a40 0x7fbb90104b70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb80035040 tx=0x7fbb80033d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb8d7fa640 1 -- 172.21.15.22:0/1350947810 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80037040 con 0x7fbb90100a40 2024-09-10T08:08:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb8d7fa640 1 -- 172.21.15.22:0/1350947810 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb80004040 con 0x7fbb90100a40 2024-09-10T08:08:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1350947810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb901a1eb0 con 0x7fbb90100a40 2024-09-10T08:08:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb8d7fa640 1 -- 172.21.15.22:0/1350947810 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80005650 con 0x7fbb90100a40 2024-09-10T08:08:46.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.778+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1350947810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb901a22c0 con 0x7fbb90100a40 2024-09-10T08:08:46.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.779+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1350947810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb901a25b0 con 0x7fbb90100a40 2024-09-10T08:08:46.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.781+0000 7fbb8d7fa640 1 -- 172.21.15.22:0/1350947810 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7fbb80042020 con 0x7fbb90100a40 2024-09-10T08:08:46.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.781+0000 7fbb8d7fa640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbb7c0a2c80 0x7fbb7c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:46.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.781+0000 7fbb87fff640 1 -- 172.21.15.22:0/1350947810 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbb7c0a2c80 msgr2=0x7fbb7c0a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/1767260330 2024-09-10T08:08:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.781+0000 7fbb8d7fa640 1 -- 172.21.15.22:0/1350947810 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7fbb800eee60 con 0x7fbb90100a40 2024-09-10T08:08:46.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.781+0000 7fbb87fff640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbb7c0a2c80 0x7fbb7c0a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:08:46.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.789+0000 7fbb8d7fa640 1 -- 172.21.15.22:0/1350947810 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb80049020 con 0x7fbb90100a40 2024-09-10T08:08:46.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.967+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1350947810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fbb901a2780 con 0x7fbb90100a40 2024-09-10T08:08:46.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.975+0000 7fbb8d7fa640 1 -- 172.21.15.22:0/1350947810 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7fbb800bbd80 con 0x7fbb90100a40 2024-09-10T08:08:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.977+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1350947810 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbb7c0a2c80 msgr2=0x7fbb7c0a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:08:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.977+0000 7fbb95f9f640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbb7c0a2c80 0x7fbb7c0a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.977+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1350947810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb90100a40 msgr2=0x7fbb90104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.977+0000 7fbb95f9f640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb90100a40 0x7fbb90104b70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb80035040 tx=0x7fbb80033d90 comp rx=0 tx=0).stop 2024-09-10T08:08:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.977+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1350947810 shutdown_connections 2024-09-10T08:08:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.977+0000 7fbb95f9f640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7fbb7c0a2c80 0x7fbb7c0a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.977+0000 7fbb95f9f640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb901025f0 0x7fbb901036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.977+0000 7fbb95f9f640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb90101c30 0x7fbb901031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.977+0000 7fbb95f9f640 1 --2- 172.21.15.22:0/1350947810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb90100a40 0x7fbb90104b70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.977+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1350947810 >> 172.21.15.22:0/1350947810 conn(0x7fbb900fc1e0 msgr2=0x7fbb900698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.977+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1350947810 shutdown_connections 2024-09-10T08:08:46.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:46.977+0000 7fbb95f9f640 1 -- 172.21.15.22:0/1350947810 wait complete. 2024-09-10T08:08:46.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-10T08:08:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.093+0000 7ff38a877640 1 -- 172.21.15.22:0/1940693004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384101b60 msgr2=0x7ff384101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.093+0000 7ff38a877640 1 --2- 172.21.15.22:0/1940693004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384101b60 0x7ff384101f60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff374009900 tx=0x7ff37402a410 comp rx=0 tx=0).stop 2024-09-10T08:08:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.093+0000 7ff38a877640 1 -- 172.21.15.22:0/1940693004 shutdown_connections 2024-09-10T08:08:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.093+0000 7ff38a877640 1 --2- 172.21.15.22:0/1940693004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff384103710 0x7ff384109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.093+0000 7ff38a877640 1 --2- 172.21.15.22:0/1940693004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff384102d50 0x7ff3841031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.093+0000 7ff38a877640 1 --2- 172.21.15.22:0/1940693004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384101b60 0x7ff384101f60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.093+0000 7ff38a877640 1 -- 172.21.15.22:0/1940693004 >> 172.21.15.22:0/1940693004 conn(0x7ff3840fd2e0 msgr2=0x7ff3840ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.093+0000 7ff38a877640 1 -- 172.21.15.22:0/1940693004 shutdown_connections 2024-09-10T08:08:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.093+0000 7ff38a877640 1 -- 172.21.15.22:0/1940693004 wait complete. 2024-09-10T08:08:47.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff38a877640 1 Processor -- start 2024-09-10T08:08:47.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff38a877640 1 -- start start 2024-09-10T08:08:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff38a877640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384101b60 0x7ff384197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff38a877640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff384102d50 0x7ff384198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff38a877640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff384103710 0x7ff38419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff38a877640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff38410d7e0 con 0x7ff384101b60 2024-09-10T08:08:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff38a877640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff38410d660 con 0x7ff384103710 2024-09-10T08:08:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff38a877640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff38410d960 con 0x7ff384102d50 2024-09-10T08:08:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff383fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384101b60 0x7ff384197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff383fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384101b60 0x7ff384197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59080/0 (socket says 172.21.15.22:59080) 2024-09-10T08:08:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff383fff640 1 -- 172.21.15.22:0/2652114562 learned_addr learned my addr 172.21.15.22:0/2652114562 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff3837fe640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff384102d50 0x7ff384198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff388e14640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff384103710 0x7ff38419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:47.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff383fff640 1 -- 172.21.15.22:0/2652114562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff384102d50 msgr2=0x7ff384198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.094+0000 7ff383fff640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff384102d50 0x7ff384198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.095+0000 7ff383fff640 1 -- 172.21.15.22:0/2652114562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff384103710 msgr2=0x7ff38419f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.095+0000 7ff383fff640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff384103710 0x7ff38419f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.095+0000 7ff383fff640 1 -- 172.21.15.22:0/2652114562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38419fa20 con 0x7ff384101b60 2024-09-10T08:08:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.095+0000 7ff383fff640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384101b60 0x7ff384197e00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff374031610 tx=0x7ff374004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.095+0000 7ff3817fa640 1 -- 172.21.15.22:0/2652114562 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37403f030 con 0x7ff384101b60 2024-09-10T08:08:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.095+0000 7ff38a877640 1 -- 172.21.15.22:0/2652114562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38419fcb0 con 0x7ff384101b60 2024-09-10T08:08:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.095+0000 7ff3817fa640 1 -- 172.21.15.22:0/2652114562 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff374003ad0 con 0x7ff384101b60 2024-09-10T08:08:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.095+0000 7ff3817fa640 1 -- 172.21.15.22:0/2652114562 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff374035070 con 0x7ff384101b60 2024-09-10T08:08:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.095+0000 7ff38a877640 1 -- 172.21.15.22:0/2652114562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3841a01a0 con 0x7ff384101b60 2024-09-10T08:08:47.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.096+0000 7ff38a877640 1 -- 172.21.15.22:0/2652114562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff384108e80 con 0x7ff384101b60 2024-09-10T08:08:47.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.098+0000 7ff3817fa640 1 -- 172.21.15.22:0/2652114562 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 19) ==== 137850+0+0 (secure 0 0 0) 0x7ff374042030 con 0x7ff384101b60 2024-09-10T08:08:47.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.099+0000 7ff3817fa640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff36c0a2c80 0x7ff36c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:47.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.099+0000 7ff3837fe640 1 -- 172.21.15.22:0/2652114562 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff36c0a2c80 msgr2=0x7ff36c0a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.22:6800/1767260330 2024-09-10T08:08:47.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.099+0000 7ff3817fa640 1 -- 172.21.15.22:0/2652114562 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8240+0+0 (secure 0 0 0) 0x7ff3740ef960 con 0x7ff384101b60 2024-09-10T08:08:47.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.099+0000 7ff3837fe640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff36c0a2c80 0x7ff36c0a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:08:47.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.101+0000 7ff3817fa640 1 -- 172.21.15.22:0/2652114562 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3740bc270 con 0x7ff384101b60 2024-09-10T08:08:47.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.277+0000 7ff38a877640 1 -- 172.21.15.22:0/2652114562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7ff384062e60 con 0x7ff384101b60 2024-09-10T08:08:47.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.281+0000 7ff3817fa640 1 -- 172.21.15.22:0/2652114562 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7ff3740c0570 con 0x7ff384101b60 2024-09-10T08:08:47.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.283+0000 7ff38a877640 1 -- 172.21.15.22:0/2652114562 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff36c0a2c80 msgr2=0x7ff36c0a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:08:47.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.283+0000 7ff38a877640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff36c0a2c80 0x7ff36c0a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.283+0000 7ff38a877640 1 -- 172.21.15.22:0/2652114562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384101b60 msgr2=0x7ff384197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.283+0000 7ff38a877640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384101b60 0x7ff384197e00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff374031610 tx=0x7ff374004270 comp rx=0 tx=0).stop 2024-09-10T08:08:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.283+0000 7ff38a877640 1 -- 172.21.15.22:0/2652114562 shutdown_connections 2024-09-10T08:08:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.283+0000 7ff38a877640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.22:6800/1767260330,v1:172.21.15.22:6801/1767260330] conn(0x7ff36c0a2c80 0x7ff36c0a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.283+0000 7ff38a877640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff384103710 0x7ff38419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.283+0000 7ff38a877640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff384102d50 0x7ff384198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.283+0000 7ff38a877640 1 --2- 172.21.15.22:0/2652114562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff384101b60 0x7ff384197e00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.283+0000 7ff38a877640 1 -- 172.21.15.22:0/2652114562 >> 172.21.15.22:0/2652114562 conn(0x7ff3840fd2e0 msgr2=0x7ff384106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.283+0000 7ff38a877640 1 -- 172.21.15.22:0/2652114562 shutdown_connections 2024-09-10T08:08:47.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.283+0000 7ff38a877640 1 -- 172.21.15.22:0/2652114562 wait complete. 2024-09-10T08:08:47.293 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-10T08:08:47.321 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:08:46 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y[36472]: 2024-09-10T08:08:46.893+0000 7ff75a0ca040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:08:47.323 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:08:46 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z[37417]: 2024-09-10T08:08:46.947+0000 7f5c51bd1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:08:47.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.413+0000 7fb102542640 1 -- 172.21.15.22:0/1530977751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0fc107890 msgr2=0x7fb0fc109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:47.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.413+0000 7fb102542640 1 --2- 172.21.15.22:0/1530977751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0fc107890 0x7fb0fc109ca0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009ca0 tx=0x7fb0f402a8c0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.413+0000 7fb102542640 1 -- 172.21.15.22:0/1530977751 shutdown_connections 2024-09-10T08:08:47.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.413+0000 7fb102542640 1 --2- 172.21.15.22:0/1530977751 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0fc107890 0x7fb0fc109ca0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.413+0000 7fb102542640 1 --2- 172.21.15.22:0/1530977751 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0fc104f60 0x7fb0fc107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.413+0000 7fb102542640 1 --2- 172.21.15.22:0/1530977751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc102630 0x7fb0fc104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.413+0000 7fb102542640 1 -- 172.21.15.22:0/1530977751 >> 172.21.15.22:0/1530977751 conn(0x7fb0fc0fc1b0 msgr2=0x7fb0fc0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.413+0000 7fb102542640 1 -- 172.21.15.22:0/1530977751 shutdown_connections 2024-09-10T08:08:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.413+0000 7fb102542640 1 -- 172.21.15.22:0/1530977751 wait complete. 2024-09-10T08:08:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.414+0000 7fb102542640 1 Processor -- start 2024-09-10T08:08:47.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.414+0000 7fb102542640 1 -- start start 2024-09-10T08:08:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.414+0000 7fb102542640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0fc102630 0x7fb0fc197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.414+0000 7fb102542640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc104f60 0x7fb0fc198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.414+0000 7fb102542640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0fc107890 0x7fb0fc19f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.414+0000 7fb102542640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0fc10d810 con 0x7fb0fc107890 2024-09-10T08:08:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.414+0000 7fb102542640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb0fc10d690 con 0x7fb0fc102630 2024-09-10T08:08:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.414+0000 7fb102542640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb0fc10d990 con 0x7fb0fc104f60 2024-09-10T08:08:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb100adf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0fc107890 0x7fb0fc19f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb0fbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0fc102630 0x7fb0fc197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb100adf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0fc107890 0x7fb0fc19f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59124/0 (socket says 172.21.15.22:59124) 2024-09-10T08:08:47.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb100adf640 1 -- 172.21.15.22:0/658357735 learned_addr learned my addr 172.21.15.22:0/658357735 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb0fb7fe640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc104f60 0x7fb0fc198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb100adf640 1 -- 172.21.15.22:0/658357735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc104f60 msgr2=0x7fb0fc198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb100adf640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc104f60 0x7fb0fc198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb100adf640 1 -- 172.21.15.22:0/658357735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0fc102630 msgr2=0x7fb0fc197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb100adf640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0fc102630 0x7fb0fc197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb100adf640 1 -- 172.21.15.22:0/658357735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0fc19fa60 con 0x7fb0fc107890 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb0fbfff640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0fc102630 0x7fb0fc197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb100adf640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0fc107890 0x7fb0fc19f3f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4006010 tx=0x7fb0f4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb0f97fa640 1 -- 172.21.15.22:0/658357735 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4003b70 con 0x7fb0fc107890 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb102542640 1 -- 172.21.15.22:0/658357735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0fc19fcf0 con 0x7fb0fc107890 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb0f97fa640 1 -- 172.21.15.22:0/658357735 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb0f4003d10 con 0x7fb0fc107890 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb0f97fa640 1 -- 172.21.15.22:0/658357735 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f402fc40 con 0x7fb0fc107890 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.415+0000 7fb102542640 1 -- 172.21.15.22:0/658357735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0fc1a0230 con 0x7fb0fc107890 2024-09-10T08:08:47.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.417+0000 7fb102542640 1 -- 172.21.15.22:0/658357735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0fc0fdca0 con 0x7fb0fc107890 2024-09-10T08:08:47.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.419+0000 7fb0f97fa640 1 -- 172.21.15.22:0/658357735 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 20) ==== 137518+0+0 (secure 0 0 0) 0x7fb0f4004050 con 0x7fb0fc107890 2024-09-10T08:08:47.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.419+0000 7fb0f97fa640 1 -- 172.21.15.22:0/658357735 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8498+0+0 (secure 0 0 0) 0x7fb0f40f03c0 con 0x7fb0fc107890 2024-09-10T08:08:47.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:47.422+0000 7fb0f97fa640 1 -- 172.21.15.22:0/658357735 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb0f40bd6d0 con 0x7fb0fc107890 2024-09-10T08:08:47.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/512606842' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T08:08:47.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:08:47.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2539003150' entity='client.admin' 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: Standby manager daemon y restarted 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: Standby manager daemon y started 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.100:0/1982738165' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.100:0/1982738165' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.100:0/1982738165' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.100:0/1982738165' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: Standby manager daemon z restarted 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: Standby manager daemon z started 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.153:0/2328539287' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.153:0/2328539287' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.153:0/2328539287' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: from='mgr.? 172.21.15.153:0/2328539287' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T08:08:47.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: from='client.? ' entity='client.admin' 2024-09-10T08:08:47.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:47 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2652114562' entity='client.admin' 2024-09-10T08:08:47.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/512606842' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T08:08:47.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:08:47.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2539003150' entity='client.admin' 2024-09-10T08:08:47.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: Standby manager daemon y restarted 2024-09-10T08:08:47.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: Standby manager daemon y started 2024-09-10T08:08:47.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.100:0/1982738165' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T08:08:47.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.100:0/1982738165' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T08:08:47.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.100:0/1982738165' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T08:08:47.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.100:0/1982738165' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T08:08:47.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: Standby manager daemon z restarted 2024-09-10T08:08:47.654 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: Standby manager daemon z started 2024-09-10T08:08:47.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.153:0/2328539287' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T08:08:47.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.153:0/2328539287' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T08:08:47.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.153:0/2328539287' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T08:08:47.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: from='mgr.? 172.21.15.153:0/2328539287' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T08:08:47.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: from='client.? ' entity='client.admin' 2024-09-10T08:08:47.655 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2652114562' entity='client.admin' 2024-09-10T08:08:47.655 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:47.384+0000 7f6530af1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:08:47.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/512606842' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T08:08:47.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:08:47.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2539003150' entity='client.admin' 2024-09-10T08:08:47.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: Standby manager daemon y restarted 2024-09-10T08:08:47.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: Standby manager daemon y started 2024-09-10T08:08:47.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.100:0/1982738165' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-10T08:08:47.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.100:0/1982738165' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T08:08:47.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.100:0/1982738165' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-10T08:08:47.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.100:0/1982738165' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T08:08:47.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: Standby manager daemon z restarted 2024-09-10T08:08:47.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: Standby manager daemon z started 2024-09-10T08:08:47.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.153:0/2328539287' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-10T08:08:47.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.153:0/2328539287' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-10T08:08:47.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.153:0/2328539287' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-10T08:08:47.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: from='mgr.? 172.21.15.153:0/2328539287' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-10T08:08:47.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: from='client.? ' entity='client.admin' 2024-09-10T08:08:47.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:47 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2652114562' entity='client.admin' 2024-09-10T08:08:47.935 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:47.654+0000 7f649b307640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:08:47.935 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:47.654+0000 7f649b307640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:08:47.935 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:47.654+0000 7f649b307640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:08:47.935 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:47.654+0000 7f649b307640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:08:47.935 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:47.654+0000 7f649b307640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:08:47.936 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:47.656+0000 7f6498301640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:08:47.936 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:47.656+0000 7f6498301640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:08:47.936 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:47.656+0000 7f6498301640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:08:47.936 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:47.656+0000 7f6498301640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:08:47.936 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:47.656+0000 7f6498301640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:08:48.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.409+0000 7fb0f97fa640 1 -- 172.21.15.22:0/658357735 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fb0f40b8d20 con 0x7fb0fc107890 2024-09-10T08:08:48.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.410+0000 7fb0f97fa640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fb0e40a9a30 0x7fb0e40abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:48.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.410+0000 7fb0f97fa640 1 -- 172.21.15.22:0/658357735 --> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fb0f4035e50 con 0x7fb0e40a9a30 2024-09-10T08:08:48.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.411+0000 7fb0fbfff640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fb0e40a9a30 0x7fb0e40abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:48.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.412+0000 7fb0fbfff640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fb0e40a9a30 0x7fb0e40abe20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009fc0 tx=0x7fb0ec005f90 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:48.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.476+0000 7fb0f97fa640 1 -- 172.21.15.22:0/658357735 <== mgr.15234 v2:172.21.15.22:6800/1685162317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb0f4035e50 con 0x7fb0e40a9a30 2024-09-10T08:08:48.475 INFO:teuthology.orchestra.run.smithi022.stdout:Schedule set for path / 2024-09-10T08:08:48.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.478+0000 7fb102542640 1 -- 172.21.15.22:0/658357735 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fb0e40a9a30 msgr2=0x7fb0e40abe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.478+0000 7fb102542640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fb0e40a9a30 0x7fb0e40abe20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009fc0 tx=0x7fb0ec005f90 comp rx=0 tx=0).stop 2024-09-10T08:08:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.478+0000 7fb102542640 1 -- 172.21.15.22:0/658357735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0fc107890 msgr2=0x7fb0fc19f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.478+0000 7fb102542640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0fc107890 0x7fb0fc19f3f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4006010 tx=0x7fb0f4004ab0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.478+0000 7fb102542640 1 -- 172.21.15.22:0/658357735 shutdown_connections 2024-09-10T08:08:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.478+0000 7fb102542640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0fc107890 0x7fb0fc19f3f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.478+0000 7fb102542640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0fc104f60 0x7fb0fc198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.478+0000 7fb102542640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fb0e40a9a30 0x7fb0e40abe20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.478+0000 7fb102542640 1 --2- 172.21.15.22:0/658357735 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb0fc102630 0x7fb0fc197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.478+0000 7fb102542640 1 -- 172.21.15.22:0/658357735 >> 172.21.15.22:0/658357735 conn(0x7fb0fc0fc1b0 msgr2=0x7fb0fc102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.478+0000 7fb102542640 1 -- 172.21.15.22:0/658357735 shutdown_connections 2024-09-10T08:08:48.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.478+0000 7fb102542640 1 -- 172.21.15.22:0/658357735 wait complete. 2024-09-10T08:08:48.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-10T08:08:48.586 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: Active manager daemon x restarted 2024-09-10T08:08:48.586 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: Activating manager daemon x 2024-09-10T08:08:48.586 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T08:08:48.586 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: mgrmap e20: x(active, starting, since 0.0132008s), standbys: z, y 2024-09-10T08:08:48.586 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:08:48.586 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:08:48.586 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:08:48.586 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T08:08:48.586 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T08:08:48.586 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T08:08:48.587 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T08:08:48.588 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T08:08:48.589 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T08:08:48.589 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: Manager daemon x is now available 2024-09-10T08:08:48.589 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:08:48.589 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T08:08:48.589 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:48 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T08:08:48.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.596+0000 7fc037731640 1 -- 172.21.15.22:0/4123851500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030101c30 msgr2=0x7fc0301020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.596+0000 7fc037731640 1 --2- 172.21.15.22:0/4123851500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030101c30 0x7fc0301020b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc020009900 tx=0x7fc02002a410 comp rx=0 tx=0).stop 2024-09-10T08:08:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.596+0000 7fc037731640 1 -- 172.21.15.22:0/4123851500 shutdown_connections 2024-09-10T08:08:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.596+0000 7fc037731640 1 --2- 172.21.15.22:0/4123851500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0301025f0 0x7fc030108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.596+0000 7fc037731640 1 --2- 172.21.15.22:0/4123851500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030101c30 0x7fc0301020b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.596+0000 7fc037731640 1 --2- 172.21.15.22:0/4123851500 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc030100a40 0x7fc030100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.596+0000 7fc037731640 1 -- 172.21.15.22:0/4123851500 >> 172.21.15.22:0/4123851500 conn(0x7fc0300fc1e0 msgr2=0x7fc0300fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.596+0000 7fc037731640 1 -- 172.21.15.22:0/4123851500 shutdown_connections 2024-09-10T08:08:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.597+0000 7fc037731640 1 -- 172.21.15.22:0/4123851500 wait complete. 2024-09-10T08:08:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.597+0000 7fc037731640 1 Processor -- start 2024-09-10T08:08:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.597+0000 7fc037731640 1 -- start start 2024-09-10T08:08:48.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.597+0000 7fc037731640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc030100a40 0x7fc030197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.597+0000 7fc037731640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030101c30 0x7fc030198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.597+0000 7fc037731640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0301025f0 0x7fc03019f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.597+0000 7fc037731640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc03010c6c0 con 0x7fc030101c30 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.597+0000 7fc037731640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc03010c540 con 0x7fc030100a40 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.597+0000 7fc037731640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc03010c840 con 0x7fc0301025f0 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.597+0000 7fc034ccc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030101c30 0x7fc030198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.597+0000 7fc034ccc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030101c30 0x7fc030198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59242/0 (socket says 172.21.15.22:59242) 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.597+0000 7fc034ccc640 1 -- 172.21.15.22:0/16946308 learned_addr learned my addr 172.21.15.22:0/16946308 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc0354cd640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc030100a40 0x7fc030197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc035cce640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0301025f0 0x7fc03019f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc034ccc640 1 -- 172.21.15.22:0/16946308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0301025f0 msgr2=0x7fc03019f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc034ccc640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0301025f0 0x7fc03019f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc034ccc640 1 -- 172.21.15.22:0/16946308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc030100a40 msgr2=0x7fc030197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:48.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc034ccc640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc030100a40 0x7fc030197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc034ccc640 1 -- 172.21.15.22:0/16946308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03019fa10 con 0x7fc030101c30 2024-09-10T08:08:48.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc034ccc640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030101c30 0x7fc030198330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc020009230 tx=0x7fc020004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:48.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc0267fc640 1 -- 172.21.15.22:0/16946308 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02003f030 con 0x7fc030101c30 2024-09-10T08:08:48.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc0267fc640 1 -- 172.21.15.22:0/16946308 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc020003ce0 con 0x7fc030101c30 2024-09-10T08:08:48.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc037731640 1 -- 172.21.15.22:0/16946308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03019fca0 con 0x7fc030101c30 2024-09-10T08:08:48.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc0267fc640 1 -- 172.21.15.22:0/16946308 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020035070 con 0x7fc030101c30 2024-09-10T08:08:48.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.598+0000 7fc037731640 1 -- 172.21.15.22:0/16946308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0301a0190 con 0x7fc030101c30 2024-09-10T08:08:48.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.599+0000 7fc037731640 1 -- 172.21.15.22:0/16946308 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0301a03c0 con 0x7fc030101c30 2024-09-10T08:08:48.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.600+0000 7fc0267fc640 1 -- 172.21.15.22:0/16946308 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fc020042030 con 0x7fc030101c30 2024-09-10T08:08:48.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.601+0000 7fc0267fc640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fc01c0a2ac0 0x7fc01c0a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:48.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.601+0000 7fc0354cd640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fc01c0a2ac0 0x7fc01c0a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:48.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.601+0000 7fc0267fc640 1 -- 172.21.15.22:0/16946308 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8498+0+0 (secure 0 0 0) 0x7fc0200ef5d0 con 0x7fc030101c30 2024-09-10T08:08:48.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.602+0000 7fc0354cd640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fc01c0a2ac0 0x7fc01c0a4f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc02c005fd0 tx=0x7fc02c00b410 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:48.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.605+0000 7fc0267fc640 1 -- 172.21.15.22:0/16946308 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc0200bc0c0 con 0x7fc030101c30 2024-09-10T08:08:48.607 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: Active manager daemon x restarted 2024-09-10T08:08:48.608 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: Activating manager daemon x 2024-09-10T08:08:48.608 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T08:08:48.608 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: mgrmap e20: x(active, starting, since 0.0132008s), standbys: z, y 2024-09-10T08:08:48.608 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:08:48.608 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:08:48.608 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:08:48.608 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T08:08:48.608 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T08:08:48.608 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T08:08:48.608 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T08:08:48.608 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:08:48.609 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T08:08:48.610 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: Manager daemon x is now available 2024-09-10T08:08:48.611 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:08:48.611 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T08:08:48.611 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:48 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T08:08:48.675 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: Active manager daemon x restarted 2024-09-10T08:08:48.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: Activating manager daemon x 2024-09-10T08:08:48.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: osdmap e84: 12 total, 12 up, 12 in 2024-09-10T08:08:48.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: mgrmap e20: x(active, starting, since 0.0132008s), standbys: z, y 2024-09-10T08:08:48.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-10T08:08:48.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-10T08:08:48.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-10T08:08:48.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-10T08:08:48.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-10T08:08:48.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T08:08:48.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T08:08:48.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T08:08:48.676 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-10T08:08:48.677 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: Manager daemon x is now available 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-10T08:08:48.678 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:48 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-10T08:08:48.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.828+0000 7fc037731640 1 -- 172.21.15.22:0/16946308 --> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fc030069fb0 con 0x7fc01c0a2ac0 2024-09-10T08:08:48.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.883+0000 7fc0267fc640 1 -- 172.21.15.22:0/16946308 <== mgr.15234 v2:172.21.15.22:6800/1685162317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fc030069fb0 con 0x7fc01c0a2ac0 2024-09-10T08:08:48.882 INFO:teuthology.orchestra.run.smithi022.stdout:Retention added to path / 2024-09-10T08:08:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.885+0000 7fc037731640 1 -- 172.21.15.22:0/16946308 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fc01c0a2ac0 msgr2=0x7fc01c0a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.885+0000 7fc037731640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fc01c0a2ac0 0x7fc01c0a4f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc02c005fd0 tx=0x7fc02c00b410 comp rx=0 tx=0).stop 2024-09-10T08:08:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.885+0000 7fc037731640 1 -- 172.21.15.22:0/16946308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030101c30 msgr2=0x7fc030198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.885+0000 7fc037731640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030101c30 0x7fc030198330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc020009230 tx=0x7fc020004360 comp rx=0 tx=0).stop 2024-09-10T08:08:48.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.885+0000 7fc037731640 1 -- 172.21.15.22:0/16946308 shutdown_connections 2024-09-10T08:08:48.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.885+0000 7fc037731640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0301025f0 0x7fc03019f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.885+0000 7fc037731640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030101c30 0x7fc030198330 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.885+0000 7fc037731640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fc01c0a2ac0 0x7fc01c0a4f80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.885+0000 7fc037731640 1 --2- 172.21.15.22:0/16946308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc030100a40 0x7fc030197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:48.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.885+0000 7fc037731640 1 -- 172.21.15.22:0/16946308 >> 172.21.15.22:0/16946308 conn(0x7fc0300fc1e0 msgr2=0x7fc0300698a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:48.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.885+0000 7fc037731640 1 -- 172.21.15.22:0/16946308 shutdown_connections 2024-09-10T08:08:48.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:48.885+0000 7fc037731640 1 -- 172.21.15.22:0/16946308 wait complete. 2024-09-10T08:08:48.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-10T08:08:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.001+0000 7fe0f72dd640 1 -- 172.21.15.22:0/1825639805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f01025f0 msgr2=0x7fe0f0108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.001+0000 7fe0f72dd640 1 --2- 172.21.15.22:0/1825639805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f01025f0 0x7fe0f0108e80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009ca0 tx=0x7fe0e802a8c0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.001+0000 7fe0f72dd640 1 -- 172.21.15.22:0/1825639805 shutdown_connections 2024-09-10T08:08:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.001+0000 7fe0f72dd640 1 --2- 172.21.15.22:0/1825639805 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f01025f0 0x7fe0f0108e80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.001+0000 7fe0f72dd640 1 --2- 172.21.15.22:0/1825639805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f0101c30 0x7fe0f01020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.001+0000 7fe0f72dd640 1 --2- 172.21.15.22:0/1825639805 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0f0100a40 0x7fe0f0100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.001+0000 7fe0f72dd640 1 -- 172.21.15.22:0/1825639805 >> 172.21.15.22:0/1825639805 conn(0x7fe0f00fc1e0 msgr2=0x7fe0f00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:49.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f72dd640 1 -- 172.21.15.22:0/1825639805 shutdown_connections 2024-09-10T08:08:49.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f72dd640 1 -- 172.21.15.22:0/1825639805 wait complete. 2024-09-10T08:08:49.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f72dd640 1 Processor -- start 2024-09-10T08:08:49.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f72dd640 1 -- start start 2024-09-10T08:08:49.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f72dd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f0100a40 0x7fe0f0199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:49.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f72dd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0f0101c30 0x7fe0f019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:49.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f72dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f01025f0 0x7fe0f01a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:49.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f72dd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f010c6a0 con 0x7fe0f0100a40 2024-09-10T08:08:49.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f72dd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f010c520 con 0x7fe0f01025f0 2024-09-10T08:08:49.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f72dd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f010c820 con 0x7fe0f0101c30 2024-09-10T08:08:49.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f5079640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f0100a40 0x7fe0f0199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:49.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f5079640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f0100a40 0x7fe0f0199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59256/0 (socket says 172.21.15.22:59256) 2024-09-10T08:08:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.002+0000 7fe0f5079640 1 -- 172.21.15.22:0/2907707570 learned_addr learned my addr 172.21.15.22:0/2907707570 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0f587a640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f01025f0 0x7fe0f01a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0f4878640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0f0101c30 0x7fe0f019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0f5079640 1 -- 172.21.15.22:0/2907707570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0f0101c30 msgr2=0x7fe0f019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0f5079640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0f0101c30 0x7fe0f019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0f5079640 1 -- 172.21.15.22:0/2907707570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f01025f0 msgr2=0x7fe0f01a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:49.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0f5079640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f01025f0 0x7fe0f01a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0f5079640 1 -- 172.21.15.22:0/2907707570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f01a1b90 con 0x7fe0f0100a40 2024-09-10T08:08:49.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0f5079640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f0100a40 0x7fe0f0199fe0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00e9c0 tx=0x7fe0ec00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:49.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0e67fc640 1 -- 172.21.15.22:0/2907707570 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00cde0 con 0x7fe0f0100a40 2024-09-10T08:08:49.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0e67fc640 1 -- 172.21.15.22:0/2907707570 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0ec010910 con 0x7fe0f0100a40 2024-09-10T08:08:49.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0f72dd640 1 -- 172.21.15.22:0/2907707570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f01a1e80 con 0x7fe0f0100a40 2024-09-10T08:08:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0e67fc640 1 -- 172.21.15.22:0/2907707570 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec018a00 con 0x7fe0f0100a40 2024-09-10T08:08:49.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.003+0000 7fe0f72dd640 1 -- 172.21.15.22:0/2907707570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f01a2340 con 0x7fe0f0100a40 2024-09-10T08:08:49.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.007+0000 7fe0f72dd640 1 -- 172.21.15.22:0/2907707570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f01a25a0 con 0x7fe0f0100a40 2024-09-10T08:08:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.007+0000 7fe0e67fc640 1 -- 172.21.15.22:0/2907707570 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7fe0ec01f020 con 0x7fe0f0100a40 2024-09-10T08:08:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.008+0000 7fe0e67fc640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fe0dc0a2ac0 0x7fe0dc0a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.008+0000 7fe0e67fc640 1 -- 172.21.15.22:0/2907707570 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8498+0+0 (secure 0 0 0) 0x7fe0ec0cef00 con 0x7fe0f0100a40 2024-09-10T08:08:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.008+0000 7fe0f4878640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fe0dc0a2ac0 0x7fe0dc0a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.008+0000 7fe0f4878640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fe0dc0a2ac0 0x7fe0dc0a4f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe0f019b480 tx=0x7fe0e000b390 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:49.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.012+0000 7fe0e67fc640 1 -- 172.21.15.22:0/2907707570 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe0ec09c000 con 0x7fe0f0100a40 2024-09-10T08:08:49.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.217+0000 7fe0f72dd640 1 -- 172.21.15.22:0/2907707570 --> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fe0f00fe3a0 con 0x7fe0dc0a2ac0 2024-09-10T08:08:49.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.224+0000 7fe0e67fc640 1 -- 172.21.15.22:0/2907707570 <== mgr.15234 v2:172.21.15.22:6800/1685162317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fe0f00fe3a0 con 0x7fe0dc0a2ac0 2024-09-10T08:08:49.223 INFO:teuthology.orchestra.run.smithi022.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-10T00:00:00", "created": "2024-09-10T08:08:48", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-10T08:08:49.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.226+0000 7fe0f72dd640 1 -- 172.21.15.22:0/2907707570 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fe0dc0a2ac0 msgr2=0x7fe0dc0a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:49.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.226+0000 7fe0f72dd640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fe0dc0a2ac0 0x7fe0dc0a4f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe0f019b480 tx=0x7fe0e000b390 comp rx=0 tx=0).stop 2024-09-10T08:08:49.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.226+0000 7fe0f72dd640 1 -- 172.21.15.22:0/2907707570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f0100a40 msgr2=0x7fe0f0199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:49.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.226+0000 7fe0f72dd640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f0100a40 0x7fe0f0199fe0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00e9c0 tx=0x7fe0ec00ee80 comp rx=0 tx=0).stop 2024-09-10T08:08:49.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.226+0000 7fe0f72dd640 1 -- 172.21.15.22:0/2907707570 shutdown_connections 2024-09-10T08:08:49.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.226+0000 7fe0f72dd640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fe0dc0a2ac0 0x7fe0dc0a4f80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.226+0000 7fe0f72dd640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f01025f0 0x7fe0f01a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.226+0000 7fe0f72dd640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0f0101c30 0x7fe0f019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.226+0000 7fe0f72dd640 1 --2- 172.21.15.22:0/2907707570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0f0100a40 0x7fe0f0199fe0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.226+0000 7fe0f72dd640 1 -- 172.21.15.22:0/2907707570 >> 172.21.15.22:0/2907707570 conn(0x7fe0f00fc1e0 msgr2=0x7fe0f00fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:49.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.226+0000 7fe0f72dd640 1 -- 172.21.15.22:0/2907707570 shutdown_connections 2024-09-10T08:08:49.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.226+0000 7fe0f72dd640 1 -- 172.21.15.22:0/2907707570 wait complete. 2024-09-10T08:08:49.237 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-10T08:08:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.358+0000 7f233304c640 1 -- 172.21.15.22:0/3666154662 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f232c101c30 msgr2=0x7f232c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.358+0000 7f233304c640 1 --2- 172.21.15.22:0/3666154662 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f232c101c30 0x7f232c1020b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2314009900 tx=0x7f231402a410 comp rx=0 tx=0).stop 2024-09-10T08:08:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.358+0000 7f233304c640 1 -- 172.21.15.22:0/3666154662 shutdown_connections 2024-09-10T08:08:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.358+0000 7f233304c640 1 --2- 172.21.15.22:0/3666154662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f232c1025f0 0x7f232c108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.358+0000 7f233304c640 1 --2- 172.21.15.22:0/3666154662 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f232c101c30 0x7f232c1020b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.358+0000 7f233304c640 1 --2- 172.21.15.22:0/3666154662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f232c100a40 0x7f232c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.358+0000 7f233304c640 1 -- 172.21.15.22:0/3666154662 >> 172.21.15.22:0/3666154662 conn(0x7f232c0fc1e0 msgr2=0x7f232c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.358+0000 7f233304c640 1 -- 172.21.15.22:0/3666154662 shutdown_connections 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.358+0000 7f233304c640 1 -- 172.21.15.22:0/3666154662 wait complete. 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.358+0000 7f233304c640 1 Processor -- start 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.358+0000 7f233304c640 1 -- start start 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f233304c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f232c100a40 0x7f232c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f233304c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f232c101c30 0x7f232c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f233304c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f232c1025f0 0x7f232c19f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f233304c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f232c10d870 con 0x7f232c100a40 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f233304c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f232c10d6f0 con 0x7f232c101c30 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f233304c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f232c10d9f0 con 0x7f232c1025f0 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f2330de8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f232c100a40 0x7f232c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:49.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f2330de8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f232c100a40 0x7f232c197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59284/0 (socket says 172.21.15.22:59284) 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f2330de8640 1 -- 172.21.15.22:0/613481526 learned_addr learned my addr 172.21.15.22:0/613481526 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f232bfff640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f232c101c30 0x7f232c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f23315e9640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f232c1025f0 0x7f232c19f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f2330de8640 1 -- 172.21.15.22:0/613481526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f232c1025f0 msgr2=0x7f232c19f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f2330de8640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f232c1025f0 0x7f232c19f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f2330de8640 1 -- 172.21.15.22:0/613481526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f232c101c30 msgr2=0x7f232c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f2330de8640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f232c101c30 0x7f232c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f2330de8640 1 -- 172.21.15.22:0/613481526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232c19f9f0 con 0x7f232c100a40 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.359+0000 7f2330de8640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f232c100a40 0x7f232c197dd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f231c00eb70 tx=0x7f231c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.360+0000 7f2329ffb640 1 -- 172.21.15.22:0/613481526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c003b70 con 0x7f232c100a40 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.360+0000 7f2329ffb640 1 -- 172.21.15.22:0/613481526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f231c00ee70 con 0x7f232c100a40 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.360+0000 7f233304c640 1 -- 172.21.15.22:0/613481526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232c19fce0 con 0x7f232c100a40 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.360+0000 7f2329ffb640 1 -- 172.21.15.22:0/613481526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231c010830 con 0x7f232c100a40 2024-09-10T08:08:49.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.360+0000 7f233304c640 1 -- 172.21.15.22:0/613481526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f232c1a01b0 con 0x7f232c100a40 2024-09-10T08:08:49.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.361+0000 7f233304c640 1 -- 172.21.15.22:0/613481526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f232c107de0 con 0x7f232c100a40 2024-09-10T08:08:49.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.362+0000 7f2329ffb640 1 -- 172.21.15.22:0/613481526 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 21) ==== 137645+0+0 (secure 0 0 0) 0x7f231c004020 con 0x7f232c100a40 2024-09-10T08:08:49.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.363+0000 7f2329ffb640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f23180a2ac0 0x7f23180a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:08:49.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.363+0000 7f2329ffb640 1 -- 172.21.15.22:0/613481526 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8498+0+0 (secure 0 0 0) 0x7f231c0cf3a0 con 0x7f232c100a40 2024-09-10T08:08:49.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.363+0000 7f232bfff640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f23180a2ac0 0x7f23180a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:08:49.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.363+0000 7f232bfff640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f23180a2ac0 0x7f23180a4f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2314031440 tx=0x7f23140315b0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:08:49.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.371+0000 7f2329ffb640 1 -- 172.21.15.22:0/613481526 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f231c09c4a0 con 0x7f232c100a40 2024-09-10T08:08:49.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.412+0000 7f2329ffb640 1 -- 172.21.15.22:0/613481526 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 22) ==== 137953+0+0 (secure 0 0 0) 0x7f231c098410 con 0x7f232c100a40 2024-09-10T08:08:49.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-mon[30854]: mgrmap e21: x(active, since 1.02321s), standbys: z, y 2024-09-10T08:08:49.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-mon[30854]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:49.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-mon[30854]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:08:49.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-mon[30854]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:49.504 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:49.438+0000 7f647e30e640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:08:08:49] ENGINE Error in HTTPServer.serve 2024-09-10T08:08:49.504 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: Traceback (most recent call last): 2024-09-10T08:08:49.504 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T08:08:49.504 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: self._connections.run(self.expiration_interval) 2024-09-10T08:08:49.504 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: self._run(expiration_interval) 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: s = self.context.wrap_socket( 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: return self.sslsocket_class._create( 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: self.do_handshake() 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T08:08:49.505 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: self._sslobj.do_handshake() 2024-09-10T08:08:49.506 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T08:08:49.506 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:08:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:08:49.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.636+0000 7f233304c640 1 -- 172.21.15.22:0/613481526 --> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f232c062630 con 0x7f23180a2ac0 2024-09-10T08:08:49.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.642+0000 7f2329ffb640 1 -- 172.21.15.22:0/613481526 <== mgr.15234 v2:172.21.15.22:6800/1685162317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f232c062630 con 0x7f23180a2ac0 2024-09-10T08:08:49.642 INFO:teuthology.orchestra.run.smithi022.stdout:/ 1m 6m3h 2024-09-10T08:08:49.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.644+0000 7f233304c640 1 -- 172.21.15.22:0/613481526 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f23180a2ac0 msgr2=0x7f23180a4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:49.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.644+0000 7f233304c640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f23180a2ac0 0x7f23180a4f80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2314031440 tx=0x7f23140315b0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.644+0000 7f233304c640 1 -- 172.21.15.22:0/613481526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f232c100a40 msgr2=0x7f232c197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:08:49.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.644+0000 7f233304c640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f232c100a40 0x7f232c197dd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f231c00eb70 tx=0x7f231c00c6a0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.644+0000 7f233304c640 1 -- 172.21.15.22:0/613481526 shutdown_connections 2024-09-10T08:08:49.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.644+0000 7f233304c640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f232c1025f0 0x7f232c19f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.644+0000 7f233304c640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f23180a2ac0 0x7f23180a4f80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.644+0000 7f233304c640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f232c101c30 0x7f232c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.644+0000 7f233304c640 1 --2- 172.21.15.22:0/613481526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f232c100a40 0x7f232c197dd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:08:49.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.644+0000 7f233304c640 1 -- 172.21.15.22:0/613481526 >> 172.21.15.22:0/613481526 conn(0x7f232c0fc1e0 msgr2=0x7f232c104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:08:49.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.645+0000 7f233304c640 1 -- 172.21.15.22:0/613481526 shutdown_connections 2024-09-10T08:08:49.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:08:49.645+0000 7f233304c640 1 -- 172.21.15.22:0/613481526 wait complete. 2024-09-10T08:08:49.655 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-10T08:08:49.682 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-10T08:08:49.693 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T08:08:49.715 INFO:tasks.workunit:Pulling workunits from ref 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:08:49.716 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T08:08:49.716 INFO:tasks.workunit:timeout=3h 2024-09-10T08:08:49.716 INFO:tasks.workunit:cleanup=True 2024-09-10T08:08:49.717 DEBUG:teuthology.orchestra.run.smithi022:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T08:08:49.717 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:49 smithi153 ceph-mon[35609]: mgrmap e21: x(active, since 1.02321s), standbys: z, y 2024-09-10T08:08:49.717 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:49 smithi153 ceph-mon[35609]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:49.717 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:49 smithi153 ceph-mon[35609]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:08:49.718 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:49 smithi153 ceph-mon[35609]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:49.738 INFO:teuthology.orchestra.run.smithi022.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T08:08:49.738 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-10T08:08:49.738 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-10T08:08:49.738 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:08:49.738 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T08:08:49.738 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-10 08:07:13.455062527 +0000 2024-09-10T08:08:49.738 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-10 08:07:13.455062527 +0000 2024-09-10T08:08:49.739 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-10 08:08:45.572501034 +0000 2024-09-10T08:08:49.739 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-10 08:07:13.455062527 +0000 2024-09-10T08:08:49.739 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T08:08:49.739 DEBUG:teuthology.orchestra.run.smithi022:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T08:08:49.814 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:08:49.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:49 smithi100 ceph-mon[35102]: mgrmap e21: x(active, since 1.02321s), standbys: z, y 2024-09-10T08:08:49.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:49 smithi100 ceph-mon[35102]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:49.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:49 smithi100 ceph-mon[35102]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:08:49.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:49 smithi100 ceph-mon[35102]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:49.871 INFO:tasks.workunit.client.0.smithi022.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T08:08:50.697 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: [10/Sep/2024:08:08:49] ENGINE Bus STARTING 2024-09-10T08:08:50.697 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:50.697 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: [10/Sep/2024:08:08:49] ENGINE Serving on http://172.21.15.22:8765 2024-09-10T08:08:50.697 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:08:50.697 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-10T08:08:50.697 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.697 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.697 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: [10/Sep/2024:08:08:49] ENGINE Serving on https://172.21.15.22:7150 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: [10/Sep/2024:08:08:49] ENGINE Bus STARTED 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: [10/Sep/2024:08:08:49] ENGINE Error in HTTPServer.serve 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout: Traceback (most recent call last): 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout: self._connections.run(self.expiration_interval) 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout: self._run(expiration_interval) 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T08:08:50.698 INFO:journalctl@ceph.mon.c.smithi153.stdout: s = self.context.wrap_socket( 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout: return self.sslsocket_class._create( 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout: self.do_handshake() 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout: self._sslobj.do_handshake() 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:50.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-10T08:08:50.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: Unable to set osd_memory_target on smithi100 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-10T08:08:50.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi153 to 176.0M 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: Unable to set osd_memory_target on smithi153 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:08:50.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:50 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:08:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: [10/Sep/2024:08:08:49] ENGINE Bus STARTING 2024-09-10T08:08:50.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: [10/Sep/2024:08:08:49] ENGINE Serving on http://172.21.15.22:8765 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: [10/Sep/2024:08:08:49] ENGINE Serving on https://172.21.15.22:7150 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: [10/Sep/2024:08:08:49] ENGINE Bus STARTED 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: [10/Sep/2024:08:08:49] ENGINE Error in HTTPServer.serve 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout: Traceback (most recent call last): 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._connections.run(self.expiration_interval) 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T08:08:50.754 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._run(expiration_interval) 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: s = self.context.wrap_socket( 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: return self.sslsocket_class._create( 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: self.do_handshake() 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._sslobj.do_handshake() 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T08:08:50.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:50.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: Unable to set osd_memory_target on smithi100 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi153 to 176.0M 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: Unable to set osd_memory_target on smithi153 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:08:50.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:50 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:08:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: [10/Sep/2024:08:08:49] ENGINE Bus STARTING 2024-09-10T08:08:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: [10/Sep/2024:08:08:49] ENGINE Serving on http://172.21.15.22:8765 2024-09-10T08:08:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:08:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-09-10T08:08:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: [10/Sep/2024:08:08:49] ENGINE Serving on https://172.21.15.22:7150 2024-09-10T08:08:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: [10/Sep/2024:08:08:49] ENGINE Bus STARTED 2024-09-10T08:08:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: [10/Sep/2024:08:08:49] ENGINE Error in HTTPServer.serve 2024-09-10T08:08:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout: Traceback (most recent call last): 2024-09-10T08:08:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T08:08:50.869 INFO:journalctl@ceph.mon.b.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-10T08:08:50.870 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T08:08:50.870 INFO:journalctl@ceph.mon.b.smithi100.stdout: self._run(expiration_interval) 2024-09-10T08:08:50.870 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T08:08:50.870 INFO:journalctl@ceph.mon.b.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T08:08:50.870 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T08:08:50.870 INFO:journalctl@ceph.mon.b.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T08:08:50.870 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T08:08:50.870 INFO:journalctl@ceph.mon.b.smithi100.stdout: s = self.context.wrap_socket( 2024-09-10T08:08:50.870 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T08:08:50.870 INFO:journalctl@ceph.mon.b.smithi100.stdout: return self.sslsocket_class._create( 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout: self.do_handshake() 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout: self._sslobj.do_handshake() 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.871 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: Unable to set osd_memory_target on smithi100 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi153 to 176.0M 2024-09-10T08:08:50.872 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: Unable to set osd_memory_target on smithi153 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-10T08:08:50.873 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.873 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:50.873 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.873 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.873 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.873 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:08:50.873 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:08:50.873 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:50 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Unable to set osd_memory_target on smithi022 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Updating smithi153:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Updating smithi022:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Updating smithi100:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Updating smithi153:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T08:08:51.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Updating smithi100:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T08:08:51.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: Updating smithi022:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T08:08:51.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:51 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Unable to set osd_memory_target on smithi022 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Updating smithi153:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Updating smithi022:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Updating smithi100:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Updating smithi153:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Updating smithi100:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T08:08:51.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: Updating smithi022:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T08:08:51.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:51 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-10T08:08:51.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Unable to set osd_memory_target on smithi022 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-10T08:08:51.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-10T08:08:51.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-10T08:08:51.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-10T08:08:51.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Updating smithi153:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:08:51.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Updating smithi022:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:08:51.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Updating smithi100:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T08:08:51.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:08:51.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:08:51.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-09-10T08:08:51.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Updating smithi153:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T08:08:51.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Updating smithi100:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T08:08:51.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: Updating smithi022:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T08:08:51.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:51.870 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:51 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:52.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:52 smithi153 ceph-mon[35609]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:08:52.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:52 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:08:52.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:52 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:08:52.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:52 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:08:52.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:52 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:52.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:52 smithi153 ceph-mon[35609]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-10T08:08:52.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:52 smithi022 ceph-mon[30854]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:08:52.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:52 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:08:52.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:52 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:08:52.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:52 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:08:52.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:52 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:52.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:52 smithi022 ceph-mon[30854]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-10T08:08:52.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:52 smithi100 ceph-mon[35102]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:08:52.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:52 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:08:52.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:52 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:08:52.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:52 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:08:52.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:52 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:08:52.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:52 smithi100 ceph-mon[35102]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-10T08:08:54.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:54 smithi153 ceph-mon[35609]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 205 B/s wr, 1 op/s 2024-09-10T08:08:54.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:54 smithi022 ceph-mon[30854]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 205 B/s wr, 1 op/s 2024-09-10T08:08:54.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:54 smithi100 ceph-mon[35102]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s rd, 205 B/s wr, 1 op/s 2024-09-10T08:08:56.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:56 smithi153 ceph-mon[35609]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 132 KiB/s wr, 80 op/s 2024-09-10T08:08:56.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:56 smithi022 ceph-mon[30854]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 132 KiB/s wr, 80 op/s 2024-09-10T08:08:56.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:56 smithi100 ceph-mon[35102]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 132 KiB/s wr, 80 op/s 2024-09-10T08:08:58.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:08:58 smithi153 ceph-mon[35609]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-09-10T08:08:58.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:08:58 smithi022 ceph-mon[30854]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-09-10T08:08:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:08:58 smithi100 ceph-mon[35102]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 103 KiB/s wr, 62 op/s 2024-09-10T08:09:00.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:00 smithi153 ceph-mon[35609]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-10T08:09:00.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:00 smithi022 ceph-mon[30854]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-10T08:09:00.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:00 smithi100 ceph-mon[35102]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 KiB/s wr, 55 op/s 2024-09-10T08:09:01.253 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:09:00 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:09:00.894+0000 7f6483b59640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:09:01.253 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:09:00 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:09:00.894+0000 7f6483b59640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:09:01.253 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:09:00 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:09:00.894+0000 7f6483b59640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:09:01.253 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:09:00 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:09:00.894+0000 7f6483b59640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:09:01.253 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:09:00 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:09:00.894+0000 7f6483b59640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:09:02.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:02 smithi153 ceph-mon[35609]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-09-10T08:09:02.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:02 smithi153 ceph-mon[35609]: mgrmap e24: x(active, since 14s), standbys: z, y 2024-09-10T08:09:02.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:02 smithi022 ceph-mon[30854]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-09-10T08:09:02.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:02 smithi022 ceph-mon[30854]: mgrmap e24: x(active, since 14s), standbys: z, y 2024-09-10T08:09:02.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:02 smithi100 ceph-mon[35102]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 77 KiB/s wr, 51 op/s 2024-09-10T08:09:02.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:02 smithi100 ceph-mon[35102]: mgrmap e24: x(active, since 14s), standbys: z, y 2024-09-10T08:09:04.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:04 smithi153 ceph-mon[35609]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 77 KiB/s wr, 52 op/s 2024-09-10T08:09:04.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:04 smithi022 ceph-mon[30854]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 77 KiB/s wr, 52 op/s 2024-09-10T08:09:04.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:04 smithi100 ceph-mon[35102]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 77 KiB/s wr, 52 op/s 2024-09-10T08:09:06.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:06 smithi022 ceph-mon[30854]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 99 KiB/s wr, 69 op/s 2024-09-10T08:09:06.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:06 smithi100 ceph-mon[35102]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 99 KiB/s wr, 69 op/s 2024-09-10T08:09:06.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:06 smithi153 ceph-mon[35609]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 99 KiB/s wr, 69 op/s 2024-09-10T08:09:08.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:08 smithi022 ceph-mon[30854]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-10T08:09:08.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:08 smithi100 ceph-mon[35102]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-10T08:09:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:08 smithi153 ceph-mon[35609]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-10T08:09:10.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:10 smithi022 ceph-mon[30854]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-10T08:09:10.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:10 smithi100 ceph-mon[35102]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-10T08:09:10.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:10 smithi153 ceph-mon[35609]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-10T08:09:12.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:12 smithi022 ceph-mon[30854]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-10T08:09:12.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:12 smithi100 ceph-mon[35102]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-10T08:09:12.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:12 smithi153 ceph-mon[35609]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-10T08:09:14.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:14 smithi022 ceph-mon[30854]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-10T08:09:14.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:14 smithi100 ceph-mon[35102]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-10T08:09:14.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:14 smithi153 ceph-mon[35609]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-09-10T08:09:16.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:16 smithi022 ceph-mon[30854]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-10T08:09:16.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:16 smithi100 ceph-mon[35102]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-10T08:09:16.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:16 smithi153 ceph-mon[35609]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 KiB/s wr, 27 op/s 2024-09-10T08:09:18.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:18 smithi022 ceph-mon[30854]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-10T08:09:18.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:18 smithi100 ceph-mon[35102]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-10T08:09:18.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:18 smithi153 ceph-mon[35609]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-10T08:09:20.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:20 smithi022 ceph-mon[30854]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-10T08:09:20.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:20 smithi100 ceph-mon[35102]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-10T08:09:20.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:20 smithi153 ceph-mon[35609]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-10T08:09:22.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:22 smithi022 ceph-mon[30854]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-10T08:09:22.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:22 smithi100 ceph-mon[35102]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-10T08:09:22.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:22 smithi153 ceph-mon[35609]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-10T08:09:24.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:24 smithi100 ceph-mon[35102]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T08:09:24.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:24 smithi153 ceph-mon[35609]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T08:09:25.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:24 smithi022 ceph-mon[30854]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T08:09:26.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:26 smithi100 ceph-mon[35102]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-10T08:09:26.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:26 smithi153 ceph-mon[35609]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-10T08:09:27.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:26 smithi022 ceph-mon[30854]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-10T08:09:28.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:28 smithi022 ceph-mon[30854]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:09:28.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:28 smithi100 ceph-mon[35102]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:09:28.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:28 smithi153 ceph-mon[35609]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:09:30.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:30 smithi022 ceph-mon[30854]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-10T08:09:30.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:30 smithi100 ceph-mon[35102]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-10T08:09:30.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:30 smithi153 ceph-mon[35609]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-10T08:09:32.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:32 smithi100 ceph-mon[35102]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-10T08:09:32.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:32 smithi153 ceph-mon[35609]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-10T08:09:33.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:32 smithi022 ceph-mon[30854]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-10T08:09:34.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:34 smithi100 ceph-mon[35102]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-10T08:09:34.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:34 smithi153 ceph-mon[35609]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-10T08:09:35.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:34 smithi022 ceph-mon[30854]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 938 B/s wr, 9 op/s 2024-09-10T08:09:36.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:36 smithi100 ceph-mon[35102]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-10T08:09:36.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:36 smithi153 ceph-mon[35609]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-10T08:09:37.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:36 smithi022 ceph-mon[30854]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-10T08:09:38.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:38 smithi100 ceph-mon[35102]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-10T08:09:38.946 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:38 smithi153 ceph-mon[35609]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-10T08:09:39.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:38 smithi022 ceph-mon[30854]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-10T08:09:40.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:40 smithi022 ceph-mon[30854]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-10T08:09:40.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:40 smithi100 ceph-mon[35102]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-10T08:09:40.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:40 smithi153 ceph-mon[35609]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-10T08:09:42.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:42 smithi100 ceph-mon[35102]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:09:42.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:42 smithi153 ceph-mon[35609]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:09:43.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:42 smithi022 ceph-mon[30854]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:09:44.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:44 smithi100 ceph-mon[35102]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:09:44.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:44 smithi153 ceph-mon[35609]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:09:45.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:44 smithi022 ceph-mon[30854]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-10T08:09:46.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:46 smithi100 ceph-mon[35102]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-10T08:09:46.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:46 smithi153 ceph-mon[35609]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-10T08:09:47.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:46 smithi022 ceph-mon[30854]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-10T08:09:48.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:48 smithi100 ceph-mon[35102]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:09:48.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:48 smithi153 ceph-mon[35609]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:09:49.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:48 smithi022 ceph-mon[30854]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:09:50.858 INFO:tasks.workunit.client.0.smithi022.stderr:Updating files: 92% (11697/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-10T08:09:50.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:50 smithi100 ceph-mon[35102]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-10T08:09:50.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:50 smithi153 ceph-mon[35609]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-10T08:09:51.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:50 smithi022 ceph-mon[30854]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2024-09-10T08:09:51.747 INFO:tasks.workunit.client.0.smithi022.stderr:Note: switching to '1cf819b7212a6048e92fc78c4eff963344f6d56b'. 2024-09-10T08:09:51.748 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-10T08:09:51.748 INFO:tasks.workunit.client.0.smithi022.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T08:09:51.748 INFO:tasks.workunit.client.0.smithi022.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T08:09:51.748 INFO:tasks.workunit.client.0.smithi022.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T08:09:51.748 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-10T08:09:51.748 INFO:tasks.workunit.client.0.smithi022.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T08:09:51.748 INFO:tasks.workunit.client.0.smithi022.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T08:09:51.748 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-10T08:09:51.748 INFO:tasks.workunit.client.0.smithi022.stderr: git switch -c 2024-09-10T08:09:51.748 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-10T08:09:51.748 INFO:tasks.workunit.client.0.smithi022.stderr:Or undo this operation with: 2024-09-10T08:09:51.749 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-10T08:09:51.749 INFO:tasks.workunit.client.0.smithi022.stderr: git switch - 2024-09-10T08:09:51.749 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-10T08:09:51.749 INFO:tasks.workunit.client.0.smithi022.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T08:09:51.749 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-10T08:09:51.749 INFO:tasks.workunit.client.0.smithi022.stderr:HEAD is now at 1cf819b7212 Merge PR #59672 into wip-rishabh-testing-20240909.165402-squid 2024-09-10T08:09:51.754 DEBUG:teuthology.orchestra.run.smithi022:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T08:09:51.818 INFO:tasks.workunit.client.0.smithi022.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T08:09:51.821 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T08:09:51.821 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T08:09:51.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:51 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:09:51.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:51 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:09:52.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:51 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:09:52.517 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T08:09:52.585 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T08:09:52.625 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T08:09:52.627 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T08:09:52.627 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T08:09:52.667 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T08:09:52.670 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T08:09:52.671 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T08:09:52.728 INFO:tasks.workunit:Running workunits matching suites/iogen.sh on client.0... 2024-09-10T08:09:52.731 INFO:tasks.workunit:Running workunit suites/iogen.sh... 2024-09-10T08:09:52.731 DEBUG:teuthology.orchestra.run.smithi022:workunit test suites/iogen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cf819b7212a6048e92fc78c4eff963344f6d56b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-09-10T08:09:52.790 INFO:tasks.workunit.client.0.smithi022.stdout:getting iogen 2024-09-10T08:09:52.790 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'getting iogen' 2024-09-10T08:09:52.791 INFO:tasks.workunit.client.0.smithi022.stderr:+ wget http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-10T08:09:52.810 INFO:tasks.workunit.client.0.smithi022.stderr:--2024-09-10 08:09:52-- http://download.ceph.com/qa/iogen_3.1p0.tar 2024-09-10T08:09:52.819 INFO:tasks.workunit.client.0.smithi022.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-10T08:09:52.840 INFO:tasks.workunit.client.0.smithi022.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-10T08:09:52.861 INFO:tasks.workunit.client.0.smithi022.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-10T08:09:52.861 INFO:tasks.workunit.client.0.smithi022.stderr:Length: 8071 (7.9K) [application/octet-stream] 2024-09-10T08:09:52.862 INFO:tasks.workunit.client.0.smithi022.stderr:Saving to: ‘iogen_3.1p0.tar’ 2024-09-10T08:09:52.865 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-10T08:09:52.865 INFO:tasks.workunit.client.0.smithi022.stderr: 0K ....... 100% 1.36G=0s 2024-09-10T08:09:52.865 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-10T08:09:52.865 INFO:tasks.workunit.client.0.smithi022.stderr:2024-09-10 08:09:52 (1.36 GB/s) - ‘iogen_3.1p0.tar’ saved [8071/8071] 2024-09-10T08:09:52.866 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-09-10T08:09:52.866 INFO:tasks.workunit.client.0.smithi022.stderr:+ tar -xvzf iogen_3.1p0.tar 2024-09-10T08:09:52.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:52 smithi100 ceph-mon[35102]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:09:52.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:52 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:09:52.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:52 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:09:52.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:52 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:09:52.875 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0 2024-09-10T08:09:52.876 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0/src 2024-09-10T08:09:52.876 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0/src/iogen.8 2024-09-10T08:09:52.878 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0/src/iogen.c 2024-09-10T08:09:52.879 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0/README 2024-09-10T08:09:52.880 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0/Makefile.bsd 2024-09-10T08:09:52.881 INFO:tasks.workunit.client.0.smithi022.stdout:iogen_3.1p0/Makefile 2024-09-10T08:09:52.882 INFO:tasks.workunit.client.0.smithi022.stderr:+ cd iogen_3.1p0 2024-09-10T08:09:52.882 INFO:tasks.workunit.client.0.smithi022.stdout:making iogen 2024-09-10T08:09:52.883 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'making iogen' 2024-09-10T08:09:52.883 INFO:tasks.workunit.client.0.smithi022.stderr:+ make 2024-09-10T08:09:52.889 INFO:tasks.workunit.client.0.smithi022.stdout:gcc -D_FILE_OFFSET_BITS=64 -DVERSION=\"3.1p0\" -Dstrlcpy=strncpy -Darc4random=rand -O2 src/iogen.c -o iogen 2024-09-10T08:09:52.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:52 smithi153 ceph-mon[35609]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:09:52.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:52 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:09:52.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:52 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:09:52.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:52 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:09:53.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:52 smithi022 ceph-mon[30854]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:09:53.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:52 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:09:53.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:52 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:09:53.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:52 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:09:53.132 INFO:tasks.workunit.client.0.smithi022.stdout:nroff -mandoc -Tascii src/iogen.8 > iogen.cat8 2024-09-10T08:09:53.231 INFO:tasks.workunit.client.0.smithi022.stdout:running iogen 2024-09-10T08:09:53.232 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'running iogen' 2024-09-10T08:09:53.233 INFO:tasks.workunit.client.0.smithi022.stderr:+ ./iogen -n 5 -s 2g 2024-09-10T08:09:53.233 INFO:tasks.workunit.client.0.smithi022.stderr:child spawned 82880 2024-09-10T08:09:53.233 INFO:tasks.workunit.client.0.smithi022.stderr:child spawned 82881 2024-09-10T08:09:53.233 INFO:tasks.workunit.client.0.smithi022.stderr:child spawned 82882 2024-09-10T08:09:53.233 INFO:tasks.workunit.client.0.smithi022.stderr:child spawned 82883 2024-09-10T08:09:53.233 INFO:tasks.workunit.client.0.smithi022.stderr:child spawned 82884 2024-09-10T08:09:53.233 INFO:tasks.workunit.client.0.smithi022.stdout:sleep for 10 min 2024-09-10T08:09:53.233 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'sleep for 10 min' 2024-09-10T08:09:53.234 INFO:tasks.workunit.client.0.smithi022.stderr:+ sleep 600 2024-09-10T08:09:54.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:54 smithi100 ceph-mon[35102]: pgmap v36: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T08:09:54.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:54 smithi153 ceph-mon[35609]: pgmap v36: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T08:09:55.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:54 smithi022 ceph-mon[30854]: pgmap v36: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 18 KiB/s wr, 16 op/s 2024-09-10T08:09:56.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:56 smithi100 ceph-mon[35102]: pgmap v37: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-10T08:09:56.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:56 smithi153 ceph-mon[35609]: pgmap v37: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-10T08:09:57.007 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:56 smithi022 ceph-mon[30854]: pgmap v37: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 18 KiB/s wr, 15 op/s 2024-09-10T08:09:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:09:58 smithi100 ceph-mon[35102]: pgmap v38: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-10T08:09:58.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:09:58 smithi153 ceph-mon[35609]: pgmap v38: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-10T08:09:59.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:09:58 smithi022 ceph-mon[30854]: pgmap v38: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 18 KiB/s wr, 13 op/s 2024-09-10T08:10:00.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:00 smithi100 ceph-mon[35102]: pgmap v39: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 335 MiB/s wr, 272 op/s 2024-09-10T08:10:00.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:00 smithi100 ceph-mon[35102]: overall HEALTH_OK 2024-09-10T08:10:00.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:00 smithi153 ceph-mon[35609]: pgmap v39: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 335 MiB/s wr, 272 op/s 2024-09-10T08:10:00.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:00 smithi153 ceph-mon[35609]: overall HEALTH_OK 2024-09-10T08:10:01.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:00 smithi022 ceph-mon[30854]: pgmap v39: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 335 MiB/s wr, 272 op/s 2024-09-10T08:10:01.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:00 smithi022 ceph-mon[30854]: overall HEALTH_OK 2024-09-10T08:10:02.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:02 smithi100 ceph-mon[35102]: pgmap v40: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 335 MiB/s wr, 268 op/s 2024-09-10T08:10:02.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:02 smithi153 ceph-mon[35609]: pgmap v40: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 335 MiB/s wr, 268 op/s 2024-09-10T08:10:03.015 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:02 smithi022 ceph-mon[30854]: pgmap v40: 97 pgs: 97 active+clean; 3.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 659 KiB/s rd, 335 MiB/s wr, 268 op/s 2024-09-10T08:10:04.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:04 smithi100 ceph-mon[35102]: pgmap v41: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 462 MiB/s wr, 469 op/s 2024-09-10T08:10:04.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:04 smithi153 ceph-mon[35609]: pgmap v41: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 462 MiB/s wr, 469 op/s 2024-09-10T08:10:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:04 smithi022 ceph-mon[30854]: pgmap v41: 97 pgs: 97 active+clean; 5.3 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 462 MiB/s wr, 469 op/s 2024-09-10T08:10:06.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:06 smithi100 ceph-mon[35102]: pgmap v42: 97 pgs: 97 active+clean; 7.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 687 MiB/s wr, 748 op/s 2024-09-10T08:10:06.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:06 smithi153 ceph-mon[35609]: pgmap v42: 97 pgs: 97 active+clean; 7.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 687 MiB/s wr, 748 op/s 2024-09-10T08:10:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:06 smithi022 ceph-mon[30854]: pgmap v42: 97 pgs: 97 active+clean; 7.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 687 MiB/s wr, 748 op/s 2024-09-10T08:10:08.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:08 smithi100 ceph-mon[35102]: pgmap v43: 97 pgs: 97 active+clean; 7.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 687 MiB/s wr, 748 op/s 2024-09-10T08:10:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:08 smithi153 ceph-mon[35609]: pgmap v43: 97 pgs: 97 active+clean; 7.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 687 MiB/s wr, 748 op/s 2024-09-10T08:10:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:08 smithi022 ceph-mon[30854]: pgmap v43: 97 pgs: 97 active+clean; 7.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 687 MiB/s wr, 748 op/s 2024-09-10T08:10:10.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:10 smithi153 ceph-mon[35609]: pgmap v44: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1019 MiB/s wr, 1.90k op/s 2024-09-10T08:10:10.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:10 smithi153 ceph-mon[35609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:10:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:10 smithi022 ceph-mon[30854]: pgmap v44: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1019 MiB/s wr, 1.90k op/s 2024-09-10T08:10:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:10 smithi022 ceph-mon[30854]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:10:11.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:10 smithi100 ceph-mon[35102]: pgmap v44: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1019 MiB/s wr, 1.90k op/s 2024-09-10T08:10:11.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:10 smithi100 ceph-mon[35102]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:10:13.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:12 smithi022 ceph-mon[30854]: pgmap v45: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 684 MiB/s wr, 1.64k op/s 2024-09-10T08:10:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:12 smithi100 ceph-mon[35102]: pgmap v45: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 684 MiB/s wr, 1.64k op/s 2024-09-10T08:10:13.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:12 smithi153 ceph-mon[35609]: pgmap v45: 97 pgs: 97 active+clean; 12 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 684 MiB/s wr, 1.64k op/s 2024-09-10T08:10:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:14 smithi022 ceph-mon[30854]: pgmap v46: 97 pgs: 97 active+clean; 13 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 823 MiB/s wr, 2.18k op/s 2024-09-10T08:10:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:14 smithi100 ceph-mon[35102]: pgmap v46: 97 pgs: 97 active+clean; 13 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 823 MiB/s wr, 2.18k op/s 2024-09-10T08:10:15.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:14 smithi153 ceph-mon[35609]: pgmap v46: 97 pgs: 97 active+clean; 13 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 823 MiB/s wr, 2.18k op/s 2024-09-10T08:10:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:16 smithi022 ceph-mon[30854]: pgmap v47: 97 pgs: 97 active+clean; 14 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 897 MiB/s wr, 2.71k op/s 2024-09-10T08:10:17.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:16 smithi100 ceph-mon[35102]: pgmap v47: 97 pgs: 97 active+clean; 14 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 897 MiB/s wr, 2.71k op/s 2024-09-10T08:10:17.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:16 smithi153 ceph-mon[35609]: pgmap v47: 97 pgs: 97 active+clean; 14 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 897 MiB/s wr, 2.71k op/s 2024-09-10T08:10:19.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:18 smithi022 ceph-mon[30854]: pgmap v48: 97 pgs: 97 active+clean; 14 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 672 MiB/s wr, 2.42k op/s 2024-09-10T08:10:19.025 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:18 smithi153 ceph-mon[35609]: pgmap v48: 97 pgs: 97 active+clean; 14 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 672 MiB/s wr, 2.42k op/s 2024-09-10T08:10:19.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:18 smithi100 ceph-mon[35102]: pgmap v48: 97 pgs: 97 active+clean; 14 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 672 MiB/s wr, 2.42k op/s 2024-09-10T08:10:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:20 smithi100 ceph-mon[35102]: pgmap v49: 97 pgs: 97 active+clean; 17 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 971 MiB/s wr, 3.99k op/s 2024-09-10T08:10:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:20 smithi100 ceph-mon[35102]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-10T08:10:21.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:20 smithi153 ceph-mon[35609]: pgmap v49: 97 pgs: 97 active+clean; 17 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 971 MiB/s wr, 3.99k op/s 2024-09-10T08:10:21.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:20 smithi153 ceph-mon[35609]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-10T08:10:21.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:20 smithi022 ceph-mon[30854]: pgmap v49: 97 pgs: 97 active+clean; 17 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 971 MiB/s wr, 3.99k op/s 2024-09-10T08:10:21.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:20 smithi022 ceph-mon[30854]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-10T08:10:23.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:22 smithi100 ceph-mon[35102]: pgmap v50: 97 pgs: 97 active+clean; 17 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 639 MiB/s wr, 2.84k op/s 2024-09-10T08:10:23.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:22 smithi153 ceph-mon[35609]: pgmap v50: 97 pgs: 97 active+clean; 17 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 639 MiB/s wr, 2.84k op/s 2024-09-10T08:10:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:22 smithi022 ceph-mon[30854]: pgmap v50: 97 pgs: 97 active+clean; 17 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 639 MiB/s wr, 2.84k op/s 2024-09-10T08:10:25.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:24 smithi100 ceph-mon[35102]: pgmap v51: 97 pgs: 97 active+clean; 18 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 777 MiB/s wr, 3.57k op/s 2024-09-10T08:10:25.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:24 smithi153 ceph-mon[35609]: pgmap v51: 97 pgs: 97 active+clean; 18 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 777 MiB/s wr, 3.57k op/s 2024-09-10T08:10:25.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:24 smithi022 ceph-mon[30854]: pgmap v51: 97 pgs: 97 active+clean; 18 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 777 MiB/s wr, 3.57k op/s 2024-09-10T08:10:27.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:26 smithi100 ceph-mon[35102]: pgmap v52: 97 pgs: 97 active+clean; 18 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 802 MiB/s wr, 3.97k op/s 2024-09-10T08:10:27.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:26 smithi153 ceph-mon[35609]: pgmap v52: 97 pgs: 97 active+clean; 18 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 802 MiB/s wr, 3.97k op/s 2024-09-10T08:10:27.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:26 smithi022 ceph-mon[30854]: pgmap v52: 97 pgs: 97 active+clean; 18 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 802 MiB/s wr, 3.97k op/s 2024-09-10T08:10:29.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:28 smithi100 ceph-mon[35102]: pgmap v53: 97 pgs: 97 active+clean; 18 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 601 MiB/s wr, 3.24k op/s 2024-09-10T08:10:29.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:28 smithi153 ceph-mon[35609]: pgmap v53: 97 pgs: 97 active+clean; 18 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 601 MiB/s wr, 3.24k op/s 2024-09-10T08:10:29.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:28 smithi022 ceph-mon[30854]: pgmap v53: 97 pgs: 97 active+clean; 18 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 601 MiB/s wr, 3.24k op/s 2024-09-10T08:10:31.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:30 smithi100 ceph-mon[35102]: pgmap v54: 97 pgs: 97 active+clean; 19 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 923 MiB/s wr, 4.64k op/s 2024-09-10T08:10:31.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:30 smithi153 ceph-mon[35609]: pgmap v54: 97 pgs: 97 active+clean; 19 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 923 MiB/s wr, 4.64k op/s 2024-09-10T08:10:31.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:30 smithi022 ceph-mon[30854]: pgmap v54: 97 pgs: 97 active+clean; 19 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 923 MiB/s wr, 4.64k op/s 2024-09-10T08:10:33.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:32 smithi153 ceph-mon[35609]: pgmap v55: 97 pgs: 97 active+clean; 19 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 625 MiB/s wr, 3.07k op/s 2024-09-10T08:10:33.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:32 smithi022 ceph-mon[30854]: pgmap v55: 97 pgs: 97 active+clean; 19 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 625 MiB/s wr, 3.07k op/s 2024-09-10T08:10:33.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:32 smithi100 ceph-mon[35102]: pgmap v55: 97 pgs: 97 active+clean; 19 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 625 MiB/s wr, 3.07k op/s 2024-09-10T08:10:35.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:34 smithi153 ceph-mon[35609]: pgmap v56: 97 pgs: 97 active+clean; 19 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 724 MiB/s wr, 3.49k op/s 2024-09-10T08:10:35.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:34 smithi022 ceph-mon[30854]: pgmap v56: 97 pgs: 97 active+clean; 19 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 724 MiB/s wr, 3.49k op/s 2024-09-10T08:10:35.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:34 smithi100 ceph-mon[35102]: pgmap v56: 97 pgs: 97 active+clean; 19 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 724 MiB/s wr, 3.49k op/s 2024-09-10T08:10:37.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:36 smithi022 ceph-mon[30854]: pgmap v57: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 809 MiB/s wr, 3.85k op/s 2024-09-10T08:10:37.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:36 smithi100 ceph-mon[35102]: pgmap v57: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 809 MiB/s wr, 3.85k op/s 2024-09-10T08:10:37.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:36 smithi153 ceph-mon[35609]: pgmap v57: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 809 MiB/s wr, 3.85k op/s 2024-09-10T08:10:39.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:38 smithi022 ceph-mon[30854]: pgmap v58: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 645 MiB/s wr, 2.91k op/s 2024-09-10T08:10:39.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:38 smithi100 ceph-mon[35102]: pgmap v58: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 645 MiB/s wr, 2.91k op/s 2024-09-10T08:10:39.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:38 smithi153 ceph-mon[35609]: pgmap v58: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 645 MiB/s wr, 2.91k op/s 2024-09-10T08:10:41.260 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:40 smithi022 ceph-mon[30854]: pgmap v59: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 942 MiB/s wr, 3.50k op/s 2024-09-10T08:10:41.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:40 smithi100 ceph-mon[35102]: pgmap v59: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 942 MiB/s wr, 3.50k op/s 2024-09-10T08:10:41.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:40 smithi153 ceph-mon[35609]: pgmap v59: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 942 MiB/s wr, 3.50k op/s 2024-09-10T08:10:43.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:43 smithi022 ceph-mon[30854]: pgmap v60: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 656 MiB/s wr, 2.15k op/s 2024-09-10T08:10:43.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:43 smithi100 ceph-mon[35102]: pgmap v60: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 656 MiB/s wr, 2.15k op/s 2024-09-10T08:10:43.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:43 smithi153 ceph-mon[35609]: pgmap v60: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 656 MiB/s wr, 2.15k op/s 2024-09-10T08:10:45.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:45 smithi100 ceph-mon[35102]: pgmap v61: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 877 MiB/s wr, 2.49k op/s 2024-09-10T08:10:45.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:45 smithi153 ceph-mon[35609]: pgmap v61: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 877 MiB/s wr, 2.49k op/s 2024-09-10T08:10:45.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:45 smithi022 ceph-mon[30854]: pgmap v61: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 877 MiB/s wr, 2.49k op/s 2024-09-10T08:10:47.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:47 smithi100 ceph-mon[35102]: pgmap v62: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 922 MiB/s wr, 2.31k op/s 2024-09-10T08:10:47.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:47 smithi153 ceph-mon[35609]: pgmap v62: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 922 MiB/s wr, 2.31k op/s 2024-09-10T08:10:47.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:47 smithi022 ceph-mon[30854]: pgmap v62: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 922 MiB/s wr, 2.31k op/s 2024-09-10T08:10:49.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:49 smithi100 ceph-mon[35102]: pgmap v63: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 698 MiB/s wr, 1.22k op/s 2024-09-10T08:10:49.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:49 smithi153 ceph-mon[35609]: pgmap v63: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 698 MiB/s wr, 1.22k op/s 2024-09-10T08:10:49.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:49 smithi022 ceph-mon[30854]: pgmap v63: 97 pgs: 97 active+clean; 20 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 698 MiB/s wr, 1.22k op/s 2024-09-10T08:10:51.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:51 smithi100 ceph-mon[35102]: pgmap v64: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.0 GiB/s wr, 2.11k op/s 2024-09-10T08:10:51.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:51 smithi153 ceph-mon[35609]: pgmap v64: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.0 GiB/s wr, 2.11k op/s 2024-09-10T08:10:51.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:51 smithi022 ceph-mon[30854]: pgmap v64: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.0 GiB/s wr, 2.11k op/s 2024-09-10T08:10:52.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:52 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:10:52.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:52 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:10:52.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:52 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:10:53.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:53 smithi153 ceph-mon[35609]: pgmap v65: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 732 MiB/s wr, 1.51k op/s 2024-09-10T08:10:53.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:53 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:53.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:53 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:53.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:53 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:53.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:53 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:53.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:53 smithi022 ceph-mon[30854]: pgmap v65: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 732 MiB/s wr, 1.51k op/s 2024-09-10T08:10:53.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:53 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:53.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:53 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:53.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:53 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:53.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:53 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:53.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:53 smithi100 ceph-mon[35102]: pgmap v65: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 732 MiB/s wr, 1.51k op/s 2024-09-10T08:10:53.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:53 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:53.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:53 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:53.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:53 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:53.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:53 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:54.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:54 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:54.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:54 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:54.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:54 smithi153 ceph-mon[35609]: pgmap v66: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 893 MiB/s wr, 2.29k op/s 2024-09-10T08:10:54.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:54 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:54.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:54 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:54.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:54 smithi022 ceph-mon[30854]: pgmap v66: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 893 MiB/s wr, 2.29k op/s 2024-09-10T08:10:54.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:54 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:54.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:54 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:54.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:54 smithi100 ceph-mon[35102]: pgmap v66: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 893 MiB/s wr, 2.29k op/s 2024-09-10T08:10:55.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:55 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:10:55.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:55 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:10:55.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:55 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:55.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:55 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:10:55.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:55 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:10:55.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:55 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:55.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:55 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:10:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:55 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:10:55.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:55 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:10:56.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:56 smithi100 ceph-mon[35102]: pgmap v67: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 794 MiB/s wr, 2.57k op/s 2024-09-10T08:10:56.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:56 smithi153 ceph-mon[35609]: pgmap v67: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 794 MiB/s wr, 2.57k op/s 2024-09-10T08:10:57.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:56 smithi022 ceph-mon[30854]: pgmap v67: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 794 MiB/s wr, 2.57k op/s 2024-09-10T08:10:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:10:58 smithi100 ceph-mon[35102]: pgmap v68: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 651 MiB/s wr, 2.33k op/s 2024-09-10T08:10:58.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:10:58 smithi153 ceph-mon[35609]: pgmap v68: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 651 MiB/s wr, 2.33k op/s 2024-09-10T08:10:59.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:10:58 smithi022 ceph-mon[30854]: pgmap v68: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 651 MiB/s wr, 2.33k op/s 2024-09-10T08:11:00.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:00 smithi100 ceph-mon[35102]: pgmap v69: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 963 MiB/s wr, 3.04k op/s 2024-09-10T08:11:00.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:00 smithi153 ceph-mon[35609]: pgmap v69: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 963 MiB/s wr, 3.04k op/s 2024-09-10T08:11:01.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:00 smithi022 ceph-mon[30854]: pgmap v69: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 963 MiB/s wr, 3.04k op/s 2024-09-10T08:11:02.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:02 smithi100 ceph-mon[35102]: pgmap v70: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 672 MiB/s wr, 2.21k op/s 2024-09-10T08:11:02.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:02 smithi153 ceph-mon[35609]: pgmap v70: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 672 MiB/s wr, 2.21k op/s 2024-09-10T08:11:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:02 smithi022 ceph-mon[30854]: pgmap v70: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 672 MiB/s wr, 2.21k op/s 2024-09-10T08:11:04.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:04 smithi153 ceph-mon[35609]: pgmap v71: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 885 MiB/s wr, 2.68k op/s 2024-09-10T08:11:05.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:04 smithi022 ceph-mon[30854]: pgmap v71: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 885 MiB/s wr, 2.68k op/s 2024-09-10T08:11:05.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:04 smithi100 ceph-mon[35102]: pgmap v71: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 885 MiB/s wr, 2.68k op/s 2024-09-10T08:11:06.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:06 smithi153 ceph-mon[35609]: pgmap v72: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 832 MiB/s wr, 2.23k op/s 2024-09-10T08:11:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:06 smithi022 ceph-mon[30854]: pgmap v72: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 832 MiB/s wr, 2.23k op/s 2024-09-10T08:11:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:06 smithi100 ceph-mon[35102]: pgmap v72: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 832 MiB/s wr, 2.23k op/s 2024-09-10T08:11:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:08 smithi153 ceph-mon[35609]: pgmap v73: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 711 MiB/s wr, 1.61k op/s 2024-09-10T08:11:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:08 smithi022 ceph-mon[30854]: pgmap v73: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 711 MiB/s wr, 1.61k op/s 2024-09-10T08:11:09.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:08 smithi100 ceph-mon[35102]: pgmap v73: 97 pgs: 97 active+clean; 20 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 711 MiB/s wr, 1.61k op/s 2024-09-10T08:11:10.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:10 smithi153 ceph-mon[35609]: pgmap v74: 97 pgs: 97 active+clean; 22 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.0 GiB/s wr, 3.30k op/s 2024-09-10T08:11:11.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:10 smithi022 ceph-mon[30854]: pgmap v74: 97 pgs: 97 active+clean; 22 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.0 GiB/s wr, 3.30k op/s 2024-09-10T08:11:11.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:10 smithi100 ceph-mon[35102]: pgmap v74: 97 pgs: 97 active+clean; 22 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.0 GiB/s wr, 3.30k op/s 2024-09-10T08:11:13.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:12 smithi022 ceph-mon[30854]: pgmap v75: 97 pgs: 97 active+clean; 22 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 729 MiB/s wr, 2.60k op/s 2024-09-10T08:11:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:12 smithi100 ceph-mon[35102]: pgmap v75: 97 pgs: 97 active+clean; 22 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 729 MiB/s wr, 2.60k op/s 2024-09-10T08:11:13.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:12 smithi153 ceph-mon[35609]: pgmap v75: 97 pgs: 97 active+clean; 22 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 729 MiB/s wr, 2.60k op/s 2024-09-10T08:11:15.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:14 smithi022 ceph-mon[30854]: pgmap v76: 97 pgs: 97 active+clean; 24 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 911 MiB/s wr, 3.63k op/s 2024-09-10T08:11:15.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:14 smithi100 ceph-mon[35102]: pgmap v76: 97 pgs: 97 active+clean; 24 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 911 MiB/s wr, 3.63k op/s 2024-09-10T08:11:15.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:14 smithi153 ceph-mon[35609]: pgmap v76: 97 pgs: 97 active+clean; 24 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 911 MiB/s wr, 3.63k op/s 2024-09-10T08:11:16.985 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:16 smithi153 ceph-mon[35609]: pgmap v77: 97 pgs: 97 active+clean; 25 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 761 MiB/s wr, 3.52k op/s 2024-09-10T08:11:17.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:16 smithi022 ceph-mon[30854]: pgmap v77: 97 pgs: 97 active+clean; 25 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 761 MiB/s wr, 3.52k op/s 2024-09-10T08:11:17.120 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:16 smithi100 ceph-mon[35102]: pgmap v77: 97 pgs: 97 active+clean; 25 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 761 MiB/s wr, 3.52k op/s 2024-09-10T08:11:19.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:18 smithi022 ceph-mon[30854]: pgmap v78: 97 pgs: 97 active+clean; 25 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 696 MiB/s wr, 3.64k op/s 2024-09-10T08:11:19.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:18 smithi100 ceph-mon[35102]: pgmap v78: 97 pgs: 97 active+clean; 25 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 696 MiB/s wr, 3.64k op/s 2024-09-10T08:11:19.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:18 smithi153 ceph-mon[35609]: pgmap v78: 97 pgs: 97 active+clean; 25 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 696 MiB/s wr, 3.64k op/s 2024-09-10T08:11:21.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:20 smithi100 ceph-mon[35102]: pgmap v79: 97 pgs: 97 active+clean; 25 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 956 MiB/s wr, 5.01k op/s 2024-09-10T08:11:21.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:20 smithi153 ceph-mon[35609]: pgmap v79: 97 pgs: 97 active+clean; 25 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 956 MiB/s wr, 5.01k op/s 2024-09-10T08:11:21.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:20 smithi022 ceph-mon[30854]: pgmap v79: 97 pgs: 97 active+clean; 25 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 956 MiB/s wr, 5.01k op/s 2024-09-10T08:11:23.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:22 smithi100 ceph-mon[35102]: pgmap v80: 97 pgs: 97 active+clean; 26 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 696 MiB/s wr, 3.72k op/s 2024-09-10T08:11:23.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:22 smithi153 ceph-mon[35609]: pgmap v80: 97 pgs: 97 active+clean; 26 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 696 MiB/s wr, 3.72k op/s 2024-09-10T08:11:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:22 smithi022 ceph-mon[30854]: pgmap v80: 97 pgs: 97 active+clean; 26 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 696 MiB/s wr, 3.72k op/s 2024-09-10T08:11:25.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:24 smithi100 ceph-mon[35102]: pgmap v81: 97 pgs: 97 active+clean; 26 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 871 MiB/s wr, 4.45k op/s 2024-09-10T08:11:25.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:24 smithi153 ceph-mon[35609]: pgmap v81: 97 pgs: 97 active+clean; 26 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 871 MiB/s wr, 4.45k op/s 2024-09-10T08:11:25.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:24 smithi022 ceph-mon[30854]: pgmap v81: 97 pgs: 97 active+clean; 26 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 871 MiB/s wr, 4.45k op/s 2024-09-10T08:11:27.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:26 smithi100 ceph-mon[35102]: pgmap v82: 97 pgs: 97 active+clean; 27 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 791 MiB/s wr, 3.89k op/s 2024-09-10T08:11:27.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:26 smithi153 ceph-mon[35609]: pgmap v82: 97 pgs: 97 active+clean; 27 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 791 MiB/s wr, 3.89k op/s 2024-09-10T08:11:27.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:26 smithi022 ceph-mon[30854]: pgmap v82: 97 pgs: 97 active+clean; 27 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 791 MiB/s wr, 3.89k op/s 2024-09-10T08:11:29.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:28 smithi153 ceph-mon[35609]: pgmap v83: 97 pgs: 97 active+clean; 27 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 727 MiB/s wr, 3.52k op/s 2024-09-10T08:11:29.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:28 smithi022 ceph-mon[30854]: pgmap v83: 97 pgs: 97 active+clean; 27 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 727 MiB/s wr, 3.52k op/s 2024-09-10T08:11:29.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:28 smithi100 ceph-mon[35102]: pgmap v83: 97 pgs: 97 active+clean; 27 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 727 MiB/s wr, 3.52k op/s 2024-09-10T08:11:31.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:30 smithi153 ceph-mon[35609]: pgmap v84: 97 pgs: 97 active+clean; 28 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 894 MiB/s wr, 4.14k op/s 2024-09-10T08:11:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:30 smithi022 ceph-mon[30854]: pgmap v84: 97 pgs: 97 active+clean; 28 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 894 MiB/s wr, 4.14k op/s 2024-09-10T08:11:31.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:30 smithi100 ceph-mon[35102]: pgmap v84: 97 pgs: 97 active+clean; 28 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 894 MiB/s wr, 4.14k op/s 2024-09-10T08:11:33.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:32 smithi153 ceph-mon[35609]: pgmap v85: 97 pgs: 97 active+clean; 29 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 708 MiB/s wr, 3.06k op/s 2024-09-10T08:11:33.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:32 smithi022 ceph-mon[30854]: pgmap v85: 97 pgs: 97 active+clean; 29 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 708 MiB/s wr, 3.06k op/s 2024-09-10T08:11:33.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:32 smithi100 ceph-mon[35102]: pgmap v85: 97 pgs: 97 active+clean; 29 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 708 MiB/s wr, 3.06k op/s 2024-09-10T08:11:35.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:34 smithi153 ceph-mon[35609]: pgmap v86: 97 pgs: 97 active+clean; 29 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 836 MiB/s wr, 2.85k op/s 2024-09-10T08:11:35.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:34 smithi022 ceph-mon[30854]: pgmap v86: 97 pgs: 97 active+clean; 29 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 836 MiB/s wr, 2.85k op/s 2024-09-10T08:11:35.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:34 smithi100 ceph-mon[35102]: pgmap v86: 97 pgs: 97 active+clean; 29 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 836 MiB/s wr, 2.85k op/s 2024-09-10T08:11:37.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:36 smithi022 ceph-mon[30854]: pgmap v87: 97 pgs: 97 active+clean; 30 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 804 MiB/s wr, 2.43k op/s 2024-09-10T08:11:37.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:36 smithi100 ceph-mon[35102]: pgmap v87: 97 pgs: 97 active+clean; 30 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 804 MiB/s wr, 2.43k op/s 2024-09-10T08:11:37.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:36 smithi153 ceph-mon[35609]: pgmap v87: 97 pgs: 97 active+clean; 30 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 804 MiB/s wr, 2.43k op/s 2024-09-10T08:11:39.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:39 smithi100 ceph-mon[35102]: pgmap v88: 97 pgs: 97 active+clean; 30 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 662 MiB/s wr, 1.91k op/s 2024-09-10T08:11:39.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:39 smithi153 ceph-mon[35609]: pgmap v88: 97 pgs: 97 active+clean; 30 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 662 MiB/s wr, 1.91k op/s 2024-09-10T08:11:39.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:39 smithi022 ceph-mon[30854]: pgmap v88: 97 pgs: 97 active+clean; 30 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 662 MiB/s wr, 1.91k op/s 2024-09-10T08:11:41.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:41 smithi100 ceph-mon[35102]: pgmap v89: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 893 MiB/s wr, 2.81k op/s 2024-09-10T08:11:41.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:41 smithi153 ceph-mon[35609]: pgmap v89: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 893 MiB/s wr, 2.81k op/s 2024-09-10T08:11:41.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:41 smithi022 ceph-mon[30854]: pgmap v89: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 893 MiB/s wr, 2.81k op/s 2024-09-10T08:11:43.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:43 smithi100 ceph-mon[35102]: pgmap v90: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 756 MiB/s wr, 1.97k op/s 2024-09-10T08:11:43.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:43 smithi153 ceph-mon[35609]: pgmap v90: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 756 MiB/s wr, 1.97k op/s 2024-09-10T08:11:43.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:43 smithi022 ceph-mon[30854]: pgmap v90: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 756 MiB/s wr, 1.97k op/s 2024-09-10T08:11:45.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:45 smithi100 ceph-mon[35102]: pgmap v91: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 896 MiB/s wr, 1.94k op/s 2024-09-10T08:11:45.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:45 smithi153 ceph-mon[35609]: pgmap v91: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 896 MiB/s wr, 1.94k op/s 2024-09-10T08:11:45.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:45 smithi022 ceph-mon[30854]: pgmap v91: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 896 MiB/s wr, 1.94k op/s 2024-09-10T08:11:47.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:47 smithi100 ceph-mon[35102]: pgmap v92: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 836 MiB/s wr, 2.02k op/s 2024-09-10T08:11:47.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:47 smithi153 ceph-mon[35609]: pgmap v92: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 836 MiB/s wr, 2.02k op/s 2024-09-10T08:11:47.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:47 smithi022 ceph-mon[30854]: pgmap v92: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 836 MiB/s wr, 2.02k op/s 2024-09-10T08:11:49.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:49 smithi100 ceph-mon[35102]: pgmap v93: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 693 MiB/s wr, 1.71k op/s 2024-09-10T08:11:49.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:49 smithi153 ceph-mon[35609]: pgmap v93: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 693 MiB/s wr, 1.71k op/s 2024-09-10T08:11:49.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:49 smithi022 ceph-mon[30854]: pgmap v93: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 693 MiB/s wr, 1.71k op/s 2024-09-10T08:11:51.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:51 smithi153 ceph-mon[35609]: pgmap v94: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 929 MiB/s wr, 2.40k op/s 2024-09-10T08:11:51.506 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:51 smithi022 ceph-mon[30854]: pgmap v94: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 929 MiB/s wr, 2.40k op/s 2024-09-10T08:11:51.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:51 smithi100 ceph-mon[35102]: pgmap v94: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 929 MiB/s wr, 2.40k op/s 2024-09-10T08:11:53.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:53 smithi153 ceph-mon[35609]: pgmap v95: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 817 MiB/s wr, 1.70k op/s 2024-09-10T08:11:53.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:53 smithi022 ceph-mon[30854]: pgmap v95: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 817 MiB/s wr, 1.70k op/s 2024-09-10T08:11:53.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:53 smithi100 ceph-mon[35102]: pgmap v95: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 817 MiB/s wr, 1.70k op/s 2024-09-10T08:11:55.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:55 smithi153 ceph-mon[35609]: pgmap v96: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 911 MiB/s wr, 1.79k op/s 2024-09-10T08:11:55.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:55 smithi022 ceph-mon[30854]: pgmap v96: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 911 MiB/s wr, 1.79k op/s 2024-09-10T08:11:55.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:55 smithi100 ceph-mon[35102]: pgmap v96: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 911 MiB/s wr, 1.79k op/s 2024-09-10T08:11:56.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:56 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:11:56.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:56 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:11:56.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:56 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:11:57.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:57 smithi022 ceph-mon[30854]: pgmap v97: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 834 MiB/s wr, 2.02k op/s 2024-09-10T08:11:57.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:57 smithi100 ceph-mon[35102]: pgmap v97: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 834 MiB/s wr, 2.02k op/s 2024-09-10T08:11:57.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:57 smithi153 ceph-mon[35609]: pgmap v97: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 834 MiB/s wr, 2.02k op/s 2024-09-10T08:11:58.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:58 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:11:58.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:58 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:11:58.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:58 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:11:58.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:58 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:11:58.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:58 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:11:58.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:58 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:11:58.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:58 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:11:58.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:58 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:11:58.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:58 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:11:59.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:11:59 smithi153 ceph-mon[35609]: pgmap v98: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 695 MiB/s wr, 1.74k op/s 2024-09-10T08:11:59.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:11:59 smithi022 ceph-mon[30854]: pgmap v98: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 695 MiB/s wr, 1.74k op/s 2024-09-10T08:11:59.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:11:59 smithi100 ceph-mon[35102]: pgmap v98: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 695 MiB/s wr, 1.74k op/s 2024-09-10T08:12:00.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:00 smithi022 ceph-mon[30854]: pgmap v99: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 908 MiB/s wr, 2.66k op/s 2024-09-10T08:12:00.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:00 smithi100 ceph-mon[35102]: pgmap v99: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 908 MiB/s wr, 2.66k op/s 2024-09-10T08:12:00.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:00 smithi153 ceph-mon[35609]: pgmap v99: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 908 MiB/s wr, 2.66k op/s 2024-09-10T08:12:03.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:02 smithi022 ceph-mon[30854]: pgmap v100: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 782 MiB/s wr, 2.30k op/s 2024-09-10T08:12:03.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:02 smithi100 ceph-mon[35102]: pgmap v100: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 782 MiB/s wr, 2.30k op/s 2024-09-10T08:12:03.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:02 smithi153 ceph-mon[35609]: pgmap v100: 97 pgs: 97 active+clean; 30 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 782 MiB/s wr, 2.30k op/s 2024-09-10T08:12:04.995 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:04 smithi153 ceph-mon[35609]: pgmap v101: 97 pgs: 97 active+clean; 30 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 858 MiB/s wr, 2.79k op/s 2024-09-10T08:12:05.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:04 smithi022 ceph-mon[30854]: pgmap v101: 97 pgs: 97 active+clean; 30 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 858 MiB/s wr, 2.79k op/s 2024-09-10T08:12:05.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:04 smithi100 ceph-mon[35102]: pgmap v101: 97 pgs: 97 active+clean; 30 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 858 MiB/s wr, 2.79k op/s 2024-09-10T08:12:07.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:06 smithi022 ceph-mon[30854]: pgmap v102: 97 pgs: 97 active+clean; 30 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 796 MiB/s wr, 2.95k op/s 2024-09-10T08:12:07.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:06 smithi100 ceph-mon[35102]: pgmap v102: 97 pgs: 97 active+clean; 30 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 796 MiB/s wr, 2.95k op/s 2024-09-10T08:12:07.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:06 smithi153 ceph-mon[35609]: pgmap v102: 97 pgs: 97 active+clean; 30 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 796 MiB/s wr, 2.95k op/s 2024-09-10T08:12:09.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:08 smithi022 ceph-mon[30854]: pgmap v103: 97 pgs: 97 active+clean; 30 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 660 MiB/s wr, 2.46k op/s 2024-09-10T08:12:09.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:08 smithi100 ceph-mon[35102]: pgmap v103: 97 pgs: 97 active+clean; 30 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 660 MiB/s wr, 2.46k op/s 2024-09-10T08:12:09.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:08 smithi153 ceph-mon[35609]: pgmap v103: 97 pgs: 97 active+clean; 30 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 660 MiB/s wr, 2.46k op/s 2024-09-10T08:12:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:10 smithi022 ceph-mon[30854]: pgmap v104: 97 pgs: 97 active+clean; 32 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 873 MiB/s wr, 3.59k op/s 2024-09-10T08:12:11.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:10 smithi100 ceph-mon[35102]: pgmap v104: 97 pgs: 97 active+clean; 32 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 873 MiB/s wr, 3.59k op/s 2024-09-10T08:12:11.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:10 smithi153 ceph-mon[35609]: pgmap v104: 97 pgs: 97 active+clean; 32 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 873 MiB/s wr, 3.59k op/s 2024-09-10T08:12:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:12 smithi100 ceph-mon[35102]: pgmap v105: 97 pgs: 97 active+clean; 33 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 780 MiB/s wr, 3.62k op/s 2024-09-10T08:12:13.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:12 smithi153 ceph-mon[35609]: pgmap v105: 97 pgs: 97 active+clean; 33 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 780 MiB/s wr, 3.62k op/s 2024-09-10T08:12:13.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:12 smithi022 ceph-mon[30854]: pgmap v105: 97 pgs: 97 active+clean; 33 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 780 MiB/s wr, 3.62k op/s 2024-09-10T08:12:15.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:14 smithi022 ceph-mon[30854]: pgmap v106: 97 pgs: 97 active+clean; 34 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 863 MiB/s wr, 4.45k op/s 2024-09-10T08:12:15.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:14 smithi100 ceph-mon[35102]: pgmap v106: 97 pgs: 97 active+clean; 34 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 863 MiB/s wr, 4.45k op/s 2024-09-10T08:12:15.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:14 smithi153 ceph-mon[35609]: pgmap v106: 97 pgs: 97 active+clean; 34 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 863 MiB/s wr, 4.45k op/s 2024-09-10T08:12:16.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:16 smithi100 ceph-mon[35102]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:12:16.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:16 smithi153 ceph-mon[35609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:12:16.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:16 smithi022 ceph-mon[30854]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:12:17.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:17 smithi153 ceph-mon[35609]: pgmap v107: 97 pgs: 97 active+clean; 34 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 725 MiB/s wr, 4.02k op/s 2024-09-10T08:12:17.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:17 smithi022 ceph-mon[30854]: pgmap v107: 97 pgs: 97 active+clean; 34 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 725 MiB/s wr, 4.02k op/s 2024-09-10T08:12:17.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:17 smithi100 ceph-mon[35102]: pgmap v107: 97 pgs: 97 active+clean; 34 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 725 MiB/s wr, 4.02k op/s 2024-09-10T08:12:19.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:19 smithi153 ceph-mon[35609]: pgmap v108: 97 pgs: 97 active+clean; 35 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 662 MiB/s wr, 3.82k op/s 2024-09-10T08:12:19.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:19 smithi022 ceph-mon[30854]: pgmap v108: 97 pgs: 97 active+clean; 35 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 662 MiB/s wr, 3.82k op/s 2024-09-10T08:12:19.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:19 smithi100 ceph-mon[35102]: pgmap v108: 97 pgs: 97 active+clean; 35 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 662 MiB/s wr, 3.82k op/s 2024-09-10T08:12:21.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:21 smithi153 ceph-mon[35609]: pgmap v109: 97 pgs: 97 active+clean; 35 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 870 MiB/s wr, 4.38k op/s 2024-09-10T08:12:21.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:21 smithi022 ceph-mon[30854]: pgmap v109: 97 pgs: 97 active+clean; 35 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 870 MiB/s wr, 4.38k op/s 2024-09-10T08:12:21.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:21 smithi100 ceph-mon[35102]: pgmap v109: 97 pgs: 97 active+clean; 35 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 870 MiB/s wr, 4.38k op/s 2024-09-10T08:12:23.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:23 smithi100 ceph-mon[35102]: pgmap v110: 97 pgs: 97 active+clean; 35 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 767 MiB/s wr, 3.50k op/s 2024-09-10T08:12:23.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:23 smithi153 ceph-mon[35609]: pgmap v110: 97 pgs: 97 active+clean; 35 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 767 MiB/s wr, 3.50k op/s 2024-09-10T08:12:23.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:23 smithi022 ceph-mon[30854]: pgmap v110: 97 pgs: 97 active+clean; 35 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 767 MiB/s wr, 3.50k op/s 2024-09-10T08:12:25.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:25 smithi100 ceph-mon[35102]: pgmap v111: 97 pgs: 97 active+clean; 37 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 847 MiB/s wr, 2.88k op/s 2024-09-10T08:12:25.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:25 smithi100 ceph-mon[35102]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:12:25.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:25 smithi153 ceph-mon[35609]: pgmap v111: 97 pgs: 97 active+clean; 37 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 847 MiB/s wr, 2.88k op/s 2024-09-10T08:12:25.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:25 smithi153 ceph-mon[35609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:12:25.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:25 smithi022 ceph-mon[30854]: pgmap v111: 97 pgs: 97 active+clean; 37 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 847 MiB/s wr, 2.88k op/s 2024-09-10T08:12:25.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:25 smithi022 ceph-mon[30854]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:12:27.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:27 smithi100 ceph-mon[35102]: pgmap v112: 97 pgs: 97 active+clean; 37 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 710 MiB/s wr, 1.81k op/s 2024-09-10T08:12:27.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:27 smithi153 ceph-mon[35609]: pgmap v112: 97 pgs: 97 active+clean; 37 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 710 MiB/s wr, 1.81k op/s 2024-09-10T08:12:27.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:27 smithi022 ceph-mon[30854]: pgmap v112: 97 pgs: 97 active+clean; 37 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 710 MiB/s wr, 1.81k op/s 2024-09-10T08:12:29.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:29 smithi100 ceph-mon[35102]: pgmap v113: 97 pgs: 97 active+clean; 38 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 731 MiB/s wr, 1.68k op/s 2024-09-10T08:12:29.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:29 smithi153 ceph-mon[35609]: pgmap v113: 97 pgs: 97 active+clean; 38 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 731 MiB/s wr, 1.68k op/s 2024-09-10T08:12:29.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:29 smithi022 ceph-mon[30854]: pgmap v113: 97 pgs: 97 active+clean; 38 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 731 MiB/s wr, 1.68k op/s 2024-09-10T08:12:31.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:31 smithi100 ceph-mon[35102]: pgmap v114: 97 pgs: 97 active+clean; 39 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 847 MiB/s wr, 1.64k op/s 2024-09-10T08:12:31.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:31 smithi153 ceph-mon[35609]: pgmap v114: 97 pgs: 97 active+clean; 39 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 847 MiB/s wr, 1.64k op/s 2024-09-10T08:12:31.770 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:31 smithi022 ceph-mon[30854]: pgmap v114: 97 pgs: 97 active+clean; 39 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 847 MiB/s wr, 1.64k op/s 2024-09-10T08:12:33.582 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:33 smithi022 ceph-mon[30854]: pgmap v115: 97 pgs: 97 active+clean; 40 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 783 MiB/s wr, 1.48k op/s 2024-09-10T08:12:33.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:33 smithi100 ceph-mon[35102]: pgmap v115: 97 pgs: 97 active+clean; 40 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 783 MiB/s wr, 1.48k op/s 2024-09-10T08:12:33.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:33 smithi153 ceph-mon[35609]: pgmap v115: 97 pgs: 97 active+clean; 40 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 783 MiB/s wr, 1.48k op/s 2024-09-10T08:12:35.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:35 smithi100 ceph-mon[35102]: pgmap v116: 97 pgs: 97 active+clean; 40 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 875 MiB/s wr, 1.79k op/s 2024-09-10T08:12:35.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:35 smithi153 ceph-mon[35609]: pgmap v116: 97 pgs: 97 active+clean; 40 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 875 MiB/s wr, 1.79k op/s 2024-09-10T08:12:35.760 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:35 smithi022 ceph-mon[30854]: pgmap v116: 97 pgs: 97 active+clean; 40 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 875 MiB/s wr, 1.79k op/s 2024-09-10T08:12:37.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:37 smithi100 ceph-mon[35102]: pgmap v117: 97 pgs: 97 active+clean; 40 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 736 MiB/s wr, 1.53k op/s 2024-09-10T08:12:37.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:37 smithi153 ceph-mon[35609]: pgmap v117: 97 pgs: 97 active+clean; 40 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 736 MiB/s wr, 1.53k op/s 2024-09-10T08:12:37.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:37 smithi022 ceph-mon[30854]: pgmap v117: 97 pgs: 97 active+clean; 40 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 736 MiB/s wr, 1.53k op/s 2024-09-10T08:12:39.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:39 smithi100 ceph-mon[35102]: pgmap v118: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 763 MiB/s wr, 1.53k op/s 2024-09-10T08:12:39.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:39 smithi153 ceph-mon[35609]: pgmap v118: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 763 MiB/s wr, 1.53k op/s 2024-09-10T08:12:39.757 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:39 smithi022 ceph-mon[30854]: pgmap v118: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 763 MiB/s wr, 1.53k op/s 2024-09-10T08:12:41.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:41 smithi153 ceph-mon[35609]: pgmap v119: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 892 MiB/s wr, 1.98k op/s 2024-09-10T08:12:41.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:41 smithi022 ceph-mon[30854]: pgmap v119: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 892 MiB/s wr, 1.98k op/s 2024-09-10T08:12:41.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:41 smithi100 ceph-mon[35102]: pgmap v119: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 892 MiB/s wr, 1.98k op/s 2024-09-10T08:12:43.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:43 smithi153 ceph-mon[35609]: pgmap v120: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 833 MiB/s wr, 2.07k op/s 2024-09-10T08:12:43.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:43 smithi022 ceph-mon[30854]: pgmap v120: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 833 MiB/s wr, 2.07k op/s 2024-09-10T08:12:43.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:43 smithi100 ceph-mon[35102]: pgmap v120: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 833 MiB/s wr, 2.07k op/s 2024-09-10T08:12:45.670 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:45 smithi100 ceph-mon[35102]: pgmap v121: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 889 MiB/s wr, 2.40k op/s 2024-09-10T08:12:45.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:45 smithi153 ceph-mon[35609]: pgmap v121: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 889 MiB/s wr, 2.40k op/s 2024-09-10T08:12:45.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:45 smithi022 ceph-mon[30854]: pgmap v121: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 889 MiB/s wr, 2.40k op/s 2024-09-10T08:12:47.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:47 smithi153 ceph-mon[35609]: pgmap v122: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 747 MiB/s wr, 2.02k op/s 2024-09-10T08:12:47.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:47 smithi022 ceph-mon[30854]: pgmap v122: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 747 MiB/s wr, 2.02k op/s 2024-09-10T08:12:47.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:47 smithi100 ceph-mon[35102]: pgmap v122: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 747 MiB/s wr, 2.02k op/s 2024-09-10T08:12:49.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:49 smithi153 ceph-mon[35609]: pgmap v123: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 763 MiB/s wr, 2.24k op/s 2024-09-10T08:12:49.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:49 smithi022 ceph-mon[30854]: pgmap v123: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 763 MiB/s wr, 2.24k op/s 2024-09-10T08:12:49.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:49 smithi100 ceph-mon[35102]: pgmap v123: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 763 MiB/s wr, 2.24k op/s 2024-09-10T08:12:51.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:51 smithi153 ceph-mon[35609]: pgmap v124: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 874 MiB/s wr, 3.01k op/s 2024-09-10T08:12:51.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:51 smithi022 ceph-mon[30854]: pgmap v124: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 874 MiB/s wr, 3.01k op/s 2024-09-10T08:12:51.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:51 smithi100 ceph-mon[35102]: pgmap v124: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 874 MiB/s wr, 3.01k op/s 2024-09-10T08:12:53.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:53 smithi153 ceph-mon[35609]: pgmap v125: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 810 MiB/s wr, 2.96k op/s 2024-09-10T08:12:53.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:53 smithi022 ceph-mon[30854]: pgmap v125: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 810 MiB/s wr, 2.96k op/s 2024-09-10T08:12:53.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:53 smithi100 ceph-mon[35102]: pgmap v125: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 810 MiB/s wr, 2.96k op/s 2024-09-10T08:12:55.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:55 smithi153 ceph-mon[35609]: pgmap v126: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 885 MiB/s wr, 3.08k op/s 2024-09-10T08:12:55.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:55 smithi022 ceph-mon[30854]: pgmap v126: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 885 MiB/s wr, 3.08k op/s 2024-09-10T08:12:55.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:55 smithi100 ceph-mon[35102]: pgmap v126: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 885 MiB/s wr, 3.08k op/s 2024-09-10T08:12:57.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:57 smithi022 ceph-mon[30854]: pgmap v127: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 746 MiB/s wr, 2.54k op/s 2024-09-10T08:12:57.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:57 smithi100 ceph-mon[35102]: pgmap v127: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 746 MiB/s wr, 2.54k op/s 2024-09-10T08:12:57.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:57 smithi153 ceph-mon[35609]: pgmap v127: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 746 MiB/s wr, 2.54k op/s 2024-09-10T08:12:58.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:58 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:12:58.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:58 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:12:59.010 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:58 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:12:59.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:59 smithi022 ceph-mon[30854]: pgmap v128: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 760 MiB/s wr, 2.63k op/s 2024-09-10T08:12:59.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:59 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:12:59.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:59 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:12:59.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:12:59 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:12:59.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:59 smithi100 ceph-mon[35102]: pgmap v128: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 760 MiB/s wr, 2.63k op/s 2024-09-10T08:12:59.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:59 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:12:59.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:59 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:12:59.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:12:59 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:12:59.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:59 smithi153 ceph-mon[35609]: pgmap v128: 97 pgs: 97 active+clean; 40 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 760 MiB/s wr, 2.63k op/s 2024-09-10T08:12:59.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:59 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:12:59.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:59 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:12:59.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:12:59 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:13:01.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:01 smithi100 ceph-mon[35102]: pgmap v129: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 870 MiB/s wr, 2.94k op/s 2024-09-10T08:13:01.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:01 smithi153 ceph-mon[35609]: pgmap v129: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 870 MiB/s wr, 2.94k op/s 2024-09-10T08:13:02.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:01 smithi022 ceph-mon[30854]: pgmap v129: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 870 MiB/s wr, 2.94k op/s 2024-09-10T08:13:03.808 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:03 smithi022 ceph-mon[30854]: pgmap v130: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 810 MiB/s wr, 2.56k op/s 2024-09-10T08:13:03.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:03 smithi100 ceph-mon[35102]: pgmap v130: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 810 MiB/s wr, 2.56k op/s 2024-09-10T08:13:03.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:03 smithi153 ceph-mon[35609]: pgmap v130: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 810 MiB/s wr, 2.56k op/s 2024-09-10T08:13:05.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:05 smithi100 ceph-mon[35102]: pgmap v131: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 869 MiB/s wr, 2.59k op/s 2024-09-10T08:13:05.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:05 smithi153 ceph-mon[35609]: pgmap v131: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 869 MiB/s wr, 2.59k op/s 2024-09-10T08:13:06.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:05 smithi022 ceph-mon[30854]: pgmap v131: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 869 MiB/s wr, 2.59k op/s 2024-09-10T08:13:07.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:07 smithi100 ceph-mon[35102]: pgmap v132: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 685 MiB/s wr, 2.16k op/s 2024-09-10T08:13:07.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:07 smithi153 ceph-mon[35609]: pgmap v132: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 685 MiB/s wr, 2.16k op/s 2024-09-10T08:13:08.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:07 smithi022 ceph-mon[30854]: pgmap v132: 97 pgs: 97 active+clean; 40 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 685 MiB/s wr, 2.16k op/s 2024-09-10T08:13:08.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:08 smithi100 ceph-mon[35102]: pgmap v133: 97 pgs: 97 active+clean; 41 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 734 MiB/s wr, 2.38k op/s 2024-09-10T08:13:08.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:08 smithi153 ceph-mon[35609]: pgmap v133: 97 pgs: 97 active+clean; 41 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 734 MiB/s wr, 2.38k op/s 2024-09-10T08:13:09.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:08 smithi022 ceph-mon[30854]: pgmap v133: 97 pgs: 97 active+clean; 41 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 734 MiB/s wr, 2.38k op/s 2024-09-10T08:13:11.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:10 smithi100 ceph-mon[35102]: pgmap v134: 97 pgs: 97 active+clean; 42 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 864 MiB/s wr, 3.58k op/s 2024-09-10T08:13:11.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:10 smithi153 ceph-mon[35609]: pgmap v134: 97 pgs: 97 active+clean; 42 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 864 MiB/s wr, 3.58k op/s 2024-09-10T08:13:11.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:10 smithi022 ceph-mon[30854]: pgmap v134: 97 pgs: 97 active+clean; 42 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 864 MiB/s wr, 3.58k op/s 2024-09-10T08:13:13.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:12 smithi100 ceph-mon[35102]: pgmap v135: 97 pgs: 97 active+clean; 43 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 776 MiB/s wr, 3.85k op/s 2024-09-10T08:13:13.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:12 smithi153 ceph-mon[35609]: pgmap v135: 97 pgs: 97 active+clean; 43 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 776 MiB/s wr, 3.85k op/s 2024-09-10T08:13:13.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:12 smithi022 ceph-mon[30854]: pgmap v135: 97 pgs: 97 active+clean; 43 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 776 MiB/s wr, 3.85k op/s 2024-09-10T08:13:15.120 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:14 smithi100 ceph-mon[35102]: pgmap v136: 97 pgs: 97 active+clean; 44 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 868 MiB/s wr, 5.11k op/s 2024-09-10T08:13:15.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:14 smithi153 ceph-mon[35609]: pgmap v136: 97 pgs: 97 active+clean; 44 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 868 MiB/s wr, 5.11k op/s 2024-09-10T08:13:15.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:14 smithi022 ceph-mon[30854]: pgmap v136: 97 pgs: 97 active+clean; 44 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 868 MiB/s wr, 5.11k op/s 2024-09-10T08:13:17.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:16 smithi100 ceph-mon[35102]: pgmap v137: 97 pgs: 97 active+clean; 44 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 688 MiB/s wr, 4.72k op/s 2024-09-10T08:13:17.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:16 smithi153 ceph-mon[35609]: pgmap v137: 97 pgs: 97 active+clean; 44 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 688 MiB/s wr, 4.72k op/s 2024-09-10T08:13:17.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:16 smithi022 ceph-mon[30854]: pgmap v137: 97 pgs: 97 active+clean; 44 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 688 MiB/s wr, 4.72k op/s 2024-09-10T08:13:19.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:18 smithi100 ceph-mon[35102]: pgmap v138: 97 pgs: 97 active+clean; 44 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 754 MiB/s wr, 5.36k op/s 2024-09-10T08:13:19.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:18 smithi153 ceph-mon[35609]: pgmap v138: 97 pgs: 97 active+clean; 44 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 754 MiB/s wr, 5.36k op/s 2024-09-10T08:13:19.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:18 smithi022 ceph-mon[30854]: pgmap v138: 97 pgs: 97 active+clean; 44 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 754 MiB/s wr, 5.36k op/s 2024-09-10T08:13:21.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:20 smithi100 ceph-mon[35102]: pgmap v139: 97 pgs: 97 active+clean; 45 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 827 MiB/s wr, 5.75k op/s 2024-09-10T08:13:21.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:20 smithi153 ceph-mon[35609]: pgmap v139: 97 pgs: 97 active+clean; 45 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 827 MiB/s wr, 5.75k op/s 2024-09-10T08:13:21.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:20 smithi022 ceph-mon[30854]: pgmap v139: 97 pgs: 97 active+clean; 45 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 827 MiB/s wr, 5.75k op/s 2024-09-10T08:13:23.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:22 smithi100 ceph-mon[35102]: pgmap v140: 97 pgs: 97 active+clean; 45 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 722 MiB/s wr, 4.54k op/s 2024-09-10T08:13:23.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:22 smithi153 ceph-mon[35609]: pgmap v140: 97 pgs: 97 active+clean; 45 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 722 MiB/s wr, 4.54k op/s 2024-09-10T08:13:23.258 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:22 smithi022 ceph-mon[30854]: pgmap v140: 97 pgs: 97 active+clean; 45 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 722 MiB/s wr, 4.54k op/s 2024-09-10T08:13:25.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:24 smithi153 ceph-mon[35609]: pgmap v141: 97 pgs: 97 active+clean; 47 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 865 MiB/s wr, 4.52k op/s 2024-09-10T08:13:25.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:24 smithi022 ceph-mon[30854]: pgmap v141: 97 pgs: 97 active+clean; 47 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 865 MiB/s wr, 4.52k op/s 2024-09-10T08:13:25.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:24 smithi100 ceph-mon[35102]: pgmap v141: 97 pgs: 97 active+clean; 47 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 865 MiB/s wr, 4.52k op/s 2024-09-10T08:13:27.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:26 smithi153 ceph-mon[35609]: pgmap v142: 97 pgs: 97 active+clean; 47 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 663 MiB/s wr, 2.87k op/s 2024-09-10T08:13:27.258 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:26 smithi022 ceph-mon[30854]: pgmap v142: 97 pgs: 97 active+clean; 47 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 663 MiB/s wr, 2.87k op/s 2024-09-10T08:13:27.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:26 smithi100 ceph-mon[35102]: pgmap v142: 97 pgs: 97 active+clean; 47 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 663 MiB/s wr, 2.87k op/s 2024-09-10T08:13:29.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:28 smithi153 ceph-mon[35609]: pgmap v143: 97 pgs: 97 active+clean; 48 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 748 MiB/s wr, 3.05k op/s 2024-09-10T08:13:29.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:28 smithi022 ceph-mon[30854]: pgmap v143: 97 pgs: 97 active+clean; 48 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 748 MiB/s wr, 3.05k op/s 2024-09-10T08:13:29.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:28 smithi100 ceph-mon[35102]: pgmap v143: 97 pgs: 97 active+clean; 48 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 748 MiB/s wr, 3.05k op/s 2024-09-10T08:13:31.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:30 smithi153 ceph-mon[35609]: pgmap v144: 97 pgs: 97 active+clean; 49 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 836 MiB/s wr, 2.84k op/s 2024-09-10T08:13:31.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:30 smithi022 ceph-mon[30854]: pgmap v144: 97 pgs: 97 active+clean; 49 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 836 MiB/s wr, 2.84k op/s 2024-09-10T08:13:31.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:30 smithi100 ceph-mon[35102]: pgmap v144: 97 pgs: 97 active+clean; 49 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 836 MiB/s wr, 2.84k op/s 2024-09-10T08:13:33.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:32 smithi153 ceph-mon[35609]: pgmap v145: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 760 MiB/s wr, 2.15k op/s 2024-09-10T08:13:33.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:32 smithi022 ceph-mon[30854]: pgmap v145: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 760 MiB/s wr, 2.15k op/s 2024-09-10T08:13:33.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:32 smithi100 ceph-mon[35102]: pgmap v145: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 760 MiB/s wr, 2.15k op/s 2024-09-10T08:13:35.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:34 smithi153 ceph-mon[35609]: pgmap v146: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 903 MiB/s wr, 2.41k op/s 2024-09-10T08:13:35.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:34 smithi022 ceph-mon[30854]: pgmap v146: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 903 MiB/s wr, 2.41k op/s 2024-09-10T08:13:35.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:34 smithi100 ceph-mon[35102]: pgmap v146: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 903 MiB/s wr, 2.41k op/s 2024-09-10T08:13:37.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:36 smithi022 ceph-mon[30854]: pgmap v147: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 685 MiB/s wr, 1.63k op/s 2024-09-10T08:13:37.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:36 smithi100 ceph-mon[35102]: pgmap v147: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 685 MiB/s wr, 1.63k op/s 2024-09-10T08:13:37.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:36 smithi153 ceph-mon[35609]: pgmap v147: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 685 MiB/s wr, 1.63k op/s 2024-09-10T08:13:39.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:39 smithi100 ceph-mon[35102]: pgmap v148: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 772 MiB/s wr, 1.86k op/s 2024-09-10T08:13:39.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:39 smithi153 ceph-mon[35609]: pgmap v148: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 772 MiB/s wr, 1.86k op/s 2024-09-10T08:13:39.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:39 smithi022 ceph-mon[30854]: pgmap v148: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 772 MiB/s wr, 1.86k op/s 2024-09-10T08:13:41.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:41 smithi100 ceph-mon[35102]: pgmap v149: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 868 MiB/s wr, 2.03k op/s 2024-09-10T08:13:41.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:41 smithi153 ceph-mon[35609]: pgmap v149: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 868 MiB/s wr, 2.03k op/s 2024-09-10T08:13:41.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:41 smithi022 ceph-mon[30854]: pgmap v149: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 868 MiB/s wr, 2.03k op/s 2024-09-10T08:13:43.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:43 smithi100 ceph-mon[35102]: pgmap v150: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 783 MiB/s wr, 1.81k op/s 2024-09-10T08:13:43.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:43 smithi153 ceph-mon[35609]: pgmap v150: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 783 MiB/s wr, 1.81k op/s 2024-09-10T08:13:43.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:43 smithi022 ceph-mon[30854]: pgmap v150: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 783 MiB/s wr, 1.81k op/s 2024-09-10T08:13:45.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:45 smithi153 ceph-mon[35609]: pgmap v151: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 920 MiB/s wr, 2.24k op/s 2024-09-10T08:13:45.510 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:45 smithi022 ceph-mon[30854]: pgmap v151: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 920 MiB/s wr, 2.24k op/s 2024-09-10T08:13:45.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:45 smithi100 ceph-mon[35102]: pgmap v151: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 920 MiB/s wr, 2.24k op/s 2024-09-10T08:13:47.420 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:47 smithi100 ceph-mon[35102]: pgmap v152: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 708 MiB/s wr, 1.81k op/s 2024-09-10T08:13:47.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:47 smithi153 ceph-mon[35609]: pgmap v152: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 708 MiB/s wr, 1.81k op/s 2024-09-10T08:13:47.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:47 smithi022 ceph-mon[30854]: pgmap v152: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 708 MiB/s wr, 1.81k op/s 2024-09-10T08:13:49.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:49 smithi153 ceph-mon[35609]: pgmap v153: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 791 MiB/s wr, 2.04k op/s 2024-09-10T08:13:49.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:49 smithi022 ceph-mon[30854]: pgmap v153: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 791 MiB/s wr, 2.04k op/s 2024-09-10T08:13:49.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:49 smithi100 ceph-mon[35102]: pgmap v153: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 791 MiB/s wr, 2.04k op/s 2024-09-10T08:13:51.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:51 smithi153 ceph-mon[35609]: pgmap v154: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 873 MiB/s wr, 2.47k op/s 2024-09-10T08:13:51.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:51 smithi022 ceph-mon[30854]: pgmap v154: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 873 MiB/s wr, 2.47k op/s 2024-09-10T08:13:51.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:51 smithi100 ceph-mon[35102]: pgmap v154: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 873 MiB/s wr, 2.47k op/s 2024-09-10T08:13:53.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:53 smithi153 ceph-mon[35609]: pgmap v155: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 736 MiB/s wr, 2.11k op/s 2024-09-10T08:13:53.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:53 smithi022 ceph-mon[30854]: pgmap v155: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 736 MiB/s wr, 2.11k op/s 2024-09-10T08:13:53.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:53 smithi100 ceph-mon[35102]: pgmap v155: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 736 MiB/s wr, 2.11k op/s 2024-09-10T08:13:55.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:55 smithi022 ceph-mon[30854]: pgmap v156: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 909 MiB/s wr, 2.55k op/s 2024-09-10T08:13:55.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:55 smithi100 ceph-mon[35102]: pgmap v156: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 909 MiB/s wr, 2.55k op/s 2024-09-10T08:13:55.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:55 smithi153 ceph-mon[35609]: pgmap v156: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 909 MiB/s wr, 2.55k op/s 2024-09-10T08:13:57.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:57 smithi022 ceph-mon[30854]: pgmap v157: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 688 MiB/s wr, 2.09k op/s 2024-09-10T08:13:57.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:57 smithi100 ceph-mon[35102]: pgmap v157: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 688 MiB/s wr, 2.09k op/s 2024-09-10T08:13:57.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:57 smithi153 ceph-mon[35609]: pgmap v157: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 688 MiB/s wr, 2.09k op/s 2024-09-10T08:13:59.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:13:59 smithi100 ceph-mon[35102]: pgmap v158: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 769 MiB/s wr, 2.28k op/s 2024-09-10T08:13:59.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:13:59 smithi153 ceph-mon[35609]: pgmap v158: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 769 MiB/s wr, 2.28k op/s 2024-09-10T08:13:59.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:13:59 smithi022 ceph-mon[30854]: pgmap v158: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 769 MiB/s wr, 2.28k op/s 2024-09-10T08:14:00.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:00 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:14:00.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:00 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:14:00.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:00 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:14:01.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:01 smithi100 ceph-mon[35102]: pgmap v159: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 868 MiB/s wr, 2.51k op/s 2024-09-10T08:14:01.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:01 smithi153 ceph-mon[35609]: pgmap v159: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 868 MiB/s wr, 2.51k op/s 2024-09-10T08:14:01.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:01 smithi022 ceph-mon[30854]: pgmap v159: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 868 MiB/s wr, 2.51k op/s 2024-09-10T08:14:03.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:03 smithi100 ceph-mon[35102]: pgmap v160: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 736 MiB/s wr, 1.94k op/s 2024-09-10T08:14:03.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:03 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:14:03.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:03 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:14:03.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:03 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:14:03.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:03 smithi153 ceph-mon[35609]: pgmap v160: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 736 MiB/s wr, 1.94k op/s 2024-09-10T08:14:03.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:03 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:14:03.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:03 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:14:03.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:03 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:14:03.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:03 smithi022 ceph-mon[30854]: pgmap v160: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 736 MiB/s wr, 1.94k op/s 2024-09-10T08:14:03.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:03 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:14:03.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:03 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:14:03.761 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:03 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:14:05.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:05 smithi100 ceph-mon[35102]: pgmap v161: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 941 MiB/s wr, 2.42k op/s 2024-09-10T08:14:05.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:05 smithi153 ceph-mon[35609]: pgmap v161: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 941 MiB/s wr, 2.42k op/s 2024-09-10T08:14:05.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:05 smithi022 ceph-mon[30854]: pgmap v161: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 941 MiB/s wr, 2.42k op/s 2024-09-10T08:14:07.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:07 smithi100 ceph-mon[35102]: pgmap v162: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 670 MiB/s wr, 1.69k op/s 2024-09-10T08:14:07.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:07 smithi153 ceph-mon[35609]: pgmap v162: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 670 MiB/s wr, 1.69k op/s 2024-09-10T08:14:07.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:07 smithi022 ceph-mon[30854]: pgmap v162: 97 pgs: 97 active+clean; 50 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 670 MiB/s wr, 1.69k op/s 2024-09-10T08:14:09.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:09 smithi100 ceph-mon[35102]: pgmap v163: 97 pgs: 97 active+clean; 51 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 789 MiB/s wr, 2.07k op/s 2024-09-10T08:14:09.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:09 smithi153 ceph-mon[35609]: pgmap v163: 97 pgs: 97 active+clean; 51 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 789 MiB/s wr, 2.07k op/s 2024-09-10T08:14:09.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:09 smithi022 ceph-mon[30854]: pgmap v163: 97 pgs: 97 active+clean; 51 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 789 MiB/s wr, 2.07k op/s 2024-09-10T08:14:11.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:11 smithi100 ceph-mon[35102]: pgmap v164: 97 pgs: 97 active+clean; 51 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 868 MiB/s wr, 2.82k op/s 2024-09-10T08:14:11.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:11 smithi153 ceph-mon[35609]: pgmap v164: 97 pgs: 97 active+clean; 51 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 868 MiB/s wr, 2.82k op/s 2024-09-10T08:14:11.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:11 smithi022 ceph-mon[30854]: pgmap v164: 97 pgs: 97 active+clean; 51 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 868 MiB/s wr, 2.82k op/s 2024-09-10T08:14:13.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:13 smithi153 ceph-mon[35609]: pgmap v165: 97 pgs: 97 active+clean; 52 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 714 MiB/s wr, 2.71k op/s 2024-09-10T08:14:13.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:13 smithi022 ceph-mon[30854]: pgmap v165: 97 pgs: 97 active+clean; 52 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 714 MiB/s wr, 2.71k op/s 2024-09-10T08:14:13.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:13 smithi100 ceph-mon[35102]: pgmap v165: 97 pgs: 97 active+clean; 52 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 714 MiB/s wr, 2.71k op/s 2024-09-10T08:14:15.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:15 smithi153 ceph-mon[35609]: pgmap v166: 97 pgs: 97 active+clean; 54 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 917 MiB/s wr, 4.12k op/s 2024-09-10T08:14:15.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:15 smithi022 ceph-mon[30854]: pgmap v166: 97 pgs: 97 active+clean; 54 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 917 MiB/s wr, 4.12k op/s 2024-09-10T08:14:15.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:15 smithi100 ceph-mon[35102]: pgmap v166: 97 pgs: 97 active+clean; 54 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 917 MiB/s wr, 4.12k op/s 2024-09-10T08:14:17.670 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:17 smithi100 ceph-mon[35102]: pgmap v167: 97 pgs: 97 active+clean; 54 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 646 MiB/s wr, 3.48k op/s 2024-09-10T08:14:17.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:17 smithi153 ceph-mon[35609]: pgmap v167: 97 pgs: 97 active+clean; 54 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 646 MiB/s wr, 3.48k op/s 2024-09-10T08:14:17.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:17 smithi022 ceph-mon[30854]: pgmap v167: 97 pgs: 97 active+clean; 54 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 646 MiB/s wr, 3.48k op/s 2024-09-10T08:14:19.693 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:19 smithi153 ceph-mon[35609]: pgmap v168: 97 pgs: 97 active+clean; 55 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 766 MiB/s wr, 3.92k op/s 2024-09-10T08:14:19.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:19 smithi022 ceph-mon[30854]: pgmap v168: 97 pgs: 97 active+clean; 55 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 766 MiB/s wr, 3.92k op/s 2024-09-10T08:14:19.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:19 smithi100 ceph-mon[35102]: pgmap v168: 97 pgs: 97 active+clean; 55 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 766 MiB/s wr, 3.92k op/s 2024-09-10T08:14:21.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:21 smithi022 ceph-mon[30854]: pgmap v169: 97 pgs: 97 active+clean; 57 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 795 MiB/s wr, 4.16k op/s 2024-09-10T08:14:21.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:21 smithi100 ceph-mon[35102]: pgmap v169: 97 pgs: 97 active+clean; 57 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 795 MiB/s wr, 4.16k op/s 2024-09-10T08:14:21.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:21 smithi153 ceph-mon[35609]: pgmap v169: 97 pgs: 97 active+clean; 57 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 795 MiB/s wr, 4.16k op/s 2024-09-10T08:14:23.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:23 smithi022 ceph-mon[30854]: pgmap v170: 97 pgs: 97 active+clean; 57 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 631 MiB/s wr, 3.21k op/s 2024-09-10T08:14:23.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:23 smithi100 ceph-mon[35102]: pgmap v170: 97 pgs: 97 active+clean; 57 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 631 MiB/s wr, 3.21k op/s 2024-09-10T08:14:23.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:23 smithi153 ceph-mon[35609]: pgmap v170: 97 pgs: 97 active+clean; 57 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 631 MiB/s wr, 3.21k op/s 2024-09-10T08:14:25.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:25 smithi100 ceph-mon[35102]: pgmap v171: 97 pgs: 97 active+clean; 58 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 878 MiB/s wr, 3.84k op/s 2024-09-10T08:14:25.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:25 smithi153 ceph-mon[35609]: pgmap v171: 97 pgs: 97 active+clean; 58 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 878 MiB/s wr, 3.84k op/s 2024-09-10T08:14:26.012 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:25 smithi022 ceph-mon[30854]: pgmap v171: 97 pgs: 97 active+clean; 58 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 878 MiB/s wr, 3.84k op/s 2024-09-10T08:14:27.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:27 smithi100 ceph-mon[35102]: pgmap v172: 97 pgs: 97 active+clean; 58 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 617 MiB/s wr, 2.25k op/s 2024-09-10T08:14:27.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:27 smithi153 ceph-mon[35609]: pgmap v172: 97 pgs: 97 active+clean; 58 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 617 MiB/s wr, 2.25k op/s 2024-09-10T08:14:28.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:27 smithi022 ceph-mon[30854]: pgmap v172: 97 pgs: 97 active+clean; 58 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 617 MiB/s wr, 2.25k op/s 2024-09-10T08:14:29.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:29 smithi100 ceph-mon[35102]: pgmap v173: 97 pgs: 97 active+clean; 59 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 753 MiB/s wr, 2.57k op/s 2024-09-10T08:14:29.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:29 smithi153 ceph-mon[35609]: pgmap v173: 97 pgs: 97 active+clean; 59 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 753 MiB/s wr, 2.57k op/s 2024-09-10T08:14:30.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:29 smithi022 ceph-mon[30854]: pgmap v173: 97 pgs: 97 active+clean; 59 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 753 MiB/s wr, 2.57k op/s 2024-09-10T08:14:30.868 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:30 smithi100 ceph-mon[35102]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:14:30.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:30 smithi153 ceph-mon[35609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:14:31.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:30 smithi022 ceph-mon[30854]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:14:31.869 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:31 smithi100 ceph-mon[35102]: pgmap v174: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 841 MiB/s wr, 2.65k op/s 2024-09-10T08:14:31.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:31 smithi153 ceph-mon[35609]: pgmap v174: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 841 MiB/s wr, 2.65k op/s 2024-09-10T08:14:32.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:31 smithi022 ceph-mon[30854]: pgmap v174: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 841 MiB/s wr, 2.65k op/s 2024-09-10T08:14:33.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:33 smithi153 ceph-mon[35609]: pgmap v175: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 696 MiB/s wr, 2.04k op/s 2024-09-10T08:14:34.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:33 smithi022 ceph-mon[30854]: pgmap v175: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 696 MiB/s wr, 2.04k op/s 2024-09-10T08:14:34.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:33 smithi100 ceph-mon[35102]: pgmap v175: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 696 MiB/s wr, 2.04k op/s 2024-09-10T08:14:35.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:35 smithi153 ceph-mon[35609]: pgmap v176: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 944 MiB/s wr, 2.68k op/s 2024-09-10T08:14:36.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:35 smithi022 ceph-mon[30854]: pgmap v176: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 944 MiB/s wr, 2.68k op/s 2024-09-10T08:14:36.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:35 smithi100 ceph-mon[35102]: pgmap v176: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 944 MiB/s wr, 2.68k op/s 2024-09-10T08:14:37.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:37 smithi153 ceph-mon[35609]: pgmap v177: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 644 MiB/s wr, 1.63k op/s 2024-09-10T08:14:38.009 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:37 smithi022 ceph-mon[30854]: pgmap v177: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 644 MiB/s wr, 1.63k op/s 2024-09-10T08:14:38.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:37 smithi100 ceph-mon[35102]: pgmap v177: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 644 MiB/s wr, 1.63k op/s 2024-09-10T08:14:40.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:39 smithi022 ceph-mon[30854]: pgmap v178: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 743 MiB/s wr, 1.92k op/s 2024-09-10T08:14:40.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:39 smithi100 ceph-mon[35102]: pgmap v178: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 743 MiB/s wr, 1.92k op/s 2024-09-10T08:14:40.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:39 smithi153 ceph-mon[35609]: pgmap v178: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 743 MiB/s wr, 1.92k op/s 2024-09-10T08:14:42.006 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:41 smithi022 ceph-mon[30854]: pgmap v179: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 838 MiB/s wr, 2.49k op/s 2024-09-10T08:14:42.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:41 smithi100 ceph-mon[35102]: pgmap v179: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 838 MiB/s wr, 2.49k op/s 2024-09-10T08:14:42.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:41 smithi153 ceph-mon[35609]: pgmap v179: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 838 MiB/s wr, 2.49k op/s 2024-09-10T08:14:43.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:42 smithi100 ceph-mon[35102]: pgmap v180: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 655 MiB/s wr, 2.04k op/s 2024-09-10T08:14:43.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:42 smithi153 ceph-mon[35609]: pgmap v180: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 655 MiB/s wr, 2.04k op/s 2024-09-10T08:14:43.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:42 smithi022 ceph-mon[30854]: pgmap v180: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 655 MiB/s wr, 2.04k op/s 2024-09-10T08:14:45.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:44 smithi153 ceph-mon[35609]: pgmap v181: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 934 MiB/s wr, 2.71k op/s 2024-09-10T08:14:45.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:44 smithi022 ceph-mon[30854]: pgmap v181: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 934 MiB/s wr, 2.71k op/s 2024-09-10T08:14:45.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:44 smithi100 ceph-mon[35102]: pgmap v181: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 934 MiB/s wr, 2.71k op/s 2024-09-10T08:14:47.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:46 smithi100 ceph-mon[35102]: pgmap v182: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 661 MiB/s wr, 1.99k op/s 2024-09-10T08:14:47.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:46 smithi153 ceph-mon[35609]: pgmap v182: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 661 MiB/s wr, 1.99k op/s 2024-09-10T08:14:47.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:46 smithi022 ceph-mon[30854]: pgmap v182: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 661 MiB/s wr, 1.99k op/s 2024-09-10T08:14:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:48 smithi153 ceph-mon[35609]: pgmap v183: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 761 MiB/s wr, 2.28k op/s 2024-09-10T08:14:49.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:48 smithi022 ceph-mon[30854]: pgmap v183: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 761 MiB/s wr, 2.28k op/s 2024-09-10T08:14:49.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:48 smithi100 ceph-mon[35102]: pgmap v183: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 761 MiB/s wr, 2.28k op/s 2024-09-10T08:14:51.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:50 smithi153 ceph-mon[35609]: pgmap v184: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 908 MiB/s wr, 2.47k op/s 2024-09-10T08:14:51.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:50 smithi022 ceph-mon[30854]: pgmap v184: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 908 MiB/s wr, 2.47k op/s 2024-09-10T08:14:51.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:50 smithi100 ceph-mon[35102]: pgmap v184: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 908 MiB/s wr, 2.47k op/s 2024-09-10T08:14:53.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:52 smithi153 ceph-mon[35609]: pgmap v185: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 703 MiB/s wr, 1.63k op/s 2024-09-10T08:14:53.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:52 smithi022 ceph-mon[30854]: pgmap v185: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 703 MiB/s wr, 1.63k op/s 2024-09-10T08:14:53.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:52 smithi100 ceph-mon[35102]: pgmap v185: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 703 MiB/s wr, 1.63k op/s 2024-09-10T08:14:55.255 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:54 smithi022 ceph-mon[30854]: pgmap v186: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 995 MiB/s wr, 2.45k op/s 2024-09-10T08:14:55.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:54 smithi100 ceph-mon[35102]: pgmap v186: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 995 MiB/s wr, 2.45k op/s 2024-09-10T08:14:55.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:54 smithi153 ceph-mon[35609]: pgmap v186: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 995 MiB/s wr, 2.45k op/s 2024-09-10T08:14:57.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:56 smithi022 ceph-mon[30854]: pgmap v187: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 689 MiB/s wr, 1.70k op/s 2024-09-10T08:14:57.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:56 smithi100 ceph-mon[35102]: pgmap v187: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 689 MiB/s wr, 1.70k op/s 2024-09-10T08:14:57.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:56 smithi153 ceph-mon[35609]: pgmap v187: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 689 MiB/s wr, 1.70k op/s 2024-09-10T08:14:59.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:14:58 smithi022 ceph-mon[30854]: pgmap v188: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 742 MiB/s wr, 1.97k op/s 2024-09-10T08:14:59.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:14:58 smithi100 ceph-mon[35102]: pgmap v188: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 742 MiB/s wr, 1.97k op/s 2024-09-10T08:14:59.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:14:58 smithi153 ceph-mon[35609]: pgmap v188: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 742 MiB/s wr, 1.97k op/s 2024-09-10T08:15:01.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:01 smithi100 ceph-mon[35102]: pgmap v189: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 878 MiB/s wr, 3.03k op/s 2024-09-10T08:15:01.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:01 smithi153 ceph-mon[35609]: pgmap v189: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 878 MiB/s wr, 3.03k op/s 2024-09-10T08:15:01.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:01 smithi022 ceph-mon[30854]: pgmap v189: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 878 MiB/s wr, 3.03k op/s 2024-09-10T08:15:03.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:03 smithi100 ceph-mon[35102]: pgmap v190: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 656 MiB/s wr, 2.68k op/s 2024-09-10T08:15:03.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:03 smithi153 ceph-mon[35609]: pgmap v190: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 656 MiB/s wr, 2.68k op/s 2024-09-10T08:15:03.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:03 smithi022 ceph-mon[30854]: pgmap v190: 97 pgs: 97 active+clean; 60 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 656 MiB/s wr, 2.68k op/s 2024-09-10T08:15:04.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:04 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:15:04.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:04 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:15:04.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:04 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:15:05.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:05 smithi022 ceph-mon[30854]: pgmap v191: 97 pgs: 97 active+clean; 61 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 929 MiB/s wr, 3.78k op/s 2024-09-10T08:15:05.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:05 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:15:05.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:05 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:15:05.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:05 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:15:05.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:05 smithi100 ceph-mon[35102]: pgmap v191: 97 pgs: 97 active+clean; 61 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 929 MiB/s wr, 3.78k op/s 2024-09-10T08:15:05.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:05 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:15:05.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:05 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:15:05.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:05 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:15:05.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:05 smithi153 ceph-mon[35609]: pgmap v191: 97 pgs: 97 active+clean; 61 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 929 MiB/s wr, 3.78k op/s 2024-09-10T08:15:05.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:05 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:15:05.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:05 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:15:05.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:05 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:15:07.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:07 smithi100 ceph-mon[35102]: pgmap v192: 97 pgs: 97 active+clean; 61 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 613 MiB/s wr, 2.88k op/s 2024-09-10T08:15:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:07 smithi153 ceph-mon[35609]: pgmap v192: 97 pgs: 97 active+clean; 61 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 613 MiB/s wr, 2.88k op/s 2024-09-10T08:15:07.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:07 smithi022 ceph-mon[30854]: pgmap v192: 97 pgs: 97 active+clean; 61 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 613 MiB/s wr, 2.88k op/s 2024-09-10T08:15:09.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:09 smithi100 ceph-mon[35102]: pgmap v193: 97 pgs: 97 active+clean; 61 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 639 MiB/s wr, 3.02k op/s 2024-09-10T08:15:09.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:09 smithi153 ceph-mon[35609]: pgmap v193: 97 pgs: 97 active+clean; 61 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 639 MiB/s wr, 3.02k op/s 2024-09-10T08:15:09.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:09 smithi022 ceph-mon[30854]: pgmap v193: 97 pgs: 97 active+clean; 61 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 639 MiB/s wr, 3.02k op/s 2024-09-10T08:15:11.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:11 smithi100 ceph-mon[35102]: pgmap v194: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 641 MiB/s wr, 2.91k op/s 2024-09-10T08:15:11.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:11 smithi100 ceph-mon[35102]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T08:15:11.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:11 smithi153 ceph-mon[35609]: pgmap v194: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 641 MiB/s wr, 2.91k op/s 2024-09-10T08:15:11.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:11 smithi153 ceph-mon[35609]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T08:15:11.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:11 smithi022 ceph-mon[30854]: pgmap v194: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 641 MiB/s wr, 2.91k op/s 2024-09-10T08:15:11.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:11 smithi022 ceph-mon[30854]: osdmap e85: 12 total, 12 up, 12 in 2024-09-10T08:15:13.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:13 smithi100 ceph-mon[35102]: pgmap v196: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 460 MiB/s wr, 1.71k op/s 2024-09-10T08:15:13.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:13 smithi153 ceph-mon[35609]: pgmap v196: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 460 MiB/s wr, 1.71k op/s 2024-09-10T08:15:13.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:13 smithi022 ceph-mon[30854]: pgmap v196: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 460 MiB/s wr, 1.71k op/s 2024-09-10T08:15:16.006 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:15 smithi022 ceph-mon[30854]: pgmap v197: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 133 MiB/s wr, 363 op/s 2024-09-10T08:15:16.006 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:15 smithi022 ceph-mon[30854]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T08:15:16.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:15 smithi100 ceph-mon[35102]: pgmap v197: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 133 MiB/s wr, 363 op/s 2024-09-10T08:15:16.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:15 smithi100 ceph-mon[35102]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T08:15:16.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:15 smithi153 ceph-mon[35609]: pgmap v197: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 133 MiB/s wr, 363 op/s 2024-09-10T08:15:16.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:15 smithi153 ceph-mon[35609]: osdmap e86: 12 total, 12 up, 12 in 2024-09-10T08:15:18.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:17 smithi022 ceph-mon[30854]: pgmap v199: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 128 MiB/s wr, 247 op/s 2024-09-10T08:15:18.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:17 smithi100 ceph-mon[35102]: pgmap v199: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 128 MiB/s wr, 247 op/s 2024-09-10T08:15:18.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:17 smithi153 ceph-mon[35609]: pgmap v199: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 128 MiB/s wr, 247 op/s 2024-09-10T08:15:20.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:19 smithi022 ceph-mon[30854]: pgmap v200: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 101 MiB/s wr, 378 op/s 2024-09-10T08:15:20.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:19 smithi100 ceph-mon[35102]: pgmap v200: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 101 MiB/s wr, 378 op/s 2024-09-10T08:15:20.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:19 smithi153 ceph-mon[35609]: pgmap v200: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 101 MiB/s wr, 378 op/s 2024-09-10T08:15:22.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:21 smithi022 ceph-mon[30854]: pgmap v201: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 295 MiB/s wr, 1.70k op/s 2024-09-10T08:15:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:21 smithi100 ceph-mon[35102]: pgmap v201: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 295 MiB/s wr, 1.70k op/s 2024-09-10T08:15:22.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:21 smithi153 ceph-mon[35609]: pgmap v201: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 295 MiB/s wr, 1.70k op/s 2024-09-10T08:15:24.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:23 smithi022 ceph-mon[30854]: pgmap v202: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 288 MiB/s wr, 1.67k op/s 2024-09-10T08:15:24.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:23 smithi100 ceph-mon[35102]: pgmap v202: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 288 MiB/s wr, 1.67k op/s 2024-09-10T08:15:24.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:23 smithi153 ceph-mon[35609]: pgmap v202: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 288 MiB/s wr, 1.67k op/s 2024-09-10T08:15:26.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:25 smithi022 ceph-mon[30854]: pgmap v203: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 253 MiB/s wr, 1.66k op/s 2024-09-10T08:15:26.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:25 smithi100 ceph-mon[35102]: pgmap v203: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 253 MiB/s wr, 1.66k op/s 2024-09-10T08:15:26.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:25 smithi153 ceph-mon[35609]: pgmap v203: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 253 MiB/s wr, 1.66k op/s 2024-09-10T08:15:28.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:27 smithi022 ceph-mon[30854]: pgmap v204: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 227 MiB/s wr, 1.49k op/s 2024-09-10T08:15:28.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:27 smithi100 ceph-mon[35102]: pgmap v204: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 227 MiB/s wr, 1.49k op/s 2024-09-10T08:15:28.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:27 smithi153 ceph-mon[35609]: pgmap v204: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 227 MiB/s wr, 1.49k op/s 2024-09-10T08:15:30.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:29 smithi022 ceph-mon[30854]: pgmap v205: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 211 MiB/s wr, 1.38k op/s 2024-09-10T08:15:30.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:29 smithi100 ceph-mon[35102]: pgmap v205: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 211 MiB/s wr, 1.38k op/s 2024-09-10T08:15:30.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:29 smithi153 ceph-mon[35609]: pgmap v205: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 211 MiB/s wr, 1.38k op/s 2024-09-10T08:15:31.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:30 smithi100 ceph-mon[35102]: pgmap v206: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 174 MiB/s wr, 1.15k op/s 2024-09-10T08:15:31.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:30 smithi153 ceph-mon[35609]: pgmap v206: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 174 MiB/s wr, 1.15k op/s 2024-09-10T08:15:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:30 smithi022 ceph-mon[30854]: pgmap v206: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 174 MiB/s wr, 1.15k op/s 2024-09-10T08:15:33.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:32 smithi153 ceph-mon[35609]: pgmap v207: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 KiB/s wr, 9 op/s 2024-09-10T08:15:33.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:32 smithi022 ceph-mon[30854]: pgmap v207: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 KiB/s wr, 9 op/s 2024-09-10T08:15:33.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:32 smithi100 ceph-mon[35102]: pgmap v207: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 19 KiB/s wr, 9 op/s 2024-09-10T08:15:35.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:34 smithi153 ceph-mon[35609]: pgmap v208: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-10T08:15:35.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:34 smithi022 ceph-mon[30854]: pgmap v208: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-10T08:15:35.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:34 smithi100 ceph-mon[35102]: pgmap v208: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 KiB/s wr, 12 op/s 2024-09-10T08:15:37.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:36 smithi153 ceph-mon[35609]: pgmap v209: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-10T08:15:37.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:36 smithi022 ceph-mon[30854]: pgmap v209: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-10T08:15:37.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:36 smithi100 ceph-mon[35102]: pgmap v209: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-10T08:15:39.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:38 smithi153 ceph-mon[35609]: pgmap v210: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-09-10T08:15:39.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:38 smithi022 ceph-mon[30854]: pgmap v210: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-09-10T08:15:39.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:38 smithi100 ceph-mon[35102]: pgmap v210: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.3 KiB/s wr, 9 op/s 2024-09-10T08:15:41.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:40 smithi153 ceph-mon[35609]: pgmap v211: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 KiB/s wr, 12 op/s 2024-09-10T08:15:41.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:40 smithi022 ceph-mon[30854]: pgmap v211: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 KiB/s wr, 12 op/s 2024-09-10T08:15:41.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:40 smithi100 ceph-mon[35102]: pgmap v211: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 KiB/s wr, 12 op/s 2024-09-10T08:15:43.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:42 smithi153 ceph-mon[35609]: pgmap v212: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 KiB/s wr, 9 op/s 2024-09-10T08:15:43.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:42 smithi022 ceph-mon[30854]: pgmap v212: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 KiB/s wr, 9 op/s 2024-09-10T08:15:43.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:42 smithi100 ceph-mon[35102]: pgmap v212: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 KiB/s wr, 9 op/s 2024-09-10T08:15:45.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:44 smithi153 ceph-mon[35609]: pgmap v213: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 KiB/s wr, 12 op/s 2024-09-10T08:15:45.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:44 smithi022 ceph-mon[30854]: pgmap v213: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 KiB/s wr, 12 op/s 2024-09-10T08:15:45.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:44 smithi100 ceph-mon[35102]: pgmap v213: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 KiB/s wr, 12 op/s 2024-09-10T08:15:47.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:46 smithi153 ceph-mon[35609]: pgmap v214: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.1 KiB/s wr, 8 op/s 2024-09-10T08:15:47.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:46 smithi022 ceph-mon[30854]: pgmap v214: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.1 KiB/s wr, 8 op/s 2024-09-10T08:15:47.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:46 smithi100 ceph-mon[35102]: pgmap v214: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.1 KiB/s wr, 8 op/s 2024-09-10T08:15:49.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:48 smithi153 ceph-mon[35609]: pgmap v215: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 9 op/s 2024-09-10T08:15:49.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:48 smithi022 ceph-mon[30854]: pgmap v215: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 9 op/s 2024-09-10T08:15:49.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:48 smithi100 ceph-mon[35102]: pgmap v215: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 9 op/s 2024-09-10T08:15:51.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:50 smithi153 ceph-mon[35609]: pgmap v216: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 KiB/s wr, 12 op/s 2024-09-10T08:15:51.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:50 smithi022 ceph-mon[30854]: pgmap v216: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 KiB/s wr, 12 op/s 2024-09-10T08:15:51.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:50 smithi100 ceph-mon[35102]: pgmap v216: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 KiB/s wr, 12 op/s 2024-09-10T08:15:53.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:52 smithi153 ceph-mon[35609]: pgmap v217: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-10T08:15:53.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:52 smithi022 ceph-mon[30854]: pgmap v217: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-10T08:15:53.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:52 smithi100 ceph-mon[35102]: pgmap v217: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-10T08:15:55.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:54 smithi153 ceph-mon[35609]: pgmap v218: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-10T08:15:55.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:54 smithi022 ceph-mon[30854]: pgmap v218: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-10T08:15:55.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:54 smithi100 ceph-mon[35102]: pgmap v218: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-09-10T08:15:57.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:56 smithi022 ceph-mon[30854]: pgmap v219: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-10T08:15:57.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:56 smithi100 ceph-mon[35102]: pgmap v219: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-10T08:15:57.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:56 smithi153 ceph-mon[35609]: pgmap v219: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-09-10T08:15:59.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:15:58 smithi022 ceph-mon[30854]: pgmap v220: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-10T08:15:59.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:15:58 smithi100 ceph-mon[35102]: pgmap v220: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-10T08:15:59.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:15:58 smithi153 ceph-mon[35609]: pgmap v220: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-10T08:16:01.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:00 smithi022 ceph-mon[30854]: pgmap v221: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-10T08:16:01.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:00 smithi100 ceph-mon[35102]: pgmap v221: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-10T08:16:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:00 smithi153 ceph-mon[35609]: pgmap v221: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-10T08:16:03.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:02 smithi022 ceph-mon[30854]: pgmap v222: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T08:16:03.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:02 smithi100 ceph-mon[35102]: pgmap v222: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T08:16:03.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:02 smithi153 ceph-mon[35609]: pgmap v222: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T08:16:05.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:04 smithi022 ceph-mon[30854]: pgmap v223: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-10T08:16:05.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:04 smithi100 ceph-mon[35102]: pgmap v223: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-10T08:16:05.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:04 smithi153 ceph-mon[35609]: pgmap v223: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-10T08:16:06.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:05 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:16:06.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:05 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:16:06.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:05 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:16:06.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:05 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:16:06.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:05 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:16:06.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:05 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:16:06.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:05 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:16:06.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:05 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:16:06.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:05 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:16:06.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:05 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:16:06.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:05 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:16:06.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:05 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:16:07.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:07 smithi153 ceph-mon[35609]: pgmap v224: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-10T08:16:08.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:07 smithi022 ceph-mon[30854]: pgmap v224: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-10T08:16:08.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:07 smithi100 ceph-mon[35102]: pgmap v224: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-10T08:16:09.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:09 smithi153 ceph-mon[35609]: pgmap v225: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-10T08:16:10.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:09 smithi022 ceph-mon[30854]: pgmap v225: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-10T08:16:10.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:09 smithi100 ceph-mon[35102]: pgmap v225: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-10T08:16:10.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:10 smithi153 ceph-mon[35609]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T08:16:11.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:10 smithi022 ceph-mon[30854]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T08:16:11.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:10 smithi100 ceph-mon[35102]: osdmap e87: 12 total, 12 up, 12 in 2024-09-10T08:16:11.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:11 smithi153 ceph-mon[35609]: pgmap v227: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-10T08:16:12.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:11 smithi022 ceph-mon[30854]: pgmap v227: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-10T08:16:12.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:11 smithi100 ceph-mon[35102]: pgmap v227: 97 pgs: 97 active+clean; 61 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-10T08:16:13.943 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:13 smithi153 ceph-mon[35609]: pgmap v228: 97 pgs: 97 active+clean; 60 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-10T08:16:14.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:13 smithi022 ceph-mon[30854]: pgmap v228: 97 pgs: 97 active+clean; 60 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-10T08:16:14.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:13 smithi100 ceph-mon[35102]: pgmap v228: 97 pgs: 97 active+clean; 60 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-10T08:16:16.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:15 smithi022 ceph-mon[30854]: pgmap v229: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-10T08:16:16.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:15 smithi022 ceph-mon[30854]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T08:16:16.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:15 smithi100 ceph-mon[35102]: pgmap v229: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-10T08:16:16.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:15 smithi100 ceph-mon[35102]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T08:16:16.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:15 smithi153 ceph-mon[35609]: pgmap v229: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-09-10T08:16:16.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:15 smithi153 ceph-mon[35609]: osdmap e88: 12 total, 12 up, 12 in 2024-09-10T08:16:18.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:17 smithi022 ceph-mon[30854]: pgmap v231: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.9 KiB/s wr, 11 op/s 2024-09-10T08:16:18.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:17 smithi100 ceph-mon[35102]: pgmap v231: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.9 KiB/s wr, 11 op/s 2024-09-10T08:16:18.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:17 smithi153 ceph-mon[35609]: pgmap v231: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.9 KiB/s wr, 11 op/s 2024-09-10T08:16:20.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:19 smithi022 ceph-mon[30854]: pgmap v232: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2024-09-10T08:16:20.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:19 smithi100 ceph-mon[35102]: pgmap v232: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2024-09-10T08:16:20.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:19 smithi153 ceph-mon[35609]: pgmap v232: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2024-09-10T08:16:22.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:21 smithi022 ceph-mon[30854]: pgmap v233: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 KiB/s wr, 10 op/s 2024-09-10T08:16:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:21 smithi100 ceph-mon[35102]: pgmap v233: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 KiB/s wr, 10 op/s 2024-09-10T08:16:22.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:21 smithi153 ceph-mon[35609]: pgmap v233: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 KiB/s wr, 10 op/s 2024-09-10T08:16:24.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:23 smithi022 ceph-mon[30854]: pgmap v234: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 KiB/s wr, 10 op/s 2024-09-10T08:16:24.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:23 smithi100 ceph-mon[35102]: pgmap v234: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 KiB/s wr, 10 op/s 2024-09-10T08:16:24.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:23 smithi153 ceph-mon[35609]: pgmap v234: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 KiB/s wr, 10 op/s 2024-09-10T08:16:26.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:25 smithi022 ceph-mon[30854]: pgmap v235: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.7 KiB/s wr, 10 op/s 2024-09-10T08:16:26.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:25 smithi100 ceph-mon[35102]: pgmap v235: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.7 KiB/s wr, 10 op/s 2024-09-10T08:16:26.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:25 smithi153 ceph-mon[35609]: pgmap v235: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.7 KiB/s wr, 10 op/s 2024-09-10T08:16:28.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:27 smithi022 ceph-mon[30854]: pgmap v236: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.3 KiB/s wr, 9 op/s 2024-09-10T08:16:28.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:27 smithi100 ceph-mon[35102]: pgmap v236: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.3 KiB/s wr, 9 op/s 2024-09-10T08:16:28.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:27 smithi153 ceph-mon[35609]: pgmap v236: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.3 KiB/s wr, 9 op/s 2024-09-10T08:16:30.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:29 smithi022 ceph-mon[30854]: pgmap v237: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-09-10T08:16:30.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:29 smithi100 ceph-mon[35102]: pgmap v237: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-09-10T08:16:30.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:29 smithi153 ceph-mon[35609]: pgmap v237: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-09-10T08:16:32.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:31 smithi022 ceph-mon[30854]: pgmap v238: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-09-10T08:16:32.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:31 smithi100 ceph-mon[35102]: pgmap v238: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-09-10T08:16:32.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:31 smithi153 ceph-mon[35609]: pgmap v238: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-09-10T08:16:33.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:32 smithi100 ceph-mon[35102]: pgmap v239: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:16:33.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:32 smithi153 ceph-mon[35609]: pgmap v239: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:16:33.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:32 smithi022 ceph-mon[30854]: pgmap v239: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:16:35.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:34 smithi153 ceph-mon[35609]: pgmap v240: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:16:35.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:34 smithi022 ceph-mon[30854]: pgmap v240: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:16:35.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:34 smithi100 ceph-mon[35102]: pgmap v240: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:16:37.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:36 smithi153 ceph-mon[35609]: pgmap v241: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:16:37.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:36 smithi022 ceph-mon[30854]: pgmap v241: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:16:37.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:36 smithi100 ceph-mon[35102]: pgmap v241: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:16:39.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:38 smithi153 ceph-mon[35609]: pgmap v242: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:16:39.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:38 smithi022 ceph-mon[30854]: pgmap v242: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:16:39.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:38 smithi100 ceph-mon[35102]: pgmap v242: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:16:41.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:40 smithi153 ceph-mon[35609]: pgmap v243: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:16:41.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:40 smithi022 ceph-mon[30854]: pgmap v243: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:16:41.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:40 smithi100 ceph-mon[35102]: pgmap v243: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:16:43.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:42 smithi153 ceph-mon[35609]: pgmap v244: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:16:43.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:42 smithi022 ceph-mon[30854]: pgmap v244: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:16:43.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:42 smithi100 ceph-mon[35102]: pgmap v244: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:16:45.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:44 smithi153 ceph-mon[35609]: pgmap v245: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:16:45.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:44 smithi022 ceph-mon[30854]: pgmap v245: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:16:45.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:44 smithi100 ceph-mon[35102]: pgmap v245: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:16:47.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:46 smithi022 ceph-mon[30854]: pgmap v246: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:16:47.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:46 smithi100 ceph-mon[35102]: pgmap v246: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:16:47.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:46 smithi153 ceph-mon[35609]: pgmap v246: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:16:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:48 smithi022 ceph-mon[30854]: pgmap v247: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:16:49.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:48 smithi100 ceph-mon[35102]: pgmap v247: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:16:49.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:48 smithi153 ceph-mon[35609]: pgmap v247: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:16:51.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:50 smithi022 ceph-mon[30854]: pgmap v248: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:16:51.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:50 smithi100 ceph-mon[35102]: pgmap v248: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:16:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:50 smithi153 ceph-mon[35609]: pgmap v248: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:16:53.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:52 smithi022 ceph-mon[30854]: pgmap v249: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:16:53.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:52 smithi100 ceph-mon[35102]: pgmap v249: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:16:53.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:52 smithi153 ceph-mon[35609]: pgmap v249: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:16:55.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:54 smithi022 ceph-mon[30854]: pgmap v250: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:16:55.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:54 smithi100 ceph-mon[35102]: pgmap v250: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:16:55.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:54 smithi153 ceph-mon[35609]: pgmap v250: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:16:57.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:56 smithi022 ceph-mon[30854]: pgmap v251: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:16:57.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:56 smithi100 ceph-mon[35102]: pgmap v251: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:16:57.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:56 smithi153 ceph-mon[35609]: pgmap v251: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:16:59.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:16:58 smithi022 ceph-mon[30854]: pgmap v252: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:16:59.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:16:58 smithi100 ceph-mon[35102]: pgmap v252: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:16:59.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:16:58 smithi153 ceph-mon[35609]: pgmap v252: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:17:01.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:00 smithi022 ceph-mon[30854]: pgmap v253: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:17:01.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:00 smithi100 ceph-mon[35102]: pgmap v253: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:17:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:00 smithi153 ceph-mon[35609]: pgmap v253: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:17:03.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:02 smithi022 ceph-mon[30854]: pgmap v254: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 KiB/s wr, 23 op/s 2024-09-10T08:17:03.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:02 smithi100 ceph-mon[35102]: pgmap v254: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 KiB/s wr, 23 op/s 2024-09-10T08:17:03.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:02 smithi153 ceph-mon[35609]: pgmap v254: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 KiB/s wr, 23 op/s 2024-09-10T08:17:05.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:04 smithi022 ceph-mon[30854]: pgmap v255: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-10T08:17:05.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:04 smithi100 ceph-mon[35102]: pgmap v255: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-10T08:17:05.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:04 smithi153 ceph-mon[35609]: pgmap v255: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-10T08:17:06.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:05 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:17:06.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:05 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:17:06.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:05 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:17:07.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:06 smithi022 ceph-mon[30854]: pgmap v256: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-10T08:17:07.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:06 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:17:07.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:06 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:17:07.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:06 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:17:07.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:06 smithi100 ceph-mon[35102]: pgmap v256: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-10T08:17:07.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:06 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:17:07.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:06 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:17:07.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:06 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:17:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:06 smithi153 ceph-mon[35609]: pgmap v256: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-10T08:17:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:06 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:17:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:06 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:17:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:06 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:17:09.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:08 smithi022 ceph-mon[30854]: pgmap v257: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-10T08:17:09.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:08 smithi100 ceph-mon[35102]: pgmap v257: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-10T08:17:09.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:08 smithi153 ceph-mon[35609]: pgmap v257: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-10T08:17:11.245 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:10 smithi153 ceph-mon[35609]: pgmap v258: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-10T08:17:11.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:10 smithi153 ceph-mon[35609]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T08:17:11.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:10 smithi022 ceph-mon[30854]: pgmap v258: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-10T08:17:11.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:10 smithi022 ceph-mon[30854]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T08:17:11.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:10 smithi100 ceph-mon[35102]: pgmap v258: 97 pgs: 97 active+clean; 51 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-10T08:17:11.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:10 smithi100 ceph-mon[35102]: osdmap e89: 12 total, 12 up, 12 in 2024-09-10T08:17:13.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:12 smithi022 ceph-mon[30854]: pgmap v260: 97 pgs: 97 active+clean; 50 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-10T08:17:13.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:12 smithi100 ceph-mon[35102]: pgmap v260: 97 pgs: 97 active+clean; 50 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-10T08:17:13.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:12 smithi153 ceph-mon[35609]: pgmap v260: 97 pgs: 97 active+clean; 50 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-10T08:17:16.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:15 smithi022 ceph-mon[30854]: pgmap v261: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:17:16.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:15 smithi022 ceph-mon[30854]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T08:17:16.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:15 smithi100 ceph-mon[35102]: pgmap v261: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:17:16.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:15 smithi100 ceph-mon[35102]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T08:17:16.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:15 smithi153 ceph-mon[35609]: pgmap v261: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:17:16.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:15 smithi153 ceph-mon[35609]: osdmap e90: 12 total, 12 up, 12 in 2024-09-10T08:17:18.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:17 smithi022 ceph-mon[30854]: pgmap v263: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T08:17:18.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:17 smithi100 ceph-mon[35102]: pgmap v263: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T08:17:18.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:17 smithi153 ceph-mon[35609]: pgmap v263: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T08:17:20.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:19 smithi022 ceph-mon[30854]: pgmap v264: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 127 B/s wr, 7 op/s 2024-09-10T08:17:20.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:19 smithi100 ceph-mon[35102]: pgmap v264: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 127 B/s wr, 7 op/s 2024-09-10T08:17:20.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:19 smithi153 ceph-mon[35609]: pgmap v264: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 127 B/s wr, 7 op/s 2024-09-10T08:17:22.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:21 smithi022 ceph-mon[30854]: pgmap v265: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 206 B/s wr, 10 op/s 2024-09-10T08:17:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:21 smithi100 ceph-mon[35102]: pgmap v265: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 206 B/s wr, 10 op/s 2024-09-10T08:17:22.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:21 smithi153 ceph-mon[35609]: pgmap v265: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 206 B/s wr, 10 op/s 2024-09-10T08:17:24.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:23 smithi022 ceph-mon[30854]: pgmap v266: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:17:24.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:23 smithi100 ceph-mon[35102]: pgmap v266: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:17:24.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:23 smithi153 ceph-mon[35609]: pgmap v266: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:17:26.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:25 smithi022 ceph-mon[30854]: pgmap v267: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:17:26.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:25 smithi100 ceph-mon[35102]: pgmap v267: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:17:26.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:25 smithi153 ceph-mon[35609]: pgmap v267: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:17:28.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:27 smithi100 ceph-mon[35102]: pgmap v268: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 91 B/s wr, 9 op/s 2024-09-10T08:17:28.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:27 smithi153 ceph-mon[35609]: pgmap v268: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 91 B/s wr, 9 op/s 2024-09-10T08:17:28.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:27 smithi022 ceph-mon[30854]: pgmap v268: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 91 B/s wr, 9 op/s 2024-09-10T08:17:30.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:29 smithi100 ceph-mon[35102]: pgmap v269: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T08:17:30.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:29 smithi153 ceph-mon[35609]: pgmap v269: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T08:17:30.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:29 smithi022 ceph-mon[30854]: pgmap v269: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T08:17:31.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:30 smithi100 ceph-mon[35102]: pgmap v270: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-10T08:17:31.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:30 smithi153 ceph-mon[35609]: pgmap v270: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-10T08:17:31.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:30 smithi022 ceph-mon[30854]: pgmap v270: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-10T08:17:33.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:32 smithi022 ceph-mon[30854]: pgmap v271: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:17:33.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:32 smithi100 ceph-mon[35102]: pgmap v271: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:17:33.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:32 smithi153 ceph-mon[35609]: pgmap v271: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:17:35.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:34 smithi022 ceph-mon[30854]: pgmap v272: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:17:35.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:34 smithi100 ceph-mon[35102]: pgmap v272: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:17:35.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:34 smithi153 ceph-mon[35609]: pgmap v272: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:17:37.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:36 smithi022 ceph-mon[30854]: pgmap v273: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:17:37.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:36 smithi100 ceph-mon[35102]: pgmap v273: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:17:37.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:36 smithi153 ceph-mon[35609]: pgmap v273: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:17:39.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:38 smithi022 ceph-mon[30854]: pgmap v274: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:17:39.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:38 smithi100 ceph-mon[35102]: pgmap v274: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:17:39.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:38 smithi153 ceph-mon[35609]: pgmap v274: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:17:41.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:40 smithi153 ceph-mon[35609]: pgmap v275: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:17:41.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:40 smithi022 ceph-mon[30854]: pgmap v275: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:17:41.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:40 smithi100 ceph-mon[35102]: pgmap v275: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:17:43.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:42 smithi022 ceph-mon[30854]: pgmap v276: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:17:43.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:42 smithi100 ceph-mon[35102]: pgmap v276: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:17:43.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:42 smithi153 ceph-mon[35609]: pgmap v276: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:17:45.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:44 smithi022 ceph-mon[30854]: pgmap v277: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:17:45.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:44 smithi100 ceph-mon[35102]: pgmap v277: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:17:45.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:44 smithi153 ceph-mon[35609]: pgmap v277: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:17:47.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:46 smithi022 ceph-mon[30854]: pgmap v278: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:17:47.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:46 smithi100 ceph-mon[35102]: pgmap v278: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:17:47.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:46 smithi153 ceph-mon[35609]: pgmap v278: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:17:49.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:48 smithi022 ceph-mon[30854]: pgmap v279: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:17:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:48 smithi100 ceph-mon[35102]: pgmap v279: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:17:49.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:48 smithi153 ceph-mon[35609]: pgmap v279: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:17:51.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:50 smithi022 ceph-mon[30854]: pgmap v280: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:17:51.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:50 smithi100 ceph-mon[35102]: pgmap v280: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:17:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:50 smithi153 ceph-mon[35609]: pgmap v280: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:17:53.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:52 smithi022 ceph-mon[30854]: pgmap v281: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:17:53.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:52 smithi100 ceph-mon[35102]: pgmap v281: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:17:53.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:52 smithi153 ceph-mon[35609]: pgmap v281: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:17:55.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:54 smithi022 ceph-mon[30854]: pgmap v282: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-10T08:17:55.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:54 smithi100 ceph-mon[35102]: pgmap v282: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-10T08:17:55.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:54 smithi153 ceph-mon[35609]: pgmap v282: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-10T08:17:57.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:56 smithi022 ceph-mon[30854]: pgmap v283: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:17:57.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:56 smithi100 ceph-mon[35102]: pgmap v283: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:17:57.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:56 smithi153 ceph-mon[35609]: pgmap v283: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:17:59.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:17:58 smithi022 ceph-mon[30854]: pgmap v284: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:17:59.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:17:58 smithi100 ceph-mon[35102]: pgmap v284: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:17:59.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:17:58 smithi153 ceph-mon[35609]: pgmap v284: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:18:01.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:00 smithi022 ceph-mon[30854]: pgmap v285: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:18:01.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:00 smithi100 ceph-mon[35102]: pgmap v285: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:18:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:00 smithi153 ceph-mon[35609]: pgmap v285: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:18:03.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:02 smithi022 ceph-mon[30854]: pgmap v286: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 KiB/s wr, 23 op/s 2024-09-10T08:18:03.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:02 smithi100 ceph-mon[35102]: pgmap v286: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 KiB/s wr, 23 op/s 2024-09-10T08:18:03.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:02 smithi153 ceph-mon[35609]: pgmap v286: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 KiB/s wr, 23 op/s 2024-09-10T08:18:05.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:04 smithi022 ceph-mon[30854]: pgmap v287: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-10T08:18:05.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:04 smithi100 ceph-mon[35102]: pgmap v287: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-10T08:18:05.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:04 smithi153 ceph-mon[35609]: pgmap v287: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-10T08:18:07.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:06 smithi022 ceph-mon[30854]: pgmap v288: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-10T08:18:07.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:06 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:18:07.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:06 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:18:07.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:06 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:18:07.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:06 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:18:07.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:06 smithi100 ceph-mon[35102]: pgmap v288: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-10T08:18:07.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:06 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:18:07.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:06 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:18:07.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:06 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:18:07.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:06 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:18:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:06 smithi153 ceph-mon[35609]: pgmap v288: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-10T08:18:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:06 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:18:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:06 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:18:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:06 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:18:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:06 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:18:09.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:08 smithi022 ceph-mon[30854]: pgmap v289: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-10T08:18:09.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:08 smithi100 ceph-mon[35102]: pgmap v289: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-10T08:18:09.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:08 smithi153 ceph-mon[35609]: pgmap v289: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-10T08:18:11.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:11 smithi100 ceph-mon[35102]: pgmap v290: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-10T08:18:11.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:11 smithi100 ceph-mon[35102]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T08:18:11.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:11 smithi153 ceph-mon[35609]: pgmap v290: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-10T08:18:11.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:11 smithi153 ceph-mon[35609]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T08:18:11.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:11 smithi022 ceph-mon[30854]: pgmap v290: 97 pgs: 97 active+clean; 41 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-10T08:18:11.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:11 smithi022 ceph-mon[30854]: osdmap e91: 12 total, 12 up, 12 in 2024-09-10T08:18:13.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:13 smithi100 ceph-mon[35102]: pgmap v292: 97 pgs: 97 active+clean; 40 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-10T08:18:13.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:13 smithi153 ceph-mon[35609]: pgmap v292: 97 pgs: 97 active+clean; 40 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-10T08:18:13.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:13 smithi022 ceph-mon[30854]: pgmap v292: 97 pgs: 97 active+clean; 40 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-10T08:18:16.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:15 smithi100 ceph-mon[35102]: pgmap v293: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:18:16.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:15 smithi100 ceph-mon[35102]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T08:18:16.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:15 smithi153 ceph-mon[35609]: pgmap v293: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:18:16.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:15 smithi153 ceph-mon[35609]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T08:18:16.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:15 smithi022 ceph-mon[30854]: pgmap v293: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:18:16.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:15 smithi022 ceph-mon[30854]: osdmap e92: 12 total, 12 up, 12 in 2024-09-10T08:18:18.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:17 smithi100 ceph-mon[35102]: pgmap v295: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T08:18:18.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:17 smithi153 ceph-mon[35609]: pgmap v295: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T08:18:18.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:17 smithi022 ceph-mon[30854]: pgmap v295: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 11 op/s 2024-09-10T08:18:20.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:19 smithi100 ceph-mon[35102]: pgmap v296: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 127 B/s wr, 7 op/s 2024-09-10T08:18:20.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:19 smithi153 ceph-mon[35609]: pgmap v296: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 127 B/s wr, 7 op/s 2024-09-10T08:18:20.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:19 smithi022 ceph-mon[30854]: pgmap v296: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 127 B/s wr, 7 op/s 2024-09-10T08:18:22.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:21 smithi100 ceph-mon[35102]: pgmap v297: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2024-09-10T08:18:22.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:21 smithi153 ceph-mon[35609]: pgmap v297: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2024-09-10T08:18:22.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:21 smithi022 ceph-mon[30854]: pgmap v297: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 206 B/s wr, 10 op/s 2024-09-10T08:18:24.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:23 smithi100 ceph-mon[35102]: pgmap v298: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:18:24.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:23 smithi153 ceph-mon[35609]: pgmap v298: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:18:24.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:23 smithi022 ceph-mon[30854]: pgmap v298: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:18:25.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:24 smithi100 ceph-mon[35102]: pgmap v299: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:18:25.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:24 smithi153 ceph-mon[35609]: pgmap v299: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:18:25.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:24 smithi022 ceph-mon[30854]: pgmap v299: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:18:27.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:26 smithi022 ceph-mon[30854]: pgmap v300: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 91 B/s wr, 9 op/s 2024-09-10T08:18:27.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:26 smithi100 ceph-mon[35102]: pgmap v300: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 91 B/s wr, 9 op/s 2024-09-10T08:18:27.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:26 smithi153 ceph-mon[35609]: pgmap v300: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 91 B/s wr, 9 op/s 2024-09-10T08:18:29.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:28 smithi022 ceph-mon[30854]: pgmap v301: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T08:18:29.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:28 smithi100 ceph-mon[35102]: pgmap v301: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T08:18:29.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:28 smithi153 ceph-mon[35609]: pgmap v301: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-10T08:18:31.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:30 smithi022 ceph-mon[30854]: pgmap v302: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-10T08:18:31.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:30 smithi100 ceph-mon[35102]: pgmap v302: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-10T08:18:31.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:30 smithi153 ceph-mon[35609]: pgmap v302: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 85 B/s wr, 11 op/s 2024-09-10T08:18:33.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:32 smithi022 ceph-mon[30854]: pgmap v303: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:18:33.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:32 smithi100 ceph-mon[35102]: pgmap v303: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:18:33.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:32 smithi153 ceph-mon[35609]: pgmap v303: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:18:35.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:34 smithi022 ceph-mon[30854]: pgmap v304: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:18:35.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:34 smithi100 ceph-mon[35102]: pgmap v304: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:18:35.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:34 smithi153 ceph-mon[35609]: pgmap v304: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:18:37.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:36 smithi022 ceph-mon[30854]: pgmap v305: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:18:37.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:36 smithi100 ceph-mon[35102]: pgmap v305: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:18:37.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:36 smithi153 ceph-mon[35609]: pgmap v305: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:18:39.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:38 smithi022 ceph-mon[30854]: pgmap v306: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:18:39.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:38 smithi100 ceph-mon[35102]: pgmap v306: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:18:39.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:38 smithi153 ceph-mon[35609]: pgmap v306: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:18:41.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:40 smithi153 ceph-mon[35609]: pgmap v307: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:18:41.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:40 smithi022 ceph-mon[30854]: pgmap v307: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:18:41.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:40 smithi100 ceph-mon[35102]: pgmap v307: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:18:43.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:42 smithi022 ceph-mon[30854]: pgmap v308: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:18:43.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:42 smithi100 ceph-mon[35102]: pgmap v308: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:18:43.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:42 smithi153 ceph-mon[35609]: pgmap v308: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:18:45.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:44 smithi022 ceph-mon[30854]: pgmap v309: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-10T08:18:45.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:44 smithi100 ceph-mon[35102]: pgmap v309: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-10T08:18:45.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:44 smithi153 ceph-mon[35609]: pgmap v309: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-10T08:18:47.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:46 smithi022 ceph-mon[30854]: pgmap v310: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:18:47.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:46 smithi100 ceph-mon[35102]: pgmap v310: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:18:47.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:46 smithi153 ceph-mon[35609]: pgmap v310: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:18:49.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:48 smithi022 ceph-mon[30854]: pgmap v311: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:18:49.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:48 smithi100 ceph-mon[35102]: pgmap v311: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:18:49.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:48 smithi153 ceph-mon[35609]: pgmap v311: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:18:51.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:51 smithi022 ceph-mon[30854]: pgmap v312: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:18:51.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:51 smithi100 ceph-mon[35102]: pgmap v312: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:18:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:51 smithi153 ceph-mon[35609]: pgmap v312: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:18:53.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:53 smithi022 ceph-mon[30854]: pgmap v313: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:18:53.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:53 smithi100 ceph-mon[35102]: pgmap v313: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:18:53.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:53 smithi153 ceph-mon[35609]: pgmap v313: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:18:55.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:55 smithi100 ceph-mon[35102]: pgmap v314: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-10T08:18:55.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:55 smithi153 ceph-mon[35609]: pgmap v314: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-10T08:18:55.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:55 smithi022 ceph-mon[30854]: pgmap v314: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-10T08:18:57.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:57 smithi100 ceph-mon[35102]: pgmap v315: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:18:57.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:57 smithi153 ceph-mon[35609]: pgmap v315: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:18:57.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:57 smithi022 ceph-mon[30854]: pgmap v315: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:18:59.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:18:59 smithi100 ceph-mon[35102]: pgmap v316: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:18:59.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:18:59 smithi153 ceph-mon[35609]: pgmap v316: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:18:59.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:18:59 smithi022 ceph-mon[30854]: pgmap v316: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:19:01.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:01 smithi100 ceph-mon[35102]: pgmap v317: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-10T08:19:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:01 smithi153 ceph-mon[35609]: pgmap v317: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-10T08:19:01.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:01 smithi022 ceph-mon[30854]: pgmap v317: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-10T08:19:03.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:03 smithi100 ceph-mon[35102]: pgmap v318: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T08:19:03.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:03 smithi153 ceph-mon[35609]: pgmap v318: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T08:19:03.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:03 smithi022 ceph-mon[30854]: pgmap v318: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-10T08:19:05.306 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:05 smithi022 ceph-mon[30854]: pgmap v319: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-10T08:19:05.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:05 smithi100 ceph-mon[35102]: pgmap v319: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-10T08:19:05.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:05 smithi153 ceph-mon[35609]: pgmap v319: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 45 KiB/s wr, 29 op/s 2024-09-10T08:19:07.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:07 smithi100 ceph-mon[35102]: pgmap v320: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-10T08:19:07.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:07 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:19:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:07 smithi153 ceph-mon[35609]: pgmap v320: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-10T08:19:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:07 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:19:07.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:07 smithi022 ceph-mon[30854]: pgmap v320: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-09-10T08:19:07.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:07 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:19:09.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: pgmap v321: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-10T08:19:09.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi153 to 176.0M 2024-09-10T08:19:09.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: Unable to set osd_memory_target on smithi153 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-10T08:19:09.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.620 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.621 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.621 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.621 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.621 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:19:09.621 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:19:09.621 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:09 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: pgmap v321: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi153 to 176.0M 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: Unable to set osd_memory_target on smithi153 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:19:09.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:19:09.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:09 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: pgmap v321: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-10T08:19:09.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi153 to 176.0M 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: Unable to set osd_memory_target on smithi153 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.755 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-10T08:19:09.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:19:09.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:19:09.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:09 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:19:11.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:10 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-10T08:19:11.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:10 smithi100 ceph-mon[35102]: Unable to set osd_memory_target on smithi100 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-10T08:19:11.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:10 smithi100 ceph-mon[35102]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-10T08:19:11.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:10 smithi100 ceph-mon[35102]: Unable to set osd_memory_target on smithi022 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-10T08:19:11.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:10 smithi100 ceph-mon[35102]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T08:19:11.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:10 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-10T08:19:11.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:10 smithi153 ceph-mon[35609]: Unable to set osd_memory_target on smithi100 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-10T08:19:11.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:10 smithi153 ceph-mon[35609]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-10T08:19:11.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:10 smithi153 ceph-mon[35609]: Unable to set osd_memory_target on smithi022 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-10T08:19:11.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:10 smithi153 ceph-mon[35609]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T08:19:11.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:10 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-10T08:19:11.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:10 smithi022 ceph-mon[30854]: Unable to set osd_memory_target on smithi100 to 184531558: error parsing value: Value '184531558' is below minimum 939524096 2024-09-10T08:19:11.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:10 smithi022 ceph-mon[30854]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-10T08:19:11.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:10 smithi022 ceph-mon[30854]: Unable to set osd_memory_target on smithi022 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-10T08:19:11.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:10 smithi022 ceph-mon[30854]: osdmap e93: 12 total, 12 up, 12 in 2024-09-10T08:19:12.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:11 smithi100 ceph-mon[35102]: pgmap v323: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-10T08:19:12.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:11 smithi153 ceph-mon[35609]: pgmap v323: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-10T08:19:12.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:11 smithi022 ceph-mon[30854]: pgmap v323: 97 pgs: 97 active+clean; 31 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-09-10T08:19:14.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:13 smithi100 ceph-mon[35102]: pgmap v324: 97 pgs: 97 active+clean; 30 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-10T08:19:14.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:13 smithi153 ceph-mon[35609]: pgmap v324: 97 pgs: 97 active+clean; 30 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-10T08:19:14.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:13 smithi022 ceph-mon[30854]: pgmap v324: 97 pgs: 97 active+clean; 30 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-10T08:19:16.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:15 smithi100 ceph-mon[35102]: pgmap v325: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:16.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:15 smithi153 ceph-mon[35609]: pgmap v325: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:16.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:15 smithi022 ceph-mon[30854]: pgmap v325: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:17.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:16 smithi100 ceph-mon[35102]: pgmap v326: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:17.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:16 smithi153 ceph-mon[35609]: pgmap v326: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:17.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:16 smithi022 ceph-mon[30854]: pgmap v326: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:19.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:18 smithi022 ceph-mon[30854]: pgmap v327: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:19.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:18 smithi100 ceph-mon[35102]: pgmap v327: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:19.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:18 smithi153 ceph-mon[35609]: pgmap v327: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:20 smithi100 ceph-mon[35102]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T08:19:21.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:20 smithi153 ceph-mon[35609]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T08:19:21.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:20 smithi022 ceph-mon[30854]: osdmap e94: 12 total, 12 up, 12 in 2024-09-10T08:19:22.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:21 smithi100 ceph-mon[35102]: pgmap v329: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:22.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:21 smithi153 ceph-mon[35609]: pgmap v329: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:22.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:21 smithi022 ceph-mon[30854]: pgmap v329: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:23.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:22 smithi100 ceph-mon[35102]: pgmap v330: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:23.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:22 smithi153 ceph-mon[35609]: pgmap v330: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:22 smithi022 ceph-mon[30854]: pgmap v330: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 204 B/s wr, 10 op/s 2024-09-10T08:19:25.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:24 smithi022 ceph-mon[30854]: pgmap v331: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:19:25.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:24 smithi100 ceph-mon[35102]: pgmap v331: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:19:25.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:24 smithi153 ceph-mon[35609]: pgmap v331: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:19:27.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:26 smithi022 ceph-mon[30854]: pgmap v332: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:19:27.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:26 smithi100 ceph-mon[35102]: pgmap v332: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:19:27.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:26 smithi153 ceph-mon[35609]: pgmap v332: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:19:29.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:28 smithi022 ceph-mon[30854]: pgmap v333: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:19:29.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:28 smithi100 ceph-mon[35102]: pgmap v333: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:19:29.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:28 smithi153 ceph-mon[35609]: pgmap v333: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 10 op/s 2024-09-10T08:19:32.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:31 smithi100 ceph-mon[35102]: pgmap v334: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-10T08:19:32.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:31 smithi153 ceph-mon[35609]: pgmap v334: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-10T08:19:32.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:31 smithi022 ceph-mon[30854]: pgmap v334: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-10T08:19:33.118 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:32 smithi100 ceph-mon[35102]: pgmap v335: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:19:33.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:32 smithi153 ceph-mon[35609]: pgmap v335: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:19:33.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:32 smithi022 ceph-mon[30854]: pgmap v335: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:19:35.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:34 smithi022 ceph-mon[30854]: pgmap v336: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:19:35.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:34 smithi100 ceph-mon[35102]: pgmap v336: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:19:35.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:34 smithi153 ceph-mon[35609]: pgmap v336: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:19:37.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:36 smithi022 ceph-mon[30854]: pgmap v337: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:19:37.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:36 smithi100 ceph-mon[35102]: pgmap v337: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:19:37.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:36 smithi153 ceph-mon[35609]: pgmap v337: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:19:39.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:38 smithi022 ceph-mon[30854]: pgmap v338: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:19:39.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:38 smithi100 ceph-mon[35102]: pgmap v338: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:19:39.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:38 smithi153 ceph-mon[35609]: pgmap v338: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:19:41.246 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:40 smithi153 ceph-mon[35609]: pgmap v339: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:19:41.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:40 smithi022 ceph-mon[30854]: pgmap v339: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:19:41.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:40 smithi100 ceph-mon[35102]: pgmap v339: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:19:43.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:42 smithi022 ceph-mon[30854]: pgmap v340: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:19:43.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:42 smithi100 ceph-mon[35102]: pgmap v340: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:19:43.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:42 smithi153 ceph-mon[35609]: pgmap v340: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:19:45.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:44 smithi022 ceph-mon[30854]: pgmap v341: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:19:45.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:44 smithi100 ceph-mon[35102]: pgmap v341: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:19:45.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:44 smithi153 ceph-mon[35609]: pgmap v341: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:19:47.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:46 smithi022 ceph-mon[30854]: pgmap v342: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:19:47.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:46 smithi100 ceph-mon[35102]: pgmap v342: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:19:47.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:46 smithi153 ceph-mon[35609]: pgmap v342: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:19:49.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:48 smithi022 ceph-mon[30854]: pgmap v343: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:19:49.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:48 smithi100 ceph-mon[35102]: pgmap v343: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:19:49.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:48 smithi153 ceph-mon[35609]: pgmap v343: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-10T08:19:51.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:51 smithi022 ceph-mon[30854]: pgmap v344: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:19:51.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:51 smithi100 ceph-mon[35102]: pgmap v344: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:19:51.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:51 smithi153 ceph-mon[35609]: pgmap v344: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-10T08:19:53.234 INFO:tasks.workunit.client.0.smithi022.stdout:stopping iogen 2024-09-10T08:19:53.235 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo 'stopping iogen' 2024-09-10T08:19:53.235 INFO:tasks.workunit.client.0.smithi022.stderr:+ ./iogen -k 2024-09-10T08:19:53.236 INFO:tasks.workunit.client.0.smithi022.stdout:OK 2024-09-10T08:19:53.236 INFO:tasks.workunit.client.0.smithi022.stderr:+ echo OK 2024-09-10T08:19:53.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:53 smithi100 ceph-mon[35102]: pgmap v345: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:19:53.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:53 smithi153 ceph-mon[35609]: pgmap v345: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:19:53.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:53 smithi022 ceph-mon[30854]: pgmap v345: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:19:55.256 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T08:19:55.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T08:19:55.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:55 smithi100 ceph-mon[35102]: pgmap v346: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:19:55.369 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:55 smithi022 ceph-mon[30854]: pgmap v346: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:19:55.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:55 smithi153 ceph-mon[35609]: pgmap v346: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-10T08:19:56.035 INFO:tasks.workunit:Stopping ['suites/iogen.sh'] on client.0... 2024-09-10T08:19:56.036 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T08:19:56.386 DEBUG:teuthology.parallel:result is None 2024-09-10T08:19:56.387 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T08:19:56.422 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T08:19:56.422 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-10T08:19:56.434 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-10T08:19:56.434 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T08:19:56.434 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-10T08:19:56.434 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-10T08:19:56.506 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-10T08:19:56.573 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-10T08:19:56.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.803+0000 7f54b850a640 1 -- 172.21.15.22:0/1188126506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54b0102d00 msgr2=0x7f54b01030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:56.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.803+0000 7f54b850a640 1 --2- 172.21.15.22:0/1188126506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54b0102d00 0x7f54b01030e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009900 tx=0x7f54ac02a480 comp rx=0 tx=0).stop 2024-09-10T08:19:56.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.803+0000 7f54b850a640 1 -- 172.21.15.22:0/1188126506 shutdown_connections 2024-09-10T08:19:56.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.803+0000 7f54b850a640 1 --2- 172.21.15.22:0/1188126506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54b010c0d0 0x7f54b010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:56.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.803+0000 7f54b850a640 1 --2- 172.21.15.22:0/1188126506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b0103620 0x7f54b010bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:56.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.803+0000 7f54b850a640 1 --2- 172.21.15.22:0/1188126506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54b0102d00 0x7f54b01030e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.803+0000 7f54b850a640 1 -- 172.21.15.22:0/1188126506 >> 172.21.15.22:0/1188126506 conn(0x7f54b00fc6f0 msgr2=0x7f54b00feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.803+0000 7f54b850a640 1 -- 172.21.15.22:0/1188126506 shutdown_connections 2024-09-10T08:19:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.803+0000 7f54b850a640 1 -- 172.21.15.22:0/1188126506 wait complete. 2024-09-10T08:19:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b850a640 1 Processor -- start 2024-09-10T08:19:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b850a640 1 -- start start 2024-09-10T08:19:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b850a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b0102d00 0x7f54b0100950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b850a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54b0103620 0x7f54b0100e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b850a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54b010c0d0 0x7f54b01013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b850a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f54b0111ed0 con 0x7f54b010c0d0 2024-09-10T08:19:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b850a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f54b0111d50 con 0x7f54b0103620 2024-09-10T08:19:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b850a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54b0112050 con 0x7f54b0102d00 2024-09-10T08:19:56.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b6aa7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54b010c0d0 0x7f54b01013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b5aa5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54b0103620 0x7f54b0100e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b6aa7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54b010c0d0 0x7f54b01013d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37262/0 (socket says 172.21.15.22:37262) 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b6aa7640 1 -- 172.21.15.22:0/3428591794 learned_addr learned my addr 172.21.15.22:0/3428591794 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.804+0000 7f54b62a6640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b0102d00 0x7f54b0100950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.805+0000 7f54b6aa7640 1 -- 172.21.15.22:0/3428591794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b0102d00 msgr2=0x7f54b0100950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.805+0000 7f54b6aa7640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b0102d00 0x7f54b0100950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.805+0000 7f54b6aa7640 1 -- 172.21.15.22:0/3428591794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54b0103620 msgr2=0x7f54b0100e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.805+0000 7f54b6aa7640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54b0103620 0x7f54b0100e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.805+0000 7f54b6aa7640 1 -- 172.21.15.22:0/3428591794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b01a67e0 con 0x7f54b010c0d0 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.805+0000 7f54b6aa7640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54b010c0d0 0x7f54b01013d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f54a800cce0 tx=0x7f54a800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.805+0000 7f54a77fe640 1 -- 172.21.15.22:0/3428591794 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a800f450 con 0x7f54b010c0d0 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.805+0000 7f54a77fe640 1 -- 172.21.15.22:0/3428591794 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54a800fad0 con 0x7f54b010c0d0 2024-09-10T08:19:56.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.805+0000 7f54b850a640 1 -- 172.21.15.22:0/3428591794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b01a6ad0 con 0x7f54b010c0d0 2024-09-10T08:19:56.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.805+0000 7f54a77fe640 1 -- 172.21.15.22:0/3428591794 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a8018c10 con 0x7f54b010c0d0 2024-09-10T08:19:56.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.805+0000 7f54b850a640 1 -- 172.21.15.22:0/3428591794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b01a7020 con 0x7f54b010c0d0 2024-09-10T08:19:56.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.806+0000 7f54b850a640 1 -- 172.21.15.22:0/3428591794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54b01030e0 con 0x7f54b010c0d0 2024-09-10T08:19:56.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.807+0000 7f54a77fe640 1 -- 172.21.15.22:0/3428591794 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f54a800f5f0 con 0x7f54b010c0d0 2024-09-10T08:19:56.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.808+0000 7f54a77fe640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f549c0a2e20 0x7f549c0a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:56.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.808+0000 7f54a77fe640 1 -- 172.21.15.22:0/3428591794 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8542+0+0 (secure 0 0 0) 0x7f54a80cfa20 con 0x7f54b010c0d0 2024-09-10T08:19:56.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.808+0000 7f54b62a6640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f549c0a2e20 0x7f549c0a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:56.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.809+0000 7f54b62a6640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f549c0a2e20 0x7f549c0a52e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009230 tx=0x7f54ac0058d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:56.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:56.812+0000 7f54a77fe640 1 -- 172.21.15.22:0/3428591794 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f54a8014030 con 0x7f54b010c0d0 2024-09-10T08:19:57.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.009+0000 7f54b850a640 1 -- 172.21.15.22:0/3428591794 --> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f54b00fea10 con 0x7f549c0a2e20 2024-09-10T08:19:57.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.017+0000 7f54a77fe640 1 -- 172.21.15.22:0/3428591794 <== mgr.15234 v2:172.21.15.22:6800/1685162317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f54b00fea10 con 0x7f549c0a2e20 2024-09-10T08:19:57.018 INFO:teuthology.orchestra.run.smithi022.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-10T00:00:00", "created": "2024-09-10T08:08:48", "first": "2024-09-10T08:09:00", "last": "2024-09-10T08:19:00", "last_pruned": "2024-09-10T08:19:00", "created_count": 11, "pruned_count": 5, "active": true} 2024-09-10T08:19:57.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.019+0000 7f54b850a640 1 -- 172.21.15.22:0/3428591794 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f549c0a2e20 msgr2=0x7f549c0a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.019+0000 7f54b850a640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f549c0a2e20 0x7f549c0a52e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009230 tx=0x7f54ac0058d0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.019+0000 7f54b850a640 1 -- 172.21.15.22:0/3428591794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54b010c0d0 msgr2=0x7f54b01013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.019+0000 7f54b850a640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54b010c0d0 0x7f54b01013d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f54a800cce0 tx=0x7f54a800a620 comp rx=0 tx=0).stop 2024-09-10T08:19:57.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.019+0000 7f54b850a640 1 -- 172.21.15.22:0/3428591794 shutdown_connections 2024-09-10T08:19:57.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.019+0000 7f54b850a640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f54b010c0d0 0x7f54b01013d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.019+0000 7f54b850a640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f549c0a2e20 0x7f549c0a52e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.019+0000 7f54b850a640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f54b0103620 0x7f54b0100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.019+0000 7f54b850a640 1 --2- 172.21.15.22:0/3428591794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54b0102d00 0x7f54b0100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.019+0000 7f54b850a640 1 -- 172.21.15.22:0/3428591794 >> 172.21.15.22:0/3428591794 conn(0x7f54b00fc6f0 msgr2=0x7f54b00fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:57.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.020+0000 7f54b850a640 1 -- 172.21.15.22:0/3428591794 shutdown_connections 2024-09-10T08:19:57.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.020+0000 7f54b850a640 1 -- 172.21.15.22:0/3428591794 wait complete. 2024-09-10T08:19:57.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-10T08:19:57.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.136+0000 7fc33e37f640 1 -- 172.21.15.22:0/3284919167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc33810c110 msgr2=0x7fc33810e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.136+0000 7fc33e37f640 1 --2- 172.21.15.22:0/3284919167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc33810c110 0x7fc33810e590 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc330009ca0 tx=0x7fc33002a950 comp rx=0 tx=0).stop 2024-09-10T08:19:57.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.136+0000 7fc33e37f640 1 -- 172.21.15.22:0/3284919167 shutdown_connections 2024-09-10T08:19:57.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.136+0000 7fc33e37f640 1 --2- 172.21.15.22:0/3284919167 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc33810c110 0x7fc33810e590 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.136+0000 7fc33e37f640 1 --2- 172.21.15.22:0/3284919167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3381035e0 0x7fc33810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.136+0000 7fc33e37f640 1 --2- 172.21.15.22:0/3284919167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc338102cc0 0x7fc3381030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.136+0000 7fc33e37f640 1 -- 172.21.15.22:0/3284919167 >> 172.21.15.22:0/3284919167 conn(0x7fc3380fc6b0 msgr2=0x7fc3380fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:57.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.136+0000 7fc33e37f640 1 -- 172.21.15.22:0/3284919167 shutdown_connections 2024-09-10T08:19:57.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.136+0000 7fc33e37f640 1 -- 172.21.15.22:0/3284919167 wait complete. 2024-09-10T08:19:57.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.137+0000 7fc33e37f640 1 Processor -- start 2024-09-10T08:19:57.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.137+0000 7fc33e37f640 1 -- start start 2024-09-10T08:19:57.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.137+0000 7fc33e37f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc338102cc0 0x7fc338198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:57.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.137+0000 7fc33e37f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3381035e0 0x7fc3381987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:57.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.137+0000 7fc33e37f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc33810c110 0x7fc33819cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:57.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.137+0000 7fc33e37f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc338111eb0 con 0x7fc338102cc0 2024-09-10T08:19:57.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.137+0000 7fc33e37f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc338111d30 con 0x7fc3381035e0 2024-09-10T08:19:57.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.137+0000 7fc33e37f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc338112030 con 0x7fc33810c110 2024-09-10T08:19:57.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc337fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc338102cc0 0x7fc338198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:57.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc337fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc338102cc0 0x7fc338198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37276/0 (socket says 172.21.15.22:37276) 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc337fff640 1 -- 172.21.15.22:0/2168146609 learned_addr learned my addr 172.21.15.22:0/2168146609 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc33c91c640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc33810c110 0x7fc33819cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc3377fe640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3381035e0 0x7fc3381987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc337fff640 1 -- 172.21.15.22:0/2168146609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc33810c110 msgr2=0x7fc33819cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc337fff640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc33810c110 0x7fc33819cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc337fff640 1 -- 172.21.15.22:0/2168146609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3381035e0 msgr2=0x7fc3381987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc337fff640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3381035e0 0x7fc3381987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc337fff640 1 -- 172.21.15.22:0/2168146609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33819d250 con 0x7fc338102cc0 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc33c91c640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc33810c110 0x7fc33819cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc3377fe640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3381035e0 0x7fc3381987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc337fff640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc338102cc0 0x7fc338198260 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c920 tx=0x7fc32800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc3357fa640 1 -- 172.21.15.22:0/2168146609 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328007c70 con 0x7fc338102cc0 2024-09-10T08:19:57.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc33e37f640 1 -- 172.21.15.22:0/2168146609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33819d540 con 0x7fc338102cc0 2024-09-10T08:19:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc3357fa640 1 -- 172.21.15.22:0/2168146609 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc328007e10 con 0x7fc338102cc0 2024-09-10T08:19:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc3357fa640 1 -- 172.21.15.22:0/2168146609 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328018890 con 0x7fc338102cc0 2024-09-10T08:19:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.138+0000 7fc33e37f640 1 -- 172.21.15.22:0/2168146609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3381a4dd0 con 0x7fc338102cc0 2024-09-10T08:19:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.139+0000 7fc33e37f640 1 -- 172.21.15.22:0/2168146609 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3381030a0 con 0x7fc338102cc0 2024-09-10T08:19:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.140+0000 7fc3357fa640 1 -- 172.21.15.22:0/2168146609 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fc328018a70 con 0x7fc338102cc0 2024-09-10T08:19:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.141+0000 7fc3357fa640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fc3200a2da0 0x7fc3200a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.141+0000 7fc3377fe640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fc3200a2da0 0x7fc3200a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.141+0000 7fc3357fa640 1 -- 172.21.15.22:0/2168146609 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8542+0+0 (secure 0 0 0) 0x7fc3280cf660 con 0x7fc338102cc0 2024-09-10T08:19:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.142+0000 7fc3377fe640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fc3200a2da0 0x7fc3200a5260 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc33810ea10 tx=0x7fc32c005d50 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:57.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.145+0000 7fc3357fa640 1 -- 172.21.15.22:0/2168146609 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc328014030 con 0x7fc338102cc0 2024-09-10T08:19:57.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.341+0000 7fc33e37f640 1 -- 172.21.15.22:0/2168146609 --> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fc3380fe9d0 con 0x7fc3200a2da0 2024-09-10T08:19:57.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.348+0000 7fc3357fa640 1 -- 172.21.15.22:0/2168146609 <== mgr.15234 v2:172.21.15.22:6800/1685162317 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fc3380fe9d0 con 0x7fc3200a2da0 2024-09-10T08:19:57.348 INFO:teuthology.orchestra.run.smithi022.stdout:/ 1m 6m3h 2024-09-10T08:19:57.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.350+0000 7fc33e37f640 1 -- 172.21.15.22:0/2168146609 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fc3200a2da0 msgr2=0x7fc3200a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.350+0000 7fc33e37f640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fc3200a2da0 0x7fc3200a5260 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc33810ea10 tx=0x7fc32c005d50 comp rx=0 tx=0).stop 2024-09-10T08:19:57.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.350+0000 7fc33e37f640 1 -- 172.21.15.22:0/2168146609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc338102cc0 msgr2=0x7fc338198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.350+0000 7fc33e37f640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc338102cc0 0x7fc338198260 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c920 tx=0x7fc32800cde0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.350+0000 7fc33e37f640 1 -- 172.21.15.22:0/2168146609 shutdown_connections 2024-09-10T08:19:57.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.350+0000 7fc33e37f640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc33810c110 0x7fc33819cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.350+0000 7fc33e37f640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fc3200a2da0 0x7fc3200a5260 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.350+0000 7fc33e37f640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3381035e0 0x7fc3381987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.350+0000 7fc33e37f640 1 --2- 172.21.15.22:0/2168146609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc338102cc0 0x7fc338198260 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.350+0000 7fc33e37f640 1 -- 172.21.15.22:0/2168146609 >> 172.21.15.22:0/2168146609 conn(0x7fc3380fc6b0 msgr2=0x7fc3380fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:57.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.350+0000 7fc33e37f640 1 -- 172.21.15.22:0/2168146609 shutdown_connections 2024-09-10T08:19:57.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.350+0000 7fc33e37f640 1 -- 172.21.15.22:0/2168146609 wait complete. 2024-09-10T08:19:57.359 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:57 smithi022 ceph-mon[30854]: pgmap v347: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:19:57.361 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T08:19:57.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:19:57.372 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:57 smithi100 ceph-mon[35102]: pgmap v347: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:19:57.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:57 smithi153 ceph-mon[35609]: pgmap v347: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-10T08:19:57.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.482+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2156927704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9cc101230 msgr2=0x7ff9cc107970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.482+0000 7ff9d1ee6640 1 --2- 172.21.15.22:0/2156927704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9cc101230 0x7ff9cc107970 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009900 tx=0x7ff9b402a410 comp rx=0 tx=0).stop 2024-09-10T08:19:57.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.482+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2156927704 shutdown_connections 2024-09-10T08:19:57.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.482+0000 7ff9d1ee6640 1 --2- 172.21.15.22:0/2156927704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9cc1080d0 0x7ff9cc10e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.482+0000 7ff9d1ee6640 1 --2- 172.21.15.22:0/2156927704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9cc101230 0x7ff9cc107970 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.482+0000 7ff9d1ee6640 1 --2- 172.21.15.22:0/2156927704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc100880 0x7ff9cc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.482+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2156927704 >> 172.21.15.22:0/2156927704 conn(0x7ff9cc075f60 msgr2=0x7ff9cc076370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:57.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.483+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2156927704 shutdown_connections 2024-09-10T08:19:57.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.483+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2156927704 wait complete. 2024-09-10T08:19:57.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.483+0000 7ff9d1ee6640 1 Processor -- start 2024-09-10T08:19:57.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.483+0000 7ff9d1ee6640 1 -- start start 2024-09-10T08:19:57.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.483+0000 7ff9d1ee6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc100880 0x7ff9cc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:57.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.483+0000 7ff9d1ee6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9cc1080d0 0x7ff9cc198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:57.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.483+0000 7ff9d1ee6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9cc19cc90 0x7ff9cc19d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:57.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.483+0000 7ff9d1ee6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc111ee0 con 0x7ff9cc1080d0 2024-09-10T08:19:57.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.483+0000 7ff9d1ee6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc111d60 con 0x7ff9cc100880 2024-09-10T08:19:57.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.483+0000 7ff9d1ee6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc112060 con 0x7ff9cc19cc90 2024-09-10T08:19:57.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9cc1080d0 0x7ff9cc198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9cc1080d0 0x7ff9cc198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37290/0 (socket says 172.21.15.22:37290) 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9c2ffd640 1 -- 172.21.15.22:0/2477849853 learned_addr learned my addr 172.21.15.22:0/2477849853 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9cbfff640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9cc19cc90 0x7ff9cc19d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9cb7fe640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc100880 0x7ff9cc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9c2ffd640 1 -- 172.21.15.22:0/2477849853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9cc19cc90 msgr2=0x7ff9cc19d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9c2ffd640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9cc19cc90 0x7ff9cc19d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9c2ffd640 1 -- 172.21.15.22:0/2477849853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc100880 msgr2=0x7ff9cc1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9c2ffd640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc100880 0x7ff9cc1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9c2ffd640 1 -- 172.21.15.22:0/2477849853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc19d780 con 0x7ff9cc1080d0 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9cb7fe640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc100880 0x7ff9cc1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9c2ffd640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9cc1080d0 0x7ff9cc198910 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4005940 tx=0x7ff9b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9c97fa640 1 -- 172.21.15.22:0/2477849853 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b403f030 con 0x7ff9cc1080d0 2024-09-10T08:19:57.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9c97fa640 1 -- 172.21.15.22:0/2477849853 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9b4003ce0 con 0x7ff9cc1080d0 2024-09-10T08:19:57.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9c97fa640 1 -- 172.21.15.22:0/2477849853 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4035070 con 0x7ff9cc1080d0 2024-09-10T08:19:57.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2477849853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9cc19da10 con 0x7ff9cc1080d0 2024-09-10T08:19:57.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.484+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2477849853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9cc1a51d0 con 0x7ff9cc1080d0 2024-09-10T08:19:57.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.485+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2477849853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9cc100c60 con 0x7ff9cc1080d0 2024-09-10T08:19:57.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.486+0000 7ff9c97fa640 1 -- 172.21.15.22:0/2477849853 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff9b4042030 con 0x7ff9cc1080d0 2024-09-10T08:19:57.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.487+0000 7ff9c97fa640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7ff9b80a2d00 0x7ff9b80a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:57.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.487+0000 7ff9cb7fe640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7ff9b80a2d00 0x7ff9b80a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:57.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.487+0000 7ff9c97fa640 1 -- 172.21.15.22:0/2477849853 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8542+0+0 (secure 0 0 0) 0x7ff9b40ef9d0 con 0x7ff9cc1080d0 2024-09-10T08:19:57.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.488+0000 7ff9cb7fe640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7ff9b80a2d00 0x7ff9b80a51c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0058c0 tx=0x7ff9bc005850 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:57.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.491+0000 7ff9c97fa640 1 -- 172.21.15.22:0/2477849853 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9b40bc5e0 con 0x7ff9cc1080d0 2024-09-10T08:19:57.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.668+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2477849853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9cc101230 con 0x7ff9cc1080d0 2024-09-10T08:19:57.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.670+0000 7ff9c97fa640 1 -- 172.21.15.22:0/2477849853 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+23258 (secure 0 0 0) 0x7ff9b40bbee0 con 0x7ff9cc1080d0 2024-09-10T08:19:57.670 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:19:57.670 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":94,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","created":"2024-09-10T07:59:04.704048+0000","modified":"2024-09-10T08:19:19.770764+0000","last_up_change":"2024-09-10T08:06:02.535944+0000","last_in_change":"2024-09-10T08:05:39.070554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:02:15.371265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:06:50.358155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:06:52.896201+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d296bd3-28a7-418c-ad73-343a5e806cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6803","nonce":4248555152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6805","nonce":4248555152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6809","nonce":4248555152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6807","nonce":4248555152}]},"public_addr":"172.21.15.22:6803/4248555152","cluster_addr":"172.21.15.22:6805/4248555152","heartbeat_back_addr":"172.21.15.22:6809/4248555152","heartbeat_front_addr":"172.21.15.22:6807/4248555152","state":["exists","up"]},{"osd":1,"uuid":"c1e2b40e-b4ab-475a-8a9e-c67409f46b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6801","nonce":2078646052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6803","nonce":2078646052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6807","nonce":2078646052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6805","nonce":2078646052}]},"public_addr":"172.21.15.100:6801/2078646052","cluster_addr":"172.21.15.100:6803/2078646052","heartbeat_back_addr":"172.21.15.100:6807/2078646052","heartbeat_front_addr":"172.21.15.100:6805/2078646052","state":["exists","up"]},{"osd":2,"uuid":"be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6801","nonce":2492419476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6803","nonce":2492419476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6807","nonce":2492419476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6805","nonce":2492419476}]},"public_addr":"172.21.15.153:6801/2492419476","cluster_addr":"172.21.15.153:6803/2492419476","heartbeat_back_addr":"172.21.15.153:6807/2492419476","heartbeat_front_addr":"172.21.15.153:6805/2492419476","state":["exists","up"]},{"osd":3,"uuid":"e980a3ba-c659-4473-9633-9cbe88296d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6811","nonce":3674495276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6813","nonce":3674495276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6817","nonce":3674495276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6815","nonce":3674495276}]},"public_addr":"172.21.15.22:6811/3674495276","cluster_addr":"172.21.15.22:6813/3674495276","heartbeat_back_addr":"172.21.15.22:6817/3674495276","heartbeat_front_addr":"172.21.15.22:6815/3674495276","state":["exists","up"]},{"osd":4,"uuid":"b37d0590-99b1-4566-96b4-9936890d4308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6809","nonce":3886932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6811","nonce":3886932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6815","nonce":3886932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6813","nonce":3886932513}]},"public_addr":"172.21.15.100:6809/3886932513","cluster_addr":"172.21.15.100:6811/3886932513","heartbeat_back_addr":"172.21.15.100:6815/3886932513","heartbeat_front_addr":"172.21.15.100:6813/3886932513","state":["exists","up"]},{"osd":5,"uuid":"6cb989a0-80a1-4a9a-8b45-51b47772b203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6809","nonce":120732073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6811","nonce":120732073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6815","nonce":120732073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6813","nonce":120732073}]},"public_addr":"172.21.15.153:6809/120732073","cluster_addr":"172.21.15.153:6811/120732073","heartbeat_back_addr":"172.21.15.153:6815/120732073","heartbeat_front_addr":"172.21.15.153:6813/120732073","state":["exists","up"]},{"osd":6,"uuid":"294887f3-3e58-4b02-884d-4e0a70a86d16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6819","nonce":3692536487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6821","nonce":3692536487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6825","nonce":3692536487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6823","nonce":3692536487}]},"public_addr":"172.21.15.22:6819/3692536487","cluster_addr":"172.21.15.22:6821/3692536487","heartbeat_back_addr":"172.21.15.22:6825/3692536487","heartbeat_front_addr":"172.21.15.22:6823/3692536487","state":["exists","up"]},{"osd":7,"uuid":"d0c0ec61-4055-46f3-a4b0-39f04c735452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6817","nonce":1221175921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6819","nonce":1221175921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6823","nonce":1221175921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6821","nonce":1221175921}]},"public_addr":"172.21.15.100:6817/1221175921","cluster_addr":"172.21.15.100:6819/1221175921","heartbeat_back_addr":"172.21.15.100:6823/1221175921","heartbeat_front_addr":"172.21.15.100:6821/1221175921","state":["exists","up"]},{"osd":8,"uuid":"bda45a16-742e-4eda-b4d4-e01d6f3dc92e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6817","nonce":1153053941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6819","nonce":1153053941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6823","nonce":1153053941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6821","nonce":1153053941}]},"public_addr":"172.21.15.153:6817/1153053941","cluster_addr":"172.21.15.153:6819/1153053941","heartbeat_back_addr":"172.21.15.153:6823/1153053941","heartbeat_front_addr":"172.21.15.153:6821/1153053941","state":["exists","up"]},{"osd":9,"uuid":"48bd3544-9028-4535-801b-3d39ecadf48e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6827","nonce":3423218876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6829","nonce":3423218876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6833","nonce":3423218876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6831","nonce":3423218876}]},"public_addr":"172.21.15.22:6827/3423218876","cluster_addr":"172.21.15.22:6829/3423218876","heartbeat_back_addr":"172.21.15.22:6833/3423218876","heartbeat_front_addr":"172.21.15.22:6831/3423218876","state":["exists","up"]},{"osd":10,"uuid":"c8716aa0-eb93-435d-a9d0-dd4c3dce1954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6825","nonce":2024112643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6827","nonce":2024112643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6831","nonce":2024112643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6829","nonce":2024112643}]},"public_addr":"172.21.15.100:6825/2024112643","cluster_addr":"172.21.15.100:6827/2024112643","heartbeat_back_addr":"172.21.15.100:6831/2024112643","heartbeat_front_addr":"172.21.15.100:6829/2024112643","state":["exists","up"]},{"osd":11,"uuid":"3c427cfe-8d7c-431e-9eb4-b03cfac3068d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6825","nonce":2245781783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6827","nonce":2245781783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6831","nonce":2245781783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6829","nonce":2245781783}]},"public_addr":"172.21.15.153:6825/2245781783","cluster_addr":"172.21.15.153:6827/2245781783","heartbeat_back_addr":"172.21.15.153:6831/2245781783","heartbeat_front_addr":"172.21.15.153:6829/2245781783","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:23.001057+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:46.353182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:11.469840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:37.557521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:02.630783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:27.374057+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:53.758498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:19.507846+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:45.080789+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:10.286820+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:35.565950+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:06:00.633384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3248665282":"2024-09-11T08:08:47.387046+0000","172.21.15.22:0/1730890938":"2024-09-11T08:08:47.387046+0000","172.21.15.22:0/278091300":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/1708436544":"2024-09-11T07:59:36.505631+0000","172.21.15.22:6801/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/3337107310":"2024-09-11T07:59:36.505631+0000","172.21.15.22:6800/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/2108462626":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/1519904928":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6801/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6801/1767260330":"2024-09-11T08:08:47.387046+0000","172.21.15.22:0/467191986":"2024-09-11T08:08:47.387046+0000","172.21.15.22:0/3072001022":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/3164953486":"2024-09-11T08:08:47.387046+0000","172.21.15.22:6800/1767260330":"2024-09-11T08:08:47.387046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:19:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.672+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2477849853 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7ff9b80a2d00 msgr2=0x7ff9b80a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.672+0000 7ff9d1ee6640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7ff9b80a2d00 0x7ff9b80a51c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0058c0 tx=0x7ff9bc005850 comp rx=0 tx=0).stop 2024-09-10T08:19:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.672+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2477849853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9cc1080d0 msgr2=0x7ff9cc198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.672+0000 7ff9d1ee6640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9cc1080d0 0x7ff9cc198910 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4005940 tx=0x7ff9b40042f0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.672+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2477849853 shutdown_connections 2024-09-10T08:19:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.672+0000 7ff9d1ee6640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9cc19cc90 0x7ff9cc19d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.672+0000 7ff9d1ee6640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9cc1080d0 0x7ff9cc198910 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.672+0000 7ff9d1ee6640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7ff9b80a2d00 0x7ff9b80a51c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.672+0000 7ff9d1ee6640 1 --2- 172.21.15.22:0/2477849853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9cc100880 0x7ff9cc1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.672+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2477849853 >> 172.21.15.22:0/2477849853 conn(0x7ff9cc075f60 msgr2=0x7ff9cc105b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.672+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2477849853 shutdown_connections 2024-09-10T08:19:57.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.672+0000 7ff9d1ee6640 1 -- 172.21.15.22:0/2477849853 wait complete. 2024-09-10T08:19:57.683 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:02:15.371265+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T08:06:50.358155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T08:06:52.896201+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 93, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T08:19:57.684 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:19:57.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.791+0000 7f47f679f640 1 -- 172.21.15.22:0/3454871053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f0102ce0 msgr2=0x7f47f01030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.791+0000 7f47f679f640 1 --2- 172.21.15.22:0/3454871053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f0102ce0 0x7f47f01030c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009900 tx=0x7f47e002a480 comp rx=0 tx=0).stop 2024-09-10T08:19:57.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.791+0000 7f47f679f640 1 -- 172.21.15.22:0/3454871053 shutdown_connections 2024-09-10T08:19:57.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.791+0000 7f47f679f640 1 --2- 172.21.15.22:0/3454871053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47f010c0b0 0x7f47f010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.791+0000 7f47f679f640 1 --2- 172.21.15.22:0/3454871053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0103600 0x7f47f010bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.791+0000 7f47f679f640 1 --2- 172.21.15.22:0/3454871053 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f0102ce0 0x7f47f01030c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.791+0000 7f47f679f640 1 -- 172.21.15.22:0/3454871053 >> 172.21.15.22:0/3454871053 conn(0x7f47f00fc690 msgr2=0x7f47f00feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:57.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.791+0000 7f47f679f640 1 -- 172.21.15.22:0/3454871053 shutdown_connections 2024-09-10T08:19:57.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.792+0000 7f47f679f640 1 -- 172.21.15.22:0/3454871053 wait complete. 2024-09-10T08:19:57.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.792+0000 7f47f679f640 1 Processor -- start 2024-09-10T08:19:57.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.792+0000 7f47f679f640 1 -- start start 2024-09-10T08:19:57.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47f679f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f0102ce0 0x7f47f0073aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:57.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47f679f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0103600 0x7f47f006cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:57.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47f679f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47f010c0b0 0x7f47f006d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:57.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47f679f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0111eb0 con 0x7f47f0102ce0 2024-09-10T08:19:57.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47f679f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0111d30 con 0x7f47f0103600 2024-09-10T08:19:57.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47f679f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f47f0112030 con 0x7f47f010c0b0 2024-09-10T08:19:57.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47e7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0103600 0x7f47f006cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47effff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f0102ce0 0x7f47f0073aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47e7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0103600 0x7f47f006cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.22:35572/0 (socket says 172.21.15.22:35572) 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47e7fff640 1 -- 172.21.15.22:0/1836359368 learned_addr learned my addr 172.21.15.22:0/1836359368 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47f4d3c640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47f010c0b0 0x7f47f006d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47e7fff640 1 -- 172.21.15.22:0/1836359368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47f010c0b0 msgr2=0x7f47f006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47e7fff640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47f010c0b0 0x7f47f006d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47e7fff640 1 -- 172.21.15.22:0/1836359368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f0102ce0 msgr2=0x7f47f0073aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.793+0000 7f47e7fff640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f0102ce0 0x7f47f0073aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.794+0000 7f47e7fff640 1 -- 172.21.15.22:0/1836359368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f006d6d0 con 0x7f47f0103600 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.794+0000 7f47effff640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f0102ce0 0x7f47f0073aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.794+0000 7f47e7fff640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0103600 0x7f47f006cb20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f47d800e9f0 tx=0x7f47d800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.794+0000 7f47edffb640 1 -- 172.21.15.22:0/1836359368 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d800cd80 con 0x7f47f0103600 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.794+0000 7f47f679f640 1 -- 172.21.15.22:0/1836359368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f00715c0 con 0x7f47f0103600 2024-09-10T08:19:57.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.794+0000 7f47edffb640 1 -- 172.21.15.22:0/1836359368 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47d8010910 con 0x7f47f0103600 2024-09-10T08:19:57.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.794+0000 7f47edffb640 1 -- 172.21.15.22:0/1836359368 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d80188f0 con 0x7f47f0103600 2024-09-10T08:19:57.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.794+0000 7f47f679f640 1 -- 172.21.15.22:0/1836359368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f0071b10 con 0x7f47f0103600 2024-09-10T08:19:57.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.795+0000 7f47f679f640 1 -- 172.21.15.22:0/1836359368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f006abe0 con 0x7f47f0103600 2024-09-10T08:19:57.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.798+0000 7f47edffb640 1 -- 172.21.15.22:0/1836359368 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f47d8010ac0 con 0x7f47f0103600 2024-09-10T08:19:57.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.798+0000 7f47edffb640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f47dc0a2d30 0x7f47dc0a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:57.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.799+0000 7f47effff640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f47dc0a2d30 0x7f47dc0a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:57.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.799+0000 7f47edffb640 1 -- 172.21.15.22:0/1836359368 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8542+0+0 (secure 0 0 0) 0x7f47d80cfbb0 con 0x7f47f0103600 2024-09-10T08:19:57.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.799+0000 7f47effff640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f47dc0a2d30 0x7f47dc0a51f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009230 tx=0x7f47e00058d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:57.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.802+0000 7f47edffb640 1 -- 172.21.15.22:0/1836359368 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47d809c170 con 0x7f47f0103600 2024-09-10T08:19:57.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.979+0000 7f47f679f640 1 -- 172.21.15.22:0/1836359368 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f47f0107160 con 0x7f47f0103600 2024-09-10T08:19:57.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.979+0000 7f47edffb640 1 -- 172.21.15.22:0/1836359368 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7f47d80a0470 con 0x7f47f0103600 2024-09-10T08:19:57.980 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-09-10T08:19:57.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.981+0000 7f47f679f640 1 -- 172.21.15.22:0/1836359368 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f47dc0a2d30 msgr2=0x7f47dc0a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.981+0000 7f47f679f640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f47dc0a2d30 0x7f47dc0a51f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009230 tx=0x7f47e00058d0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.981+0000 7f47f679f640 1 -- 172.21.15.22:0/1836359368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0103600 msgr2=0x7f47f006cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:57.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.981+0000 7f47f679f640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0103600 0x7f47f006cb20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f47d800e9f0 tx=0x7f47d800eeb0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.981+0000 7f47f679f640 1 -- 172.21.15.22:0/1836359368 shutdown_connections 2024-09-10T08:19:57.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.981+0000 7f47f679f640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47f010c0b0 0x7f47f006d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.981+0000 7f47f679f640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f47dc0a2d30 0x7f47dc0a51f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.981+0000 7f47f679f640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47f0103600 0x7f47f006cb20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.981+0000 7f47f679f640 1 --2- 172.21.15.22:0/1836359368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47f0102ce0 0x7f47f0073aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:57.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.982+0000 7f47f679f640 1 -- 172.21.15.22:0/1836359368 >> 172.21.15.22:0/1836359368 conn(0x7f47f00fc690 msgr2=0x7f47f00fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:57.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.982+0000 7f47f679f640 1 -- 172.21.15.22:0/1836359368 shutdown_connections 2024-09-10T08:19:57.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:57.982+0000 7f47f679f640 1 -- 172.21.15.22:0/1836359368 wait complete. 2024-09-10T08:19:57.993 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T08:19:58.158 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.158+0000 7f2c7a675640 1 -- 172.21.15.22:0/2544881755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c6c006440 msgr2=0x7f2c6c006820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:58.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.158+0000 7f2c7a675640 1 --2- 172.21.15.22:0/2544881755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c6c006440 0x7f2c6c006820 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2c74067ef0 tx=0x7f2c74096690 comp rx=0 tx=0).stop 2024-09-10T08:19:58.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.159+0000 7f2c7a675640 1 -- 172.21.15.22:0/2544881755 shutdown_connections 2024-09-10T08:19:58.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.159+0000 7f2c7a675640 1 --2- 172.21.15.22:0/2544881755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c6c09a9a0 0x7f2c6c0a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.159+0000 7f2c7a675640 1 --2- 172.21.15.22:0/2544881755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c6c006df0 0x7f2c6c09a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.159+0000 7f2c7a675640 1 --2- 172.21.15.22:0/2544881755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c6c006440 0x7f2c6c006820 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.159+0000 7f2c7a675640 1 -- 172.21.15.22:0/2544881755 >> 172.21.15.22:0/2544881755 conn(0x7f2c6c00a2d0 msgr2=0x7f2c6c00a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:58.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.159+0000 7f2c7a675640 1 -- 172.21.15.22:0/2544881755 shutdown_connections 2024-09-10T08:19:58.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.159+0000 7f2c7a675640 1 -- 172.21.15.22:0/2544881755 wait complete. 2024-09-10T08:19:58.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.160+0000 7f2c7a675640 1 Processor -- start 2024-09-10T08:19:58.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.160+0000 7f2c7a675640 1 -- start start 2024-09-10T08:19:58.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.160+0000 7f2c7a675640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c6c006440 0x7f2c6c0a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:58.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.160+0000 7f2c7a675640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c6c09a9a0 0x7f2c6c0a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:58.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.160+0000 7f2c7a675640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c6c0a5a90 0x7f2c6c0b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.160+0000 7f2c7a675640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c0a3880 con 0x7f2c6c09a9a0 2024-09-10T08:19:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.160+0000 7f2c7a675640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c0a3700 con 0x7f2c6c006440 2024-09-10T08:19:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.160+0000 7f2c7a675640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c0a3a00 con 0x7f2c6c0a5a90 2024-09-10T08:19:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.160+0000 7f2c79673640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c6c006440 0x7f2c6c0a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.160+0000 7f2c78e72640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c6c09a9a0 0x7f2c6c0a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.160+0000 7f2c79673640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c6c006440 0x7f2c6c0a4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.22:35598/0 (socket says 172.21.15.22:35598) 2024-09-10T08:19:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.160+0000 7f2c79673640 1 -- 172.21.15.22:0/4035086109 learned_addr learned my addr 172.21.15.22:0/4035086109 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:19:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.161+0000 7f2c79e74640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c6c0a5a90 0x7f2c6c0b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.161+0000 7f2c79673640 1 -- 172.21.15.22:0/4035086109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c6c0a5a90 msgr2=0x7f2c6c0b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.161+0000 7f2c79673640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c6c0a5a90 0x7f2c6c0b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.161+0000 7f2c79673640 1 -- 172.21.15.22:0/4035086109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c6c09a9a0 msgr2=0x7f2c6c0a53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:58.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.161+0000 7f2c79673640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c6c09a9a0 0x7f2c6c0a53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.161+0000 7f2c79673640 1 -- 172.21.15.22:0/4035086109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c0b1700 con 0x7f2c6c006440 2024-09-10T08:19:58.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.161+0000 7f2c79e74640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c6c0a5a90 0x7f2c6c0b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:19:58.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.161+0000 7f2c79673640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c6c006440 0x7f2c6c0a4eb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2c74096c80 tx=0x7f2c74076d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:58.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.162+0000 7f2c667fc640 1 -- 172.21.15.22:0/4035086109 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c740ae070 con 0x7f2c6c006440 2024-09-10T08:19:58.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.162+0000 7f2c667fc640 1 -- 172.21.15.22:0/4035086109 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c74076e80 con 0x7f2c6c006440 2024-09-10T08:19:58.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.162+0000 7f2c667fc640 1 -- 172.21.15.22:0/4035086109 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7409e6d0 con 0x7f2c6c006440 2024-09-10T08:19:58.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.162+0000 7f2c7a675640 1 -- 172.21.15.22:0/4035086109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c0b1990 con 0x7f2c6c006440 2024-09-10T08:19:58.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.163+0000 7f2c7a675640 1 -- 172.21.15.22:0/4035086109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c0b1e30 con 0x7f2c6c006440 2024-09-10T08:19:58.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.164+0000 7f2c7a675640 1 -- 172.21.15.22:0/4035086109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6c096e70 con 0x7f2c6c006440 2024-09-10T08:19:58.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.168+0000 7f2c667fc640 1 -- 172.21.15.22:0/4035086109 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f2c740b1070 con 0x7f2c6c006440 2024-09-10T08:19:58.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.169+0000 7f2c667fc640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f2c600a2e50 0x7f2c600a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:58.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.169+0000 7f2c667fc640 1 -- 172.21.15.22:0/4035086109 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8542+0+0 (secure 0 0 0) 0x7f2c7415a9e0 con 0x7f2c6c006440 2024-09-10T08:19:58.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.171+0000 7f2c78e72640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f2c600a2e50 0x7f2c600a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:58.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.173+0000 7f2c78e72640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f2c600a2e50 0x7f2c600a5310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0a6620 tx=0x7f2c70009260 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:58.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.173+0000 7f2c667fc640 1 -- 172.21.15.22:0/4035086109 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c74127590 con 0x7f2c6c006440 2024-09-10T08:19:58.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:58 smithi022 ceph-mon[30854]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:19:58.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:58 smithi022 ceph-mon[30854]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:19:58.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:58 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2477849853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:19:58.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:58 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1836359368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T08:19:58.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:58 smithi100 ceph-mon[35102]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:19:58.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:58 smithi100 ceph-mon[35102]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:19:58.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:58 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2477849853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:19:58.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:58 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1836359368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T08:19:58.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:58 smithi153 ceph-mon[35609]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:19:58.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:58 smithi153 ceph-mon[35609]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T08:19:58.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:58 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2477849853' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:19:58.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:58 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1836359368' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-10T08:19:58.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.502+0000 7f2c7a675640 1 -- 172.21.15.22:0/4035086109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2c6c006f30 con 0x7f2c6c006440 2024-09-10T08:19:58.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.504+0000 7f2c667fc640 1 -- 172.21.15.22:0/4035086109 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7f2c74126e90 con 0x7f2c6c006440 2024-09-10T08:19:58.504 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-09-10T08:19:58.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.507+0000 7f2c7a675640 1 -- 172.21.15.22:0/4035086109 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f2c600a2e50 msgr2=0x7f2c600a5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:58.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.507+0000 7f2c7a675640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f2c600a2e50 0x7f2c600a5310 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c0a6620 tx=0x7f2c70009260 comp rx=0 tx=0).stop 2024-09-10T08:19:58.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.507+0000 7f2c7a675640 1 -- 172.21.15.22:0/4035086109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c6c006440 msgr2=0x7f2c6c0a4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:58.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.507+0000 7f2c7a675640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c6c006440 0x7f2c6c0a4eb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2c74096c80 tx=0x7f2c74076d90 comp rx=0 tx=0).stop 2024-09-10T08:19:58.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.508+0000 7f2c7a675640 1 -- 172.21.15.22:0/4035086109 shutdown_connections 2024-09-10T08:19:58.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.508+0000 7f2c7a675640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c6c0a5a90 0x7f2c6c0b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.508+0000 7f2c7a675640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c6c09a9a0 0x7f2c6c0a53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.508+0000 7f2c7a675640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f2c600a2e50 0x7f2c600a5310 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.508+0000 7f2c7a675640 1 --2- 172.21.15.22:0/4035086109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c6c006440 0x7f2c6c0a4eb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.509+0000 7f2c7a675640 1 -- 172.21.15.22:0/4035086109 >> 172.21.15.22:0/4035086109 conn(0x7f2c6c00a2d0 msgr2=0x7f2c6c092c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:58.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.509+0000 7f2c7a675640 1 -- 172.21.15.22:0/4035086109 shutdown_connections 2024-09-10T08:19:58.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.509+0000 7f2c7a675640 1 -- 172.21.15.22:0/4035086109 wait complete. 2024-09-10T08:19:58.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T08:19:58.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.693+0000 7fdabfeae640 1 -- 172.21.15.22:0/1591099977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdab8102cf0 msgr2=0x7fdab81030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:58.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.693+0000 7fdabfeae640 1 --2- 172.21.15.22:0/1591099977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdab8102cf0 0x7fdab81030d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009900 tx=0x7fdaac02a4b0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.694+0000 7fdabfeae640 1 -- 172.21.15.22:0/1591099977 shutdown_connections 2024-09-10T08:19:58.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.694+0000 7fdabfeae640 1 --2- 172.21.15.22:0/1591099977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab810c0c0 0x7fdab810e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.694+0000 7fdabfeae640 1 --2- 172.21.15.22:0/1591099977 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdab8103610 0x7fdab810baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.694+0000 7fdabfeae640 1 --2- 172.21.15.22:0/1591099977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdab8102cf0 0x7fdab81030d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.694+0000 7fdabfeae640 1 -- 172.21.15.22:0/1591099977 >> 172.21.15.22:0/1591099977 conn(0x7fdab80779d0 msgr2=0x7fdab80fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:58.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.695+0000 7fdabfeae640 1 -- 172.21.15.22:0/1591099977 shutdown_connections 2024-09-10T08:19:58.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.695+0000 7fdabfeae640 1 -- 172.21.15.22:0/1591099977 wait complete. 2024-09-10T08:19:58.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.696+0000 7fdabfeae640 1 Processor -- start 2024-09-10T08:19:58.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.696+0000 7fdabfeae640 1 -- start start 2024-09-10T08:19:58.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.697+0000 7fdabfeae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdab8102cf0 0x7fdab8100870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:58.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.697+0000 7fdabfeae640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab8103610 0x7fdab8100db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:58.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.697+0000 7fdabfeae640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdab810c0c0 0x7fdab81012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:58.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.697+0000 7fdabfeae640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdab8111fc0 con 0x7fdab810c0c0 2024-09-10T08:19:58.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.697+0000 7fdabfeae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdab8111e40 con 0x7fdab8102cf0 2024-09-10T08:19:58.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.697+0000 7fdabfeae640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdab8112140 con 0x7fdab8103610 2024-09-10T08:19:58.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.697+0000 7fdabdc4a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdab8102cf0 0x7fdab8100870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:58.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.697+0000 7fdabdc4a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdab8102cf0 0x7fdab8100870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.22:35618/0 (socket says 172.21.15.22:35618) 2024-09-10T08:19:58.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.697+0000 7fdabdc4a640 1 -- 172.21.15.22:0/3170454036 learned_addr learned my addr 172.21.15.22:0/3170454036 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:19:58.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.697+0000 7fdabd449640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab8103610 0x7fdab8100db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:58.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.697+0000 7fdabe44b640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdab810c0c0 0x7fdab81012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:58.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.698+0000 7fdabd449640 1 -- 172.21.15.22:0/3170454036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdab8102cf0 msgr2=0x7fdab8100870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:58.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.698+0000 7fdabd449640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdab8102cf0 0x7fdab8100870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.698+0000 7fdabd449640 1 -- 172.21.15.22:0/3170454036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdab810c0c0 msgr2=0x7fdab81012f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:58.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.698+0000 7fdabd449640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdab810c0c0 0x7fdab81012f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:58.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.698+0000 7fdabd449640 1 -- 172.21.15.22:0/3170454036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab8072b60 con 0x7fdab8103610 2024-09-10T08:19:58.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.698+0000 7fdabd449640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab8103610 0x7fdab8100db0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009fd0 tx=0x7fdab400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:58.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.700+0000 7fdaaaffd640 1 -- 172.21.15.22:0/3170454036 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab4015020 con 0x7fdab8103610 2024-09-10T08:19:58.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.700+0000 7fdaaaffd640 1 -- 172.21.15.22:0/3170454036 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdab4011d10 con 0x7fdab8103610 2024-09-10T08:19:58.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.700+0000 7fdaaaffd640 1 -- 172.21.15.22:0/3170454036 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab400f2e0 con 0x7fdab8103610 2024-09-10T08:19:58.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.700+0000 7fdabfeae640 1 -- 172.21.15.22:0/3170454036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab8072e50 con 0x7fdab8103610 2024-09-10T08:19:58.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.700+0000 7fdabfeae640 1 -- 172.21.15.22:0/3170454036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab8073350 con 0x7fdab8103610 2024-09-10T08:19:58.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.702+0000 7fdabfeae640 1 -- 172.21.15.22:0/3170454036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdab8101d50 con 0x7fdab8103610 2024-09-10T08:19:58.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.704+0000 7fdaaaffd640 1 -- 172.21.15.22:0/3170454036 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fdab4018020 con 0x7fdab8103610 2024-09-10T08:19:58.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.705+0000 7fdaaaffd640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fdaa40a2e50 0x7fdaa40a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:58.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.705+0000 7fdaaaffd640 1 -- 172.21.15.22:0/3170454036 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8542+0+0 (secure 0 0 0) 0x7fdab40cefb0 con 0x7fdab8103610 2024-09-10T08:19:58.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.706+0000 7fdabdc4a640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fdaa40a2e50 0x7fdaa40a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:58.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.707+0000 7fdabdc4a640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fdaa40a2e50 0x7fdaa40a5310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdaac031550 tx=0x7fdaac00b040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:58.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:58.711+0000 7fdaaaffd640 1 -- 172.21.15.22:0/3170454036 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdab401f020 con 0x7fdab8103610 2024-09-10T08:19:59.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.031+0000 7fdabfeae640 1 -- 172.21.15.22:0/3170454036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdab8073b30 con 0x7fdab8103610 2024-09-10T08:19:59.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.031+0000 7fdaaaffd640 1 -- 172.21.15.22:0/3170454036 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7fdab409bd50 con 0x7fdab8103610 2024-09-10T08:19:59.031 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-09-10T08:19:59.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.035+0000 7fdabfeae640 1 -- 172.21.15.22:0/3170454036 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fdaa40a2e50 msgr2=0x7fdaa40a5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:59.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.035+0000 7fdabfeae640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fdaa40a2e50 0x7fdaa40a5310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdaac031550 tx=0x7fdaac00b040 comp rx=0 tx=0).stop 2024-09-10T08:19:59.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.035+0000 7fdabfeae640 1 -- 172.21.15.22:0/3170454036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab8103610 msgr2=0x7fdab8100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:59.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.035+0000 7fdabfeae640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab8103610 0x7fdab8100db0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009fd0 tx=0x7fdab400b870 comp rx=0 tx=0).stop 2024-09-10T08:19:59.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.037+0000 7fdabfeae640 1 -- 172.21.15.22:0/3170454036 shutdown_connections 2024-09-10T08:19:59.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.037+0000 7fdabfeae640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdab810c0c0 0x7fdab81012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:59.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.037+0000 7fdabfeae640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab8103610 0x7fdab8100db0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:59.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.037+0000 7fdabfeae640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fdaa40a2e50 0x7fdaa40a5310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:59.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.037+0000 7fdabfeae640 1 --2- 172.21.15.22:0/3170454036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdab8102cf0 0x7fdab8100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:59.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.037+0000 7fdabfeae640 1 -- 172.21.15.22:0/3170454036 >> 172.21.15.22:0/3170454036 conn(0x7fdab80779d0 msgr2=0x7fdab80fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:59.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.038+0000 7fdabfeae640 1 -- 172.21.15.22:0/3170454036 shutdown_connections 2024-09-10T08:19:59.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.038+0000 7fdabfeae640 1 -- 172.21.15.22:0/3170454036 wait complete. 2024-09-10T08:19:59.056 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T08:19:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.222+0000 7ff15ce2e640 1 -- 172.21.15.22:0/1231571419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1581069b0 msgr2=0x7ff158106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.222+0000 7ff15ce2e640 1 --2- 172.21.15.22:0/1231571419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1581069b0 0x7ff158106d90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff148009930 tx=0x7ff14802a420 comp rx=0 tx=0).stop 2024-09-10T08:19:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.222+0000 7ff15ce2e640 1 -- 172.21.15.22:0/1231571419 shutdown_connections 2024-09-10T08:19:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.222+0000 7ff15ce2e640 1 --2- 172.21.15.22:0/1231571419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff158101340 0x7ff15810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.222+0000 7ff15ce2e640 1 --2- 172.21.15.22:0/1231571419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1581009a0 0x7ff158100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.222+0000 7ff15ce2e640 1 --2- 172.21.15.22:0/1231571419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1581069b0 0x7ff158106d90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:59.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.222+0000 7ff15ce2e640 1 -- 172.21.15.22:0/1231571419 >> 172.21.15.22:0/1231571419 conn(0x7ff1580fc6a0 msgr2=0x7ff1580feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:19:59.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.222+0000 7ff15ce2e640 1 -- 172.21.15.22:0/1231571419 shutdown_connections 2024-09-10T08:19:59.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.222+0000 7ff15ce2e640 1 -- 172.21.15.22:0/1231571419 wait complete. 2024-09-10T08:19:59.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.223+0000 7ff15ce2e640 1 Processor -- start 2024-09-10T08:19:59.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.224+0000 7ff15ce2e640 1 -- start start 2024-09-10T08:19:59.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.224+0000 7ff15ce2e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1581009a0 0x7ff158197210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:59.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.224+0000 7ff15ce2e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff158101340 0x7ff158197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.224+0000 7ff15ce2e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1581069b0 0x7ff15819bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.224+0000 7ff15ce2e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff158110e00 con 0x7ff1581009a0 2024-09-10T08:19:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.224+0000 7ff15ce2e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff158110c80 con 0x7ff1581069b0 2024-09-10T08:19:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.224+0000 7ff15ce2e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff158110f80 con 0x7ff158101340 2024-09-10T08:19:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.224+0000 7ff15659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1581009a0 0x7ff158197210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.224+0000 7ff15659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1581009a0 0x7ff158197210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37344/0 (socket says 172.21.15.22:37344) 2024-09-10T08:19:59.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.224+0000 7ff15659c640 1 -- 172.21.15.22:0/2847686449 learned_addr learned my addr 172.21.15.22:0/2847686449 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:19:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.227+0000 7ff156d9d640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1581069b0 0x7ff15819bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.227+0000 7ff155d9b640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff158101340 0x7ff158197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.228+0000 7ff156d9d640 1 -- 172.21.15.22:0/2847686449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff158101340 msgr2=0x7ff158197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.228+0000 7ff156d9d640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff158101340 0x7ff158197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.228+0000 7ff156d9d640 1 -- 172.21.15.22:0/2847686449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1581009a0 msgr2=0x7ff158197210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:19:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.228+0000 7ff156d9d640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1581009a0 0x7ff158197210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:19:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.228+0000 7ff156d9d640 1 -- 172.21.15.22:0/2847686449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15819c200 con 0x7ff1581069b0 2024-09-10T08:19:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.228+0000 7ff156d9d640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1581069b0 0x7ff15819bad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff150009fd0 tx=0x7ff15000b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:59.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.228+0000 7ff1477fe640 1 -- 172.21.15.22:0/2847686449 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15000be40 con 0x7ff1581069b0 2024-09-10T08:19:59.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.228+0000 7ff1477fe640 1 -- 172.21.15.22:0/2847686449 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff150005020 con 0x7ff1581069b0 2024-09-10T08:19:59.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.228+0000 7ff15ce2e640 1 -- 172.21.15.22:0/2847686449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15819c4f0 con 0x7ff1581069b0 2024-09-10T08:19:59.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.228+0000 7ff15ce2e640 1 -- 172.21.15.22:0/2847686449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff158069fe0 con 0x7ff1581069b0 2024-09-10T08:19:59.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.230+0000 7ff1477fe640 1 -- 172.21.15.22:0/2847686449 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff150004d20 con 0x7ff1581069b0 2024-09-10T08:19:59.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.231+0000 7ff15ce2e640 1 -- 172.21.15.22:0/2847686449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff158198560 con 0x7ff1581069b0 2024-09-10T08:19:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.234+0000 7ff1477fe640 1 -- 172.21.15.22:0/2847686449 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7ff1500051d0 con 0x7ff1581069b0 2024-09-10T08:19:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.235+0000 7ff1477fe640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7ff1400a2dc0 0x7ff1400a5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:19:59.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.235+0000 7ff1477fe640 1 -- 172.21.15.22:0/2847686449 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8542+0+0 (secure 0 0 0) 0x7ff1500d1630 con 0x7ff1581069b0 2024-09-10T08:19:59.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.236+0000 7ff15659c640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7ff1400a2dc0 0x7ff1400a5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:19:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.236+0000 7ff15659c640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7ff1400a2dc0 0x7ff1400a5280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff148009850 tx=0x7ff14800b040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:19:59.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.239+0000 7ff1477fe640 1 -- 172.21.15.22:0/2847686449 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff15009e1e0 con 0x7ff1581069b0 2024-09-10T08:19:59.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:59 smithi100 ceph-mon[35102]: pgmap v348: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T08:19:59.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:59 smithi100 ceph-mon[35102]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:19:59.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:19:59 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/4035086109' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T08:19:59.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:59 smithi153 ceph-mon[35609]: pgmap v348: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T08:19:59.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:59 smithi153 ceph-mon[35609]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:19:59.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:19:59 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/4035086109' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T08:19:59.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:59 smithi022 ceph-mon[30854]: pgmap v348: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-10T08:19:59.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:59 smithi022 ceph-mon[30854]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-10T08:19:59.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:19:59 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/4035086109' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-10T08:19:59.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.643+0000 7ff15ce2e640 1 -- 172.21.15.22:0/2847686449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7ff15806a750 con 0x7ff1581069b0 2024-09-10T08:19:59.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.654+0000 7ff1477fe640 1 -- 172.21.15.22:0/2847686449 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+740902 (secure 0 0 0) 0x7ff15009dae0 con 0x7ff1581069b0 2024-09-10T08:19:59.654 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:19:59.665 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:19:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 25, 2024-09-10T08:19:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "active_gid": 15234, 2024-09-10T08:19:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "active_name": "x", 2024-09-10T08:19:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "active_addrs": { 2024-09-10T08:19:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-10T08:19:59.665 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6800", 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1685162317 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6801", 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1685162317 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "active_addr": "172.21.15.22:6801/1685162317", 2024-09-10T08:19:59.666 INFO:teuthology.orchestra.run.smithi022.stdout: "active_change": "2024-09-10T08:08:47.387253+0000", 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "active_mgr_features": 4540701547738038271, 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "available": true, 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "standbys": [ 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "gid": 24862, 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "z", 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_features": 4540701547738038271, 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.667 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:19:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:19:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:19:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T08:19:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.668 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.669 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.671 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.672 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.673 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-09-10T08:19:59.674 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to", 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.675 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.676 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-09-10T08:19:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.677 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-09-10T08:19:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-09-10T08:19:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-09-10T08:19:59.678 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-09-10T08:19:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-09-10T08:19:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-09-10T08:19:59.679 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.680 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-09-10T08:19:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-09-10T08:19:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-09-10T08:19:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.681 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.682 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.683 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T08:19:59.684 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T08:19:59.685 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.686 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-09-10T08:19:59.687 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.688 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-09-10T08:19:59.689 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.690 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.691 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.692 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.693 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.694 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.695 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.696 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.697 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T08:19:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-10T08:19:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-10T08:19:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-09-10T08:19:59.698 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.699 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.700 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.701 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.702 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.703 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.704 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.705 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.706 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.707 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.708 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.709 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.710 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.711 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.712 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.713 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.714 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.715 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.716 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.717 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.718 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.719 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.720 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.721 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.722 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.723 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.724 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.725 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.726 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T08:19:59.727 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.728 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.729 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.730 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.731 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.732 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.733 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.734 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.735 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.736 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.737 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.738 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.739 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.740 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.741 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.742 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.743 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.745 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.746 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.747 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.748 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.749 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.750 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.751 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-09-10T08:19:59.752 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-09-10T08:19:59.753 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-09-10T08:19:59.754 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-09-10T08:19:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T08:19:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T08:19:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-09-10T08:19:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-09-10T08:19:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T08:19:59.756 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.757 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.758 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.759 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.760 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T08:19:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-09-10T08:19:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-09-10T08:19:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.764 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.765 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.766 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.767 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.768 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.769 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.770 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.771 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.772 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.773 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T08:19:59.774 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T08:19:59.775 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.776 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:19:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T08:19:59.777 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T08:19:59.778 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.779 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.780 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.781 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.782 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.783 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.788 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.789 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.790 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.791 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.792 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.793 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.794 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.795 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.796 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T08:19:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T08:19:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.797 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T08:19:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T08:19:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.798 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T08:19:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T08:19:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.799 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.800 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T08:19:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T08:19:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.801 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.802 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T08:19:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T08:19:59.803 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T08:19:59.804 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T08:19:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.805 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.806 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T08:19:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T08:19:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.807 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.808 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T08:19:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T08:19:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.809 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.810 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.811 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.812 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-09-10T08:19:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T08:19:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T08:19:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.813 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T08:19:59.814 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T08:19:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T08:19:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-10T08:19:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.816 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.817 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.818 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.819 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.820 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.821 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.822 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.823 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.824 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-09-10T08:19:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-09-10T08:19:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-09-10T08:19:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-09-10T08:19:59.825 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.826 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.827 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.828 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.829 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.830 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.831 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.832 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.833 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.834 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-09-10T08:19:59.835 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.836 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-09-10T08:19:59.837 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.838 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-10T08:19:59.839 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-09-10T08:19:59.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.841 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-09-10T08:19:59.842 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.843 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.844 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.845 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.846 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-09-10T08:19:59.847 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-09-10T08:19:59.848 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-09-10T08:19:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.850 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.851 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.852 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-09-10T08:19:59.853 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.854 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.855 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.857 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.858 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.859 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.861 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.862 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-09-10T08:19:59.863 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-09-10T08:19:59.864 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.865 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-09-10T08:19:59.866 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.867 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.870 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.871 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.872 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.873 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T08:19:59.874 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T08:19:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.876 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.877 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.878 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.879 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.881 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.882 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.883 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.884 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.885 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.886 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.887 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.888 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-09-10T08:19:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-09-10T08:19:59.889 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.890 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-09-10T08:19:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-09-10T08:19:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:19:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-09-10T08:19:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T08:19:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.891 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.892 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.893 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.895 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.896 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.898 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.899 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.900 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.901 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.902 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.903 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.904 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.905 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-09-10T08:19:59.906 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.907 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-09-10T08:19:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-09-10T08:19:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-09-10T08:19:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.908 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-09-10T08:19:59.909 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.910 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.911 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.912 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.915 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.916 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.917 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.918 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.919 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.920 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.921 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.922 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.923 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.924 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.925 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-09-10T08:19:59.926 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T08:19:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.927 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.928 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.929 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.930 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.931 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-09-10T08:19:59.933 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.934 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.935 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.936 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.937 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.938 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.939 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.940 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.941 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.942 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.943 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.944 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.945 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.946 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.948 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.949 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:19:59.950 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:19:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:19:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-09-10T08:19:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-09-10T08:19:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:19:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-10T08:19:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-09-10T08:19:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-09-10T08:19:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T08:19:59.952 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-09-10T08:19:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-09-10T08:19:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-09-10T08:19:59.953 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-10T08:19:59.954 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-10T08:19:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.956 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.957 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.958 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.959 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.960 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-09-10T08:19:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-09-10T08:19:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-09-10T08:19:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.961 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.962 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-09-10T08:19:59.963 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-09-10T08:19:59.964 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-09-10T08:19:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.965 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T08:19:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T08:19:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.969 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.970 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.971 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.973 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.974 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-09-10T08:19:59.975 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.976 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.977 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-09-10T08:19:59.978 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.979 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.980 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-09-10T08:19:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-09-10T08:19:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-09-10T08:19:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.981 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-10T08:19:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-10T08:19:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-10T08:19:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-10T08:19:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-10T08:19:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.982 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-10T08:19:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.983 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.984 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.985 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.986 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.988 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.989 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.990 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.991 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.992 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-10T08:19:59.993 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:19:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.994 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.995 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.996 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:19:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:19:59.997 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:19:59.998 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:19:59.999 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.000 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.001 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-09-10T08:20:00.002 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.003 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.004 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.005 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.006 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.007 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.008 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.009 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.010 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.011 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.013 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.014 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.015 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.016 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.017 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.018 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.019 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-09-10T08:20:00.020 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.021 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.022 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.023 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.024 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.025 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.026 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.027 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.028 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.029 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.030 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.031 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.032 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.033 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.035 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.036 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.037 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.038 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.039 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.040 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.041 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.042 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.043 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.045 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.047 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.048 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.049 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.050 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.051 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-09-10T08:20:00.052 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.053 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.054 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.055 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.056 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.057 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.058 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.059 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.060 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.061 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.062 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.063 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.064 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.065 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.066 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.067 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-10T08:20:00.068 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.069 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-09-10T08:20:00.070 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-09-10T08:20:00.071 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.072 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.073 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.075 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.076 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.077 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.078 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.079 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.080 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.081 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.082 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.083 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.084 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.085 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.087 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.088 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.089 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.090 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.091 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.092 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.093 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.094 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.095 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:20:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T08:20:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-09-10T08:20:00.096 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.097 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-09-10T08:20:00.098 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.099 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.100 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.101 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.102 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.103 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.104 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.105 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.106 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-09-10T08:20:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-09-10T08:20:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.107 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.108 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.109 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "gid": 24884, 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "y", 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_features": 4540701547738038271, 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.110 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T08:20:00.111 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.112 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.113 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.114 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.116 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.117 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to", 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.118 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.119 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.120 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-09-10T08:20:00.121 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.122 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.123 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.124 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.125 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.126 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T08:20:00.127 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T08:20:00.128 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.129 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.130 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-09-10T08:20:00.131 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-09-10T08:20:00.132 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:20:00.133 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.134 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.135 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.136 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.137 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.138 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-09-10T08:20:00.139 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-10T08:20:00.140 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-09-10T08:20:00.141 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.142 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.143 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-10T08:20:00.144 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.145 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.146 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-09-10T08:20:00.147 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-09-10T08:20:00.148 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-09-10T08:20:00.149 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.150 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.151 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-09-10T08:20:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T08:20:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-09-10T08:20:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T08:20:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.152 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-09-10T08:20:00.153 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.154 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.155 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.156 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.157 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.158 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.160 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.161 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-09-10T08:20:00.162 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-09-10T08:20:00.163 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-09-10T08:20:00.164 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.165 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.166 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-09-10T08:20:00.167 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-09-10T08:20:00.168 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T08:20:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.169 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-09-10T08:20:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.172 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.173 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.174 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.175 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.176 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.177 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T08:20:00.178 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.179 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.180 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.181 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.182 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:20:00.183 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.184 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.185 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.186 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-09-10T08:20:00.187 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.188 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.189 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T08:20:00.190 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T08:20:00.191 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.192 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.193 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T08:20:00.194 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T08:20:00.195 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-09-10T08:20:00.196 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-09-10T08:20:00.197 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-09-10T08:20:00.198 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.199 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.200 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.201 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.202 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T08:20:00.203 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T08:20:00.204 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.205 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.206 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.208 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.209 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.210 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.211 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.212 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.213 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.214 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.215 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.216 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.217 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.218 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.219 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.220 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.221 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-09-10T08:20:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T08:20:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-09-10T08:20:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-09-10T08:20:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.222 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.223 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.224 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.225 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.226 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.227 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.228 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.229 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.230 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.231 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.232 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.233 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.234 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.235 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.236 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.237 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.238 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.239 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.240 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.241 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.242 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T08:20:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T08:20:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.244 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.245 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.246 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.247 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.248 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.250 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.251 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.252 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.253 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.254 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.255 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.256 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T08:20:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T08:20:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T08:20:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.257 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T08:20:00.258 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T08:20:00.259 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T08:20:00.260 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T08:20:00.261 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.262 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.263 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.264 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.265 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.266 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.267 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.268 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-09-10T08:20:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-09-10T08:20:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.269 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-09-10T08:20:00.270 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-09-10T08:20:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-09-10T08:20:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-09-10T08:20:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.271 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.272 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.273 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.275 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.276 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.277 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.278 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T08:20:00.279 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-10T08:20:00.280 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.281 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.282 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.283 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.284 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-10T08:20:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-10T08:20:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-09-10T08:20:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.285 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.286 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.287 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-10T08:20:00.288 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.289 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.290 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.291 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.292 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.293 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.294 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.295 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.296 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.297 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.298 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.299 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.300 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.301 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.302 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.303 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.304 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.305 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.306 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.307 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.308 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-09-10T08:20:00.309 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:20:00.310 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.312 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.313 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.314 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-09-10T08:20:00.315 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.316 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.319 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.320 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.321 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-09-10T08:20:00.322 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.323 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-10T08:20:00.324 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.325 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.326 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.327 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.328 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.329 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.330 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.331 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.332 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.333 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.334 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.335 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.336 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.337 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.338 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-10T08:20:00.339 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.340 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-09-10T08:20:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T08:20:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.341 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.342 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.343 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.344 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.345 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.346 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.347 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.348 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.349 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.350 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.351 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.352 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.353 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.354 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.355 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-09-10T08:20:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T08:20:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.356 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.357 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.358 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.359 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.360 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.361 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.362 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.363 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.364 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.365 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.367 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.368 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.369 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-09-10T08:20:00.370 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.371 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.372 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.373 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.376 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.377 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.378 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.379 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.380 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.381 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.382 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.383 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.384 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-09-10T08:20:00.385 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.386 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.387 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.388 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.389 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.390 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.391 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.392 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.393 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.394 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.395 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.396 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.397 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.398 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.399 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.400 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.401 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.402 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.403 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.404 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T08:20:00.405 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.406 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.407 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.408 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.409 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.410 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.411 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.412 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.413 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.414 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.415 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.416 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.417 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.418 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.419 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.420 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.421 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.422 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-09-10T08:20:00.423 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T08:20:00.424 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-09-10T08:20:00.425 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.426 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.427 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.428 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.429 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.430 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-10T08:20:00.431 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.432 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.433 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.434 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.435 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.436 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.437 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.438 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.439 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-09-10T08:20:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-09-10T08:20:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.440 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-09-10T08:20:00.441 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-10T08:20:00.442 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.443 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.444 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.445 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.446 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.447 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.448 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.449 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.450 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.451 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.452 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.453 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.454 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.455 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.456 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.457 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.458 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.459 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.460 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.461 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.462 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-09-10T08:20:00.463 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.464 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.465 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.466 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.467 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.468 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.469 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.470 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.471 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.472 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.473 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.474 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.475 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.476 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-09-10T08:20:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-09-10T08:20:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-10T08:20:00.477 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.478 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-09-10T08:20:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-09-10T08:20:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.479 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.480 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.481 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.482 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.483 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.484 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.485 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.487 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.488 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.489 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.490 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.491 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.492 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.493 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.494 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.495 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.496 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.497 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.498 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.499 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-09-10T08:20:00.500 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.501 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.502 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.503 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.504 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.505 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.506 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.507 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-09-10T08:20:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-09-10T08:20:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-09-10T08:20:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.508 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.509 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T08:20:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-09-10T08:20:00.510 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-09-10T08:20:00.511 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.512 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.513 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.514 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.515 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-09-10T08:20:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-09-10T08:20:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T08:20:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.516 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-10T08:20:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-10T08:20:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.517 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.518 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.519 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.520 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.521 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.522 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.523 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.524 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.525 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.526 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.527 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-09-10T08:20:00.528 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-09-10T08:20:00.529 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.530 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.532 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.533 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.534 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.536 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.537 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.538 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.540 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.541 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-09-10T08:20:00.542 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.543 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.544 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.545 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.546 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.547 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.548 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.549 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.550 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.551 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.552 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.553 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.554 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.555 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.556 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.557 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.558 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "modules": [ 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "dashboard", 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "iostat", 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "nfs", 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "restful", 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_schedule" 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.559 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:20:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T08:20:00.560 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.561 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.562 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.563 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.564 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.565 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.566 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to", 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.567 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.568 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.569 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.570 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-09-10T08:20:00.571 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.572 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.573 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.574 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.575 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-10T08:20:00.576 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-09-10T08:20:00.577 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T08:20:00.578 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.579 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.580 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:20:00.581 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.582 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.583 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.585 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.586 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.587 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:20:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T08:20:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-10T08:20:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-10T08:20:00.588 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.589 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.590 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.591 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T08:20:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-09-10T08:20:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-09-10T08:20:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.592 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.593 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.594 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.595 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.596 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.597 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.598 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.599 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.600 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.601 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-09-10T08:20:00.602 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-09-10T08:20:00.603 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.604 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.605 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.606 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.607 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.608 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-09-10T08:20:00.609 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-09-10T08:20:00.610 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.611 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-09-10T08:20:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-09-10T08:20:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T08:20:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-09-10T08:20:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.612 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.613 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-09-10T08:20:00.614 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.615 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.616 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.617 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.618 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-10T08:20:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-09-10T08:20:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-09-10T08:20:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.619 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.620 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.622 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:20:00.623 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-09-10T08:20:00.624 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.625 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.626 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.627 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.628 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.629 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.630 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.631 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-09-10T08:20:00.632 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.633 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.634 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.635 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T08:20:00.636 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.637 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.638 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.639 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T08:20:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T08:20:00.640 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-09-10T08:20:00.641 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.642 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.643 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.644 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T08:20:00.645 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.646 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.647 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.649 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.650 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.651 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.652 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-09-10T08:20:00.653 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.654 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.655 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.656 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T08:20:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-09-10T08:20:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-09-10T08:20:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.657 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.658 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.659 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.660 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.661 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.662 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.663 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.667 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.668 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.671 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.672 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.673 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.674 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.675 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.676 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.677 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.678 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.679 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.680 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.681 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.682 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.683 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.684 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.685 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T08:20:00.686 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T08:20:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.688 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.689 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.690 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.691 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.693 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.694 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.695 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.696 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.697 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.698 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.699 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.700 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.701 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.702 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.703 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.704 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.705 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.706 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-10T08:20:00.707 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.708 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.709 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.710 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:20:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T08:20:00.711 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T08:20:00.712 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-10T08:20:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.713 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-09-10T08:20:00.714 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-09-10T08:20:00.715 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-09-10T08:20:00.716 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.717 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.718 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.719 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.720 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.721 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.722 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.723 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.724 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.725 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-10T08:20:00.726 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-10T08:20:00.727 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-09-10T08:20:00.728 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.729 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.730 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.731 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.732 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.733 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.734 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.735 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.736 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.737 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.738 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-09-10T08:20:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.742 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.745 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.746 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.747 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.748 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.749 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.750 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.751 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.752 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-10T08:20:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-09-10T08:20:00.753 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:20:00.754 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.755 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.756 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-09-10T08:20:00.757 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.758 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.759 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.760 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.761 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.762 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.763 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.764 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.765 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.766 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.767 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.768 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.769 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.770 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.771 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.772 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.773 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.774 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.775 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.776 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.777 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.779 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.780 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.781 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.784 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-09-10T08:20:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-09-10T08:20:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-09-10T08:20:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-10T08:20:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.800 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-09-10T08:20:00.801 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-09-10T08:20:00.802 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.803 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.806 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.807 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.808 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.809 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.810 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.811 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.812 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.813 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.814 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.815 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.816 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.817 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.818 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.820 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.821 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.822 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-10T08:20:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-09-10T08:20:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-09-10T08:20:00.823 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.825 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.826 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.827 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.828 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.830 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.831 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.832 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.833 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.834 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.835 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.836 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.837 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.838 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.839 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.840 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.841 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.842 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.843 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.844 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.845 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.846 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.847 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:20:00.848 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-10T08:20:00.849 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.850 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.851 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.852 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.853 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.854 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.855 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.856 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.857 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.858 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.859 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.860 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.861 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.862 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.863 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.864 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.865 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.867 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.868 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.869 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.870 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.871 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-10T08:20:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-10T08:20:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-09-10T08:20:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.872 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.873 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-09-10T08:20:00.874 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-10T08:20:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.876 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.877 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.878 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.879 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.880 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.881 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.882 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.883 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.884 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-09-10T08:20:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-10T08:20:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.888 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.889 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.890 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.893 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.894 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.895 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.898 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.899 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.900 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.901 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.902 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.903 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.904 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.905 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.906 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.907 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.908 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.909 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.910 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.911 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.912 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.913 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.914 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.915 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.916 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.917 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.918 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.919 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.919 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.919 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.919 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.919 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.919 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.919 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.919 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.919 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-09-10T08:20:00.919 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-09-10T08:20:00.919 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-09-10T08:20:00.920 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.921 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-09-10T08:20:00.922 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-09-10T08:20:00.923 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.924 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.925 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.926 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.927 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.928 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.929 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.930 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.931 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.932 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.933 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.934 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-09-10T08:20:00.934 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.934 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.934 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.934 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.934 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.934 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.934 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.934 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.934 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.934 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.934 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.935 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.936 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.937 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.938 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-09-10T08:20:00.939 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.940 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.941 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.942 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.943 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.945 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.946 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.947 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.948 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.949 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.950 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.951 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.953 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.954 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.955 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.956 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.957 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.958 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.959 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.960 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.961 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.962 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-09-10T08:20:00.963 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-09-10T08:20:00.964 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-09-10T08:20:00.965 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.966 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.967 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.968 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.969 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.970 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.973 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.974 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.975 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.976 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.977 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.978 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.979 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.980 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.981 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.982 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:00.983 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.984 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.985 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.985 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.985 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.988 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.988 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.988 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:00.988 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:00.988 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.988 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.988 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.989 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.990 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-09-10T08:20:00.991 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-09-10T08:20:00.992 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:00.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.994 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.995 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:00.996 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.997 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:00.998 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:00.999 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-10T08:20:01.000 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-10T08:20:01.001 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:01.002 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-10T08:20:01.003 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-09-10T08:20:01.004 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-10T08:20:01.005 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-10T08:20:01.005 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-10T08:20:01.005 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T08:20:01.005 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-10T08:20:01.005 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-10T08:20:01.005 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-10T08:20:01.005 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-10T08:20:01.005 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-10T08:20:01.005 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-10T08:20:01.005 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-10T08:20:01.005 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:01.005 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: "services": { 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: "dashboard": "https://172.21.15.22:8443/" 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: "always_on_modules": { 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: "octopus": [ 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-10T08:20:01.006 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "pacific": [ 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-10T08:20:01.007 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: "quincy": [ 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:01.008 INFO:teuthology.orchestra.run.smithi022.stdout: "reef": [ 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "squid": [ 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-10T08:20:01.009 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: "last_failure_osd_epoch": 84, 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: "active_clients": [ 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-10T08:20:01.010 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2465830835 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "libcephsqlite", 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-10T08:20:01.011 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 757048989 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1073191654 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-10T08:20:01.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1415810628 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-10T08:20:01.013 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1292487520 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3102394576 2024-09-10T08:20:01.014 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:01.015 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-10T08:20:01.015 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:01.015 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-10T08:20:01.015 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:20:01.016 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:00 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3170454036' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T08:20:01.016 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:00 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2847686449' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T08:20:01.016 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:00 smithi153 ceph-mon[35609]: overall HEALTH_OK 2024-09-10T08:20:01.016 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:00 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3170454036' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T08:20:01.017 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:00 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2847686449' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T08:20:01.017 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:00 smithi100 ceph-mon[35102]: overall HEALTH_OK 2024-09-10T08:20:01.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.662+0000 7ff15ce2e640 1 -- 172.21.15.22:0/2847686449 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7ff1400a2dc0 msgr2=0x7ff1400a5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.662+0000 7ff15ce2e640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7ff1400a2dc0 0x7ff1400a5280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff148009850 tx=0x7ff14800b040 comp rx=0 tx=0).stop 2024-09-10T08:20:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.662+0000 7ff15ce2e640 1 -- 172.21.15.22:0/2847686449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1581069b0 msgr2=0x7ff15819bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.662+0000 7ff15ce2e640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1581069b0 0x7ff15819bad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff150009fd0 tx=0x7ff15000b690 comp rx=0 tx=0).stop 2024-09-10T08:20:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.662+0000 7ff15ce2e640 1 -- 172.21.15.22:0/2847686449 shutdown_connections 2024-09-10T08:20:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.662+0000 7ff15ce2e640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7ff1400a2dc0 0x7ff1400a5280 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.662+0000 7ff15ce2e640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1581069b0 0x7ff15819bad0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.662+0000 7ff15ce2e640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff158101340 0x7ff158197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.662+0000 7ff15ce2e640 1 --2- 172.21.15.22:0/2847686449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1581009a0 0x7ff158197210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.662+0000 7ff15ce2e640 1 -- 172.21.15.22:0/2847686449 >> 172.21.15.22:0/2847686449 conn(0x7ff1580fc6a0 msgr2=0x7ff1580fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.663+0000 7ff15ce2e640 1 -- 172.21.15.22:0/2847686449 shutdown_connections 2024-09-10T08:20:01.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:19:59.663+0000 7ff15ce2e640 1 -- 172.21.15.22:0/2847686449 wait complete. 2024-09-10T08:20:01.085 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T08:20:01.085 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T08:20:01.085 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:00 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3170454036' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-10T08:20:01.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:00 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2847686449' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-10T08:20:01.086 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:00 smithi022 ceph-mon[30854]: overall HEALTH_OK 2024-09-10T08:20:01.346 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:20:01.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:01 smithi100 ceph-mon[35102]: pgmap v349: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 KiB/s wr, 38 op/s 2024-09-10T08:20:01.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:01 smithi153 ceph-mon[35609]: pgmap v349: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 KiB/s wr, 38 op/s 2024-09-10T08:20:01.467 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:01 smithi022 ceph-mon[30854]: pgmap v349: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 KiB/s wr, 38 op/s 2024-09-10T08:20:02.252 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:20:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:20:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 345, 2024-09-10T08:20:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 533, 2024-09-10T08:20:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 129960, 2024-09-10T08:20:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 166506, 2024-09-10T08:20:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 10, 2024-09-10T08:20:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-10T08:20:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.068172856, 2024-09-10T08:20:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.024100186, 2024-09-10T08:20:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.034485758, 2024-09-10T08:20:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.006283755, 2024-09-10T08:20:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 529, 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.087354548, 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000165131 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 833, 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000364432, 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000437 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:20:02.254 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 84, 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 113, 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 56796, 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 233982, 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 15, 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 6, 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.017813548, 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.004187788, 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.012345027, 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000203992, 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 111, 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.026018532, 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000234401 2024-09-10T08:20:02.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 133, 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000045443, 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000341 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 5008, 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 126096 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 413, 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 527, 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1633367, 2024-09-10T08:20:02.256 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 575083, 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 8, 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 6, 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.073077446, 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.032470656, 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.055265138, 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000231784, 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 528, 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.165672952, 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000313774 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 223, 2024-09-10T08:20:02.257 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000092966, 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000416 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 1531504, 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 470304 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 1, 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-MDSRank": { 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-10T08:20:02.258 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 48, 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.001383162, 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000028815 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-PurgeQueue": { 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2, 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000010179, 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000005089 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.259 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": { 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: "request": 0, 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: "reply": 0, 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: "reply_latency": { 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_reply": 0, 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: "forward": 0, 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_complete": 0, 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_keys": 0, 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_commit": 11, 2024-09-10T08:20:02.260 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_split": 0, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_merge": 0, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes": 10, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_top": 0, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_bottom": 10, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pin_tail": 0, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pinned": 10, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_expired": 0, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_with_caps": 0, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": 0, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "subtrees": 1, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse": 0, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_hit": 0, 2024-09-10T08:20:02.261 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_forward": 0, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_discover": 0, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_remote_ino": 0, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_lock": 0, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "load_cent": 2000, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "q": 2, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "exported": 0, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "exported_inodes": 0, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "imported": 0, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "imported_inodes": 0, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_dir_fetch": 0, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_backtrace_fetch": 0, 2024-09-10T08:20:02.262 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_peer_discover": 0, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rfiles": 22, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rbytes": 10738141007, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rsnaps": 3, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_set_tag": 0, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_inodes": 0, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_file_inodes": 0, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:20:02.263 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_grant": 0, 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps": 0, 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps_dirty": 0, 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_cap_release": 0, 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "process_request_cap_release": 0 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache": { 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update": 0, 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update_receipt": 0, 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_try_discover": 0, 2024-09-10T08:20:02.264 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_send_discover": 1, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_handle_discover": 0, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays": 0, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_delayed": 0, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_created": 0, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_enqueued": 0, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_reintegrated": 0, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_migrated": 0, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_processing": 0, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_started": 0, 2024-09-10T08:20:02.265 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_completed": 0, 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_exportdir": 0, 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_flush": 0, 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragstats": 0, 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_inodestats": 0 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log": { 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: "evlrg": 0, 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: "evadd": 6, 2024-09-10T08:20:02.266 INFO:teuthology.orchestra.run.smithi022.stdout: "evex": 0, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "evtrm": 0, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "ev": 6, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "evexg": 0, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "evexd": 0, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "segadd": 2, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "segex": 0, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "segtrm": 0, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "seg": 2, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "segmjr": 2, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "segexg": 0, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "segexd": 0, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "expos": 4194304, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "wrpos": 4195960, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rdpos": 0, 2024-09-10T08:20:02.267 INFO:teuthology.orchestra.run.smithi022.stdout: "jlat": { 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 5, 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.012448637, 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.002489727 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: "replayed": 0 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_mem": { 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: "ino": 13, 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: "ino+": 13, 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: "ino-": 0, 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: "dir": 11, 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: "dir+": 12, 2024-09-10T08:20:02.268 INFO:teuthology.orchestra.run.smithi022.stdout: "dir-": 1, 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "dn": 10, 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "dn+": 10, 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "dn-": 0, 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "cap": 0, 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "cap+": 0, 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "cap-": 0, 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rss": 50788, 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "heap": 223520 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_server": { 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_client_request": 0, 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_server_request": 0, 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_request": 0, 2024-09-10T08:20:02.269 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_session": 8, 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_peer_request": 0, 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: "req_create_latency": { 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getattr_latency": { 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getfilelock_latency": { 2024-09-10T08:20:02.270 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: "req_link_latency": { 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookup_latency": { 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.271 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookuphash_latency": { 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupino_latency": { 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupname_latency": { 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.273 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupparent_latency": { 2024-09-10T08:20:02.273 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.273 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.273 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.273 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupsnap_latency": { 2024-09-10T08:20:02.273 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.273 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.273 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.273 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lssnap_latency": { 2024-09-10T08:20:02.273 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mkdir_latency": { 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mknod_latency": { 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.274 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mksnap_latency": { 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: "req_open_latency": { 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: "req_readdir_latency": { 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.275 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rename_latency": { 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: "req_renamesnap_latency": { 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: "req_snapdiff_latency": { 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.276 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmdir_latency": { 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmsnap_latency": { 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmxattr_latency": { 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.277 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setattr_latency": { 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setdirlayout_latency": { 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setfilelock_latency": { 2024-09-10T08:20:02.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setlayout_latency": { 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setxattr_latency": { 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.279 INFO:teuthology.orchestra.run.smithi022.stdout: "req_symlink_latency": { 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: "req_unlink_latency": { 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getvxattr_latency": { 2024-09-10T08:20:02.280 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_sessions": { 2024-09-10T08:20:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: "session_count": 0, 2024-09-10T08:20:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: "session_add": 2, 2024-09-10T08:20:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: "session_remove": 2, 2024-09-10T08:20:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_open": 0, 2024-09-10T08:20:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_stale": 0, 2024-09-10T08:20:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: "total_load": 0, 2024-09-10T08:20:02.281 INFO:teuthology.orchestra.run.smithi022.stdout: "average_load": 0, 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "avg_session_uptime": 88, 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "mdthresh_evicted": 0 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:20:02.282 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:20:02.283 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:20:02.284 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 254343, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 84, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 8224, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 181, 2024-09-10T08:20:02.285 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 50872, 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 198, 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter": { 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "op_active": 0, 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "op_laggy": 0, 2024-09-10T08:20:02.286 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send": 41, 2024-09-10T08:20:02.287 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send_bytes": 11958, 2024-09-10T08:20:02.287 INFO:teuthology.orchestra.run.smithi022.stdout: "op_resend": 33, 2024-09-10T08:20:02.287 INFO:teuthology.orchestra.run.smithi022.stdout: "op_reply": 41, 2024-09-10T08:20:02.287 INFO:teuthology.orchestra.run.smithi022.stdout: "op_latency": { 2024-09-10T08:20:02.287 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 41, 2024-09-10T08:20:02.287 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.243996552, 2024-09-10T08:20:02.287 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.005951135 2024-09-10T08:20:02.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.287 INFO:teuthology.orchestra.run.smithi022.stdout: "op_inflight": 0, 2024-09-10T08:20:02.287 INFO:teuthology.orchestra.run.smithi022.stdout: "oplen_avg": { 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 41, 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 63 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: "op": 41, 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: "op_r": 0, 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: "op_w": 41, 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: "op_rmw": 0, 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: "op_pg": 0, 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_stat": 0, 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_create": 10, 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_read": 0, 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_write": 5, 2024-09-10T08:20:02.288 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writefull": 7, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writesame": 0, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_append": 0, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_zero": 0, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_truncate": 0, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_delete": 6, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_mapext": 0, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_sparse_read": 0, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_clonerange": 0, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_getxattr": 0, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_setxattr": 20, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_rmxattr": 0, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:20:02.289 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_call": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_watch": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_notify": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_other": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_active": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_send": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_resend": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_ping": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_active": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_send": 0, 2024-09-10T08:20:02.290 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_resend": 0, 2024-09-10T08:20:02.291 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_active": 0, 2024-09-10T08:20:02.291 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_send": 0, 2024-09-10T08:20:02.291 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_resend": 0, 2024-09-10T08:20:02.291 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_active": 0, 2024-09-10T08:20:02.291 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_send": 0, 2024-09-10T08:20:02.291 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_resend": 0, 2024-09-10T08:20:02.291 INFO:teuthology.orchestra.run.smithi022.stdout: "command_active": 0, 2024-09-10T08:20:02.291 INFO:teuthology.orchestra.run.smithi022.stdout: "command_send": 0, 2024-09-10T08:20:02.291 INFO:teuthology.orchestra.run.smithi022.stdout: "command_resend": 0, 2024-09-10T08:20:02.291 INFO:teuthology.orchestra.run.smithi022.stdout: "map_epoch": 94, 2024-09-10T08:20:02.291 INFO:teuthology.orchestra.run.smithi022.stdout: "map_full": 0, 2024-09-10T08:20:02.291 INFO:teuthology.orchestra.run.smithi022.stdout: "map_inc": 11, 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_sessions": 9, 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_open": 9, 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_close": 0, 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_laggy": 0, 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_wr": 14, 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_rd": 0, 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_del": 1 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: "oft": { 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_objs": 1, 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_updates": 0, 2024-09-10T08:20:02.292 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_removes": 0 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: "osd-slow-ops": { 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_ops_count": 0 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: "purge_queue": { 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops": 0, 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing": 0, 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_high_water": 0, 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed_ops": 0, 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed": 0, 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_item_in_journal": 0 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.293 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 838, 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 1727162, 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 838, 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 838, 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1727162, 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.294 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_bytes": { 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 41, 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 11958, 2024-09-10T08:20:02.295 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 41, 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 11958, 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_ops": { 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 1024, 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-10T08:20:02.296 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 41, 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 41, 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 41, 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 41, 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:20:02.297 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 0, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 0, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.298 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle-0x55fc44532960": { 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 6, 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 1656, 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 6, 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 5, 2024-09-10T08:20:02.299 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1656, 2024-09-10T08:20:02.300 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-10T08:20:02.300 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:02.300 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:02.300 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:02.300 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:02.300 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:02.300 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:20:03.246 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-10T08:20:03.246 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-10T08:20:03.246 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=3 2024-09-10T08:20:03.247 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-09-10T08:20:03.247 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T08:20:03.247 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T08:20:03.247 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T08:20:03.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:03 smithi100 ceph-mon[35102]: pgmap v350: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 47 KiB/s wr, 69 op/s 2024-09-10T08:20:03.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:03 smithi153 ceph-mon[35609]: pgmap v350: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 47 KiB/s wr, 69 op/s 2024-09-10T08:20:03.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:03 smithi022 ceph-mon[30854]: pgmap v350: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 47 KiB/s wr, 69 op/s 2024-09-10T08:20:03.505 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:20:04.006 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:20:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:20:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-09-10T08:20:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-09-10T08:20:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-09-10T08:20:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-09-10T08:20:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-10T08:20:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-10T08:20:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.001180533, 2024-09-10T08:20:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T08:20:04.006 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000138330, 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T08:20:04.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 2, 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 169, 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 320, 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 186880, 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 5, 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.018234643, 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.011461050, 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.002114018, 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 166, 2024-09-10T08:20:04.008 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.021578924, 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000129993 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 186880 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 235, 2024-09-10T08:20:04.009 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 223, 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1448544, 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 136192, 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.054235533, 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.018219585, 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.049781646, 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 223, 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.034247411, 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000153575 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:04.010 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 1448544, 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 136192 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-10T08:20:04.011 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:20:04.012 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:20:04.013 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148994, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 31, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-10T08:20:04.014 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:20:04.015 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 233, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 1412970, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 233, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 233, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1412970, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:04.016 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:04.017 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:20:04.681 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T08:20:04.681 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T08:20:04.681 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-10T08:20:04.681 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-10T08:20:04.682 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-10T08:20:04.682 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T08:20:04.682 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T08:20:04.946 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:20:05.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:05 smithi100 ceph-mon[35102]: pgmap v351: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 72 KiB/s wr, 249 op/s 2024-09-10T08:20:05.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:05 smithi153 ceph-mon[35609]: pgmap v351: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 72 KiB/s wr, 249 op/s 2024-09-10T08:20:05.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:05 smithi022 ceph-mon[30854]: pgmap v351: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 72 KiB/s wr, 249 op/s 2024-09-10T08:20:07.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:07 smithi100 ceph-mon[35102]: pgmap v352: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 72 KiB/s wr, 246 op/s 2024-09-10T08:20:07.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:07 smithi153 ceph-mon[35609]: pgmap v352: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 72 KiB/s wr, 246 op/s 2024-09-10T08:20:07.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:07 smithi022 ceph-mon[30854]: pgmap v352: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 72 KiB/s wr, 246 op/s 2024-09-10T08:20:09.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:09 smithi022 ceph-mon[30854]: pgmap v353: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 72 KiB/s wr, 247 op/s 2024-09-10T08:20:09.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:09 smithi100 ceph-mon[35102]: pgmap v353: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 72 KiB/s wr, 247 op/s 2024-09-10T08:20:09.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:09 smithi153 ceph-mon[35609]: pgmap v353: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 72 KiB/s wr, 247 op/s 2024-09-10T08:20:09.539 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:20:09.539 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:20:09.539 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1030, 2024-09-10T08:20:09.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 1013, 2024-09-10T08:20:09.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1776544, 2024-09-10T08:20:09.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 384314, 2024-09-10T08:20:09.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 5, 2024-09-10T08:20:09.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-10T08:20:09.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.212084128, 2024-09-10T08:20:09.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.063988393, 2024-09-10T08:20:09.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.078780010, 2024-09-10T08:20:09.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.071547072, 2024-09-10T08:20:09.540 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:09.540 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1012, 2024-09-10T08:20:09.540 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.226102997, 2024-09-10T08:20:09.541 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000223421 2024-09-10T08:20:09.541 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:09.541 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.541 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.541 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.541 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 1514800, 2024-09-10T08:20:09.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 136592 2024-09-10T08:20:09.541 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.541 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:20:09.541 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1465, 2024-09-10T08:20:09.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 1628, 2024-09-10T08:20:09.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 376410, 2024-09-10T08:20:09.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 921651, 2024-09-10T08:20:09.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 7, 2024-09-10T08:20:09.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 5, 2024-09-10T08:20:09.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.245021162, 2024-09-10T08:20:09.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.042913013, 2024-09-10T08:20:09.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.041398359, 2024-09-10T08:20:09.542 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.095165496, 2024-09-10T08:20:09.543 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:09.543 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1626, 2024-09-10T08:20:09.543 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.233710685, 2024-09-10T08:20:09.543 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000143733 2024-09-10T08:20:09.543 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.543 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:09.543 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.543 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.543 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.543 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.543 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T08:20:09.544 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 457632 2024-09-10T08:20:09.544 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.544 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:20:09.544 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 4, 2024-09-10T08:20:09.544 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 6, 2024-09-10T08:20:09.544 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1629, 2024-09-10T08:20:09.544 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 1284, 2024-09-10T08:20:09.544 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 5, 2024-09-10T08:20:09.544 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 4, 2024-09-10T08:20:09.544 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.001347249, 2024-09-10T08:20:09.544 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000073217, 2024-09-10T08:20:09.544 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.001084631, 2024-09-10T08:20:09.545 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000082001, 2024-09-10T08:20:09.545 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:09.545 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 4, 2024-09-10T08:20:09.545 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.002214324, 2024-09-10T08:20:09.545 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000553581 2024-09-10T08:20:09.545 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.545 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:09.545 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.545 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.546 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.546 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.546 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T08:20:09.546 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T08:20:09.546 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.546 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-10T08:20:09.547 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 1, 2024-09-10T08:20:09.547 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-10T08:20:09.547 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.547 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-MDSRank": { 2024-09-10T08:20:09.548 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-10T08:20:09.548 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-10T08:20:09.548 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 3728, 2024-09-10T08:20:09.548 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.124360813, 2024-09-10T08:20:09.548 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000033358 2024-09-10T08:20:09.549 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:09.549 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.549 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-PurgeQueue": { 2024-09-10T08:20:09.549 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-10T08:20:09.549 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-10T08:20:09.549 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.549 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.550 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.550 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:09.550 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.550 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": { 2024-09-10T08:20:09.550 INFO:teuthology.orchestra.run.smithi022.stdout: "request": 0, 2024-09-10T08:20:09.550 INFO:teuthology.orchestra.run.smithi022.stdout: "reply": 0, 2024-09-10T08:20:09.550 INFO:teuthology.orchestra.run.smithi022.stdout: "reply_latency": { 2024-09-10T08:20:09.550 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.550 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.550 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.550 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.550 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_reply": 0, 2024-09-10T08:20:09.551 INFO:teuthology.orchestra.run.smithi022.stdout: "forward": 0, 2024-09-10T08:20:09.551 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_complete": 0, 2024-09-10T08:20:09.551 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_keys": 0, 2024-09-10T08:20:09.551 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_commit": 0, 2024-09-10T08:20:09.551 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_split": 0, 2024-09-10T08:20:09.551 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_merge": 0, 2024-09-10T08:20:09.551 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes": 0, 2024-09-10T08:20:09.551 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_top": 0, 2024-09-10T08:20:09.551 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_bottom": 0, 2024-09-10T08:20:09.551 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pin_tail": 0, 2024-09-10T08:20:09.551 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pinned": 0, 2024-09-10T08:20:09.552 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_expired": 0, 2024-09-10T08:20:09.552 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_with_caps": 0, 2024-09-10T08:20:09.552 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": 0, 2024-09-10T08:20:09.553 INFO:teuthology.orchestra.run.smithi022.stdout: "subtrees": 1, 2024-09-10T08:20:09.553 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse": 0, 2024-09-10T08:20:09.553 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_hit": 0, 2024-09-10T08:20:09.553 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_forward": 0, 2024-09-10T08:20:09.553 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_discover": 0, 2024-09-10T08:20:09.553 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:20:09.553 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_remote_ino": 0, 2024-09-10T08:20:09.553 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_lock": 0, 2024-09-10T08:20:09.553 INFO:teuthology.orchestra.run.smithi022.stdout: "load_cent": 0, 2024-09-10T08:20:09.553 INFO:teuthology.orchestra.run.smithi022.stdout: "q": 0, 2024-09-10T08:20:09.554 INFO:teuthology.orchestra.run.smithi022.stdout: "exported": 0, 2024-09-10T08:20:09.554 INFO:teuthology.orchestra.run.smithi022.stdout: "exported_inodes": 0, 2024-09-10T08:20:09.554 INFO:teuthology.orchestra.run.smithi022.stdout: "imported": 0, 2024-09-10T08:20:09.554 INFO:teuthology.orchestra.run.smithi022.stdout: "imported_inodes": 0, 2024-09-10T08:20:09.554 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_dir_fetch": 0, 2024-09-10T08:20:09.554 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_backtrace_fetch": 0, 2024-09-10T08:20:09.554 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_peer_discover": 0, 2024-09-10T08:20:09.554 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rfiles": 0, 2024-09-10T08:20:09.554 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rbytes": 0, 2024-09-10T08:20:09.554 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rsnaps": 0, 2024-09-10T08:20:09.554 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_set_tag": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_inodes": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_file_inodes": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_grant": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:20:09.555 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:20:09.556 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps": 0, 2024-09-10T08:20:09.556 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps_dirty": 0, 2024-09-10T08:20:09.556 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_cap_release": 0, 2024-09-10T08:20:09.556 INFO:teuthology.orchestra.run.smithi022.stdout: "process_request_cap_release": 0 2024-09-10T08:20:09.556 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.556 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache": { 2024-09-10T08:20:09.556 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update": 0, 2024-09-10T08:20:09.556 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update_receipt": 0, 2024-09-10T08:20:09.556 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_try_discover": 0, 2024-09-10T08:20:09.556 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_send_discover": 0, 2024-09-10T08:20:09.556 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_handle_discover": 0, 2024-09-10T08:20:09.556 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_delayed": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_created": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_enqueued": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_reintegrated": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_migrated": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_processing": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_started": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_completed": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:20:09.557 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_exportdir": 0, 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_flush": 0, 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragstats": 0, 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_inodestats": 0 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log": { 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: "evlrg": 0, 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: "evadd": 0, 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: "evex": 0, 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: "evtrm": 0, 2024-09-10T08:20:09.558 INFO:teuthology.orchestra.run.smithi022.stdout: "ev": 6, 2024-09-10T08:20:09.559 INFO:teuthology.orchestra.run.smithi022.stdout: "evexg": 0, 2024-09-10T08:20:09.559 INFO:teuthology.orchestra.run.smithi022.stdout: "evexd": 0, 2024-09-10T08:20:09.559 INFO:teuthology.orchestra.run.smithi022.stdout: "segadd": 0, 2024-09-10T08:20:09.559 INFO:teuthology.orchestra.run.smithi022.stdout: "segex": 0, 2024-09-10T08:20:09.559 INFO:teuthology.orchestra.run.smithi022.stdout: "segtrm": 0, 2024-09-10T08:20:09.559 INFO:teuthology.orchestra.run.smithi022.stdout: "seg": 2, 2024-09-10T08:20:09.559 INFO:teuthology.orchestra.run.smithi022.stdout: "segmjr": 2, 2024-09-10T08:20:09.559 INFO:teuthology.orchestra.run.smithi022.stdout: "segexg": 0, 2024-09-10T08:20:09.559 INFO:teuthology.orchestra.run.smithi022.stdout: "segexd": 0, 2024-09-10T08:20:09.559 INFO:teuthology.orchestra.run.smithi022.stdout: "expos": 4194304, 2024-09-10T08:20:09.559 INFO:teuthology.orchestra.run.smithi022.stdout: "wrpos": 4195960, 2024-09-10T08:20:09.560 INFO:teuthology.orchestra.run.smithi022.stdout: "rdpos": 4195819, 2024-09-10T08:20:09.560 INFO:teuthology.orchestra.run.smithi022.stdout: "jlat": { 2024-09-10T08:20:09.560 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.560 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.560 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.560 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.560 INFO:teuthology.orchestra.run.smithi022.stdout: "replayed": 6 2024-09-10T08:20:09.560 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.560 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_mem": { 2024-09-10T08:20:09.560 INFO:teuthology.orchestra.run.smithi022.stdout: "ino": 3, 2024-09-10T08:20:09.560 INFO:teuthology.orchestra.run.smithi022.stdout: "ino+": 3, 2024-09-10T08:20:09.560 INFO:teuthology.orchestra.run.smithi022.stdout: "ino-": 0, 2024-09-10T08:20:09.561 INFO:teuthology.orchestra.run.smithi022.stdout: "dir": 1, 2024-09-10T08:20:09.561 INFO:teuthology.orchestra.run.smithi022.stdout: "dir+": 1, 2024-09-10T08:20:09.561 INFO:teuthology.orchestra.run.smithi022.stdout: "dir-": 0, 2024-09-10T08:20:09.561 INFO:teuthology.orchestra.run.smithi022.stdout: "dn": 0, 2024-09-10T08:20:09.561 INFO:teuthology.orchestra.run.smithi022.stdout: "dn+": 0, 2024-09-10T08:20:09.561 INFO:teuthology.orchestra.run.smithi022.stdout: "dn-": 0, 2024-09-10T08:20:09.561 INFO:teuthology.orchestra.run.smithi022.stdout: "cap": 0, 2024-09-10T08:20:09.561 INFO:teuthology.orchestra.run.smithi022.stdout: "cap+": 0, 2024-09-10T08:20:09.561 INFO:teuthology.orchestra.run.smithi022.stdout: "cap-": 0, 2024-09-10T08:20:09.561 INFO:teuthology.orchestra.run.smithi022.stdout: "rss": 48656, 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: "heap": 215328 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_server": { 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_client_request": 0, 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_server_request": 0, 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_request": 0, 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_session": 0, 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_peer_request": 0, 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: "req_create_latency": { 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.562 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.563 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getattr_latency": { 2024-09-10T08:20:09.563 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.563 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.563 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.564 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.564 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getfilelock_latency": { 2024-09-10T08:20:09.564 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.564 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.564 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.564 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.564 INFO:teuthology.orchestra.run.smithi022.stdout: "req_link_latency": { 2024-09-10T08:20:09.564 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.564 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.564 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.564 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.564 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookup_latency": { 2024-09-10T08:20:09.565 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.565 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.565 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.565 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.565 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookuphash_latency": { 2024-09-10T08:20:09.565 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.565 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.565 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.565 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.566 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupino_latency": { 2024-09-10T08:20:09.566 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.566 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.566 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.566 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.566 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupname_latency": { 2024-09-10T08:20:09.566 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.566 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.566 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.566 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.566 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupparent_latency": { 2024-09-10T08:20:09.566 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.567 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.567 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.567 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.567 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupsnap_latency": { 2024-09-10T08:20:09.567 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.567 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.568 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.568 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.568 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lssnap_latency": { 2024-09-10T08:20:09.568 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.568 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.568 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.569 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.569 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mkdir_latency": { 2024-09-10T08:20:09.569 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.569 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.569 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.569 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.569 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mknod_latency": { 2024-09-10T08:20:09.569 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.569 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.570 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.570 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.570 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mksnap_latency": { 2024-09-10T08:20:09.570 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.570 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.570 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.570 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.570 INFO:teuthology.orchestra.run.smithi022.stdout: "req_open_latency": { 2024-09-10T08:20:09.570 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.571 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.571 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.571 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.571 INFO:teuthology.orchestra.run.smithi022.stdout: "req_readdir_latency": { 2024-09-10T08:20:09.571 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.571 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.571 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.571 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.571 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rename_latency": { 2024-09-10T08:20:09.571 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.571 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.571 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.572 INFO:teuthology.orchestra.run.smithi022.stdout: "req_renamesnap_latency": { 2024-09-10T08:20:09.572 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.572 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.572 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.572 INFO:teuthology.orchestra.run.smithi022.stdout: "req_snapdiff_latency": { 2024-09-10T08:20:09.572 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.572 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.572 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.573 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmdir_latency": { 2024-09-10T08:20:09.573 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.573 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.573 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.573 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.573 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmsnap_latency": { 2024-09-10T08:20:09.573 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.573 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.573 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.573 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.574 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmxattr_latency": { 2024-09-10T08:20:09.574 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.574 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.574 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.574 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.574 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setattr_latency": { 2024-09-10T08:20:09.574 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.574 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.574 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.574 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.575 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setdirlayout_latency": { 2024-09-10T08:20:09.575 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.575 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.575 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.575 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.575 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setfilelock_latency": { 2024-09-10T08:20:09.575 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.575 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.575 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.575 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.575 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setlayout_latency": { 2024-09-10T08:20:09.575 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.576 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.576 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.576 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.576 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setxattr_latency": { 2024-09-10T08:20:09.576 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.576 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.576 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.576 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.576 INFO:teuthology.orchestra.run.smithi022.stdout: "req_symlink_latency": { 2024-09-10T08:20:09.576 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.576 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.577 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.577 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.577 INFO:teuthology.orchestra.run.smithi022.stdout: "req_unlink_latency": { 2024-09-10T08:20:09.577 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.577 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.577 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.577 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.577 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:20:09.577 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:20:09.577 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getvxattr_latency": { 2024-09-10T08:20:09.577 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.577 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.578 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.578 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:09.578 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.578 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_sessions": { 2024-09-10T08:20:09.578 INFO:teuthology.orchestra.run.smithi022.stdout: "session_count": 0, 2024-09-10T08:20:09.578 INFO:teuthology.orchestra.run.smithi022.stdout: "session_add": 2, 2024-09-10T08:20:09.578 INFO:teuthology.orchestra.run.smithi022.stdout: "session_remove": 2, 2024-09-10T08:20:09.578 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_open": 2, 2024-09-10T08:20:09.578 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_stale": 0, 2024-09-10T08:20:09.578 INFO:teuthology.orchestra.run.smithi022.stdout: "total_load": 0, 2024-09-10T08:20:09.578 INFO:teuthology.orchestra.run.smithi022.stdout: "average_load": 0, 2024-09-10T08:20:09.579 INFO:teuthology.orchestra.run.smithi022.stdout: "avg_session_uptime": 1123, 2024-09-10T08:20:09.579 INFO:teuthology.orchestra.run.smithi022.stdout: "mdthresh_evicted": 0 2024-09-10T08:20:09.579 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.579 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-10T08:20:09.579 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:20:09.579 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-10T08:20:09.579 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:20:09.579 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:20:09.579 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:20:09.580 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-10T08:20:09.581 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 197513, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 56, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-10T08:20:09.582 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 8224, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 181, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 8512, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 13, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-10T08:20:09.583 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-10T08:20:09.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.584 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter": { 2024-09-10T08:20:09.584 INFO:teuthology.orchestra.run.smithi022.stdout: "op_active": 0, 2024-09-10T08:20:09.584 INFO:teuthology.orchestra.run.smithi022.stdout: "op_laggy": 0, 2024-09-10T08:20:09.584 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send": 2242, 2024-09-10T08:20:09.584 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send_bytes": 21, 2024-09-10T08:20:09.584 INFO:teuthology.orchestra.run.smithi022.stdout: "op_resend": 3, 2024-09-10T08:20:09.584 INFO:teuthology.orchestra.run.smithi022.stdout: "op_reply": 2242, 2024-09-10T08:20:09.584 INFO:teuthology.orchestra.run.smithi022.stdout: "op_latency": { 2024-09-10T08:20:09.584 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2242, 2024-09-10T08:20:09.584 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 5.300924606, 2024-09-10T08:20:09.584 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.002364373 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: "op_inflight": 0, 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: "oplen_avg": { 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2242, 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 2243 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: "op": 2242, 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: "op_r": 2242, 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: "op_w": 0, 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: "op_rmw": 0, 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: "op_pg": 0, 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_stat": 1455, 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_create": 0, 2024-09-10T08:20:09.585 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_read": 785, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_write": 0, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writefull": 0, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writesame": 0, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_append": 0, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_zero": 0, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_truncate": 0, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_delete": 0, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_mapext": 0, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_sparse_read": 0, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_clonerange": 0, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_getxattr": 1, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_setxattr": 0, 2024-09-10T08:20:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:20:09.587 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_rmxattr": 0, 2024-09-10T08:20:09.587 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:20:09.587 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_call": 0, 2024-09-10T08:20:09.587 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_watch": 0, 2024-09-10T08:20:09.587 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_notify": 0, 2024-09-10T08:20:09.587 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:20:09.587 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls": 0, 2024-09-10T08:20:09.587 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:20:09.587 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_other": 0, 2024-09-10T08:20:09.587 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_active": 0, 2024-09-10T08:20:09.587 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_send": 0, 2024-09-10T08:20:09.588 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_resend": 0, 2024-09-10T08:20:09.588 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_ping": 0, 2024-09-10T08:20:09.588 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_active": 0, 2024-09-10T08:20:09.588 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_send": 0, 2024-09-10T08:20:09.588 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_resend": 0, 2024-09-10T08:20:09.589 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_active": 0, 2024-09-10T08:20:09.589 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_send": 0, 2024-09-10T08:20:09.589 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_resend": 0, 2024-09-10T08:20:09.589 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_active": 0, 2024-09-10T08:20:09.589 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_send": 0, 2024-09-10T08:20:09.589 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_resend": 0, 2024-09-10T08:20:09.589 INFO:teuthology.orchestra.run.smithi022.stdout: "command_active": 0, 2024-09-10T08:20:09.589 INFO:teuthology.orchestra.run.smithi022.stdout: "command_send": 0, 2024-09-10T08:20:09.589 INFO:teuthology.orchestra.run.smithi022.stdout: "command_resend": 0, 2024-09-10T08:20:09.590 INFO:teuthology.orchestra.run.smithi022.stdout: "map_epoch": 94, 2024-09-10T08:20:09.590 INFO:teuthology.orchestra.run.smithi022.stdout: "map_full": 0, 2024-09-10T08:20:09.590 INFO:teuthology.orchestra.run.smithi022.stdout: "map_inc": 11, 2024-09-10T08:20:09.590 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_sessions": 6, 2024-09-10T08:20:09.590 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_open": 6, 2024-09-10T08:20:09.590 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_close": 0, 2024-09-10T08:20:09.590 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_laggy": 0, 2024-09-10T08:20:09.590 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_wr": 0, 2024-09-10T08:20:09.591 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_rd": 2, 2024-09-10T08:20:09.591 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_del": 0 2024-09-10T08:20:09.591 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.591 INFO:teuthology.orchestra.run.smithi022.stdout: "oft": { 2024-09-10T08:20:09.591 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_objs": 0, 2024-09-10T08:20:09.591 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:20:09.591 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_updates": 0, 2024-09-10T08:20:09.591 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_removes": 0 2024-09-10T08:20:09.591 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.592 INFO:teuthology.orchestra.run.smithi022.stdout: "osd-slow-ops": { 2024-09-10T08:20:09.592 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_ops_count": 0 2024-09-10T08:20:09.592 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.592 INFO:teuthology.orchestra.run.smithi022.stdout: "purge_queue": { 2024-09-10T08:20:09.592 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops": 0, 2024-09-10T08:20:09.592 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T08:20:09.592 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing": 0, 2024-09-10T08:20:09.592 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_high_water": 0, 2024-09-10T08:20:09.592 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed_ops": 0, 2024-09-10T08:20:09.593 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed": 0, 2024-09-10T08:20:09.593 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_item_in_journal": 0 2024-09-10T08:20:09.593 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.593 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:20:09.593 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-10T08:20:09.593 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-10T08:20:09.593 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-10T08:20:09.593 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 2495, 2024-09-10T08:20:09.594 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 1914192, 2024-09-10T08:20:09.594 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:09.594 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 2495, 2024-09-10T08:20:09.594 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-10T08:20:09.594 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-10T08:20:09.594 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 2495, 2024-09-10T08:20:09.594 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1914192, 2024-09-10T08:20:09.594 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-10T08:20:09.594 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.595 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.595 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.595 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:09.595 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.595 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_bytes": { 2024-09-10T08:20:09.595 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-10T08:20:09.595 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-10T08:20:09.595 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-10T08:20:09.595 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-10T08:20:09.595 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-10T08:20:09.596 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:09.596 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:09.596 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 2242, 2024-09-10T08:20:09.596 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 1661, 2024-09-10T08:20:09.596 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 2242, 2024-09-10T08:20:09.596 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1661, 2024-09-10T08:20:09.596 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-10T08:20:09.596 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.597 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.597 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.597 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:09.597 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.597 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_ops": { 2024-09-10T08:20:09.597 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-10T08:20:09.597 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 1024, 2024-09-10T08:20:09.597 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-10T08:20:09.598 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-10T08:20:09.598 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-10T08:20:09.598 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:09.598 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:09.598 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 2242, 2024-09-10T08:20:09.598 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 2242, 2024-09-10T08:20:09.598 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 2242, 2024-09-10T08:20:09.598 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 2242, 2024-09-10T08:20:09.598 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-10T08:20:09.599 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.599 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.599 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.599 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:09.599 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.599 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:20:09.599 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-10T08:20:09.599 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-10T08:20:09.600 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-10T08:20:09.600 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-10T08:20:09.600 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-10T08:20:09.600 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:09.600 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:09.600 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-10T08:20:09.600 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-10T08:20:09.600 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 0, 2024-09-10T08:20:09.600 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 0, 2024-09-10T08:20:09.600 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-10T08:20:09.600 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.601 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.601 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.601 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:09.601 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:09.601 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle-0x563f39f30b40": { 2024-09-10T08:20:09.601 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-10T08:20:09.601 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-10T08:20:09.601 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-10T08:20:09.601 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-10T08:20:09.601 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-10T08:20:09.601 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:09.602 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:09.602 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-10T08:20:09.602 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-10T08:20:09.602 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 0, 2024-09-10T08:20:09.602 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 0, 2024-09-10T08:20:09.602 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-10T08:20:09.602 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:09.602 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:09.602 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:09.602 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:09.602 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:09.602 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:20:10.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:10 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:20:10.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:10 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:20:10.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:10 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-10T08:20:10.530 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-10T08:20:10.530 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-10T08:20:10.530 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-09-10T08:20:10.530 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-09-10T08:20:10.530 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T08:20:10.530 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T08:20:10.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T08:20:11.013 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:20:11.324 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:11 smithi022 ceph-mon[30854]: pgmap v354: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 77 KiB/s wr, 251 op/s 2024-09-10T08:20:11.324 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:11 smithi022 ceph-mon[30854]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T08:20:11.324 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:11 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:20:11.324 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:11 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:20:11.324 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:11 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:20:11.345 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:11 smithi153 ceph-mon[35609]: pgmap v354: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 77 KiB/s wr, 251 op/s 2024-09-10T08:20:11.345 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:11 smithi153 ceph-mon[35609]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T08:20:11.345 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:11 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:20:11.345 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:11 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:20:11.345 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:11 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:20:11.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:11 smithi100 ceph-mon[35102]: pgmap v354: 97 pgs: 97 active+clean; 21 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 77 KiB/s wr, 251 op/s 2024-09-10T08:20:11.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:11 smithi100 ceph-mon[35102]: osdmap e95: 12 total, 12 up, 12 in 2024-09-10T08:20:11.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:11 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-10T08:20:11.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:11 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-10T08:20:11.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:11 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' 2024-09-10T08:20:11.656 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-10T08:20:11.656 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:20:11.656 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 234, 2024-09-10T08:20:11.656 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 224, 2024-09-10T08:20:11.656 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1446368, 2024-09-10T08:20:11.656 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 137664, 2024-09-10T08:20:11.656 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.056081964, 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.018350999, 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.054911216, 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 223, 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.031630847, 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000141842 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:11.657 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 1446368, 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 137664 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 2, 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 171, 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 320, 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 187232, 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 5, 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.017277038, 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.011756183, 2024-09-10T08:20:11.658 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.002148213, 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 168, 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.013841252, 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000082388 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 187232 2024-09-10T08:20:11.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 4, 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 4, 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 2992, 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 448, 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.003615402, 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000051440, 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.003582110, 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 3, 2024-09-10T08:20:11.660 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.006373789, 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.002124596 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-10T08:20:11.661 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:20:11.662 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:20:11.663 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 149011, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 32, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-10T08:20:11.664 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 928, 2024-09-10T08:20:11.665 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 236, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 1413360, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 236, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-10T08:20:11.666 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-10T08:20:11.667 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 236, 2024-09-10T08:20:11.667 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1413360, 2024-09-10T08:20:11.667 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-10T08:20:11.667 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-10T08:20:11.667 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-10T08:20:11.667 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-10T08:20:11.667 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:11.667 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-10T08:20:11.667 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-10T08:20:12.462 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T08:20:12.462 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T08:20:12.462 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-10T08:20:12.462 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-10T08:20:12.462 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-10T08:20:12.462 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T08:20:12.462 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T08:20:13.112 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T08:20:13.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:13 smithi153 ceph-mon[35609]: pgmap v356: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 20 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 36 KiB/s wr, 225 op/s 2024-09-10T08:20:13.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:13 smithi100 ceph-mon[35102]: pgmap v356: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 20 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 36 KiB/s wr, 225 op/s 2024-09-10T08:20:13.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:13 smithi022 ceph-mon[30854]: pgmap v356: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 20 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 36 KiB/s wr, 225 op/s 2024-09-10T08:20:15.046 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T08:20:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:20:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 4451, 2024-09-10T08:20:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 3736, 2024-09-10T08:20:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 3032691, 2024-09-10T08:20:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 148159353, 2024-09-10T08:20:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 14, 2024-09-10T08:20:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-09-10T08:20:15.046 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 1.049444914, 2024-09-10T08:20:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.566874099, 2024-09-10T08:20:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.181618776, 2024-09-10T08:20:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.310281480, 2024-09-10T08:20:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3737, 2024-09-10T08:20:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 1.207249952, 2024-09-10T08:20:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000323053 2024-09-10T08:20:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2698, 2024-09-10T08:20:15.047 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000517998, 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000191 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 2013632, 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 288960 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 197907, 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 199592, 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 78768428, 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 298436627, 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 12, 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 10.742363121, 2024-09-10T08:20:15.048 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 5.031512748, 2024-09-10T08:20:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 13.490357641, 2024-09-10T08:20:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.337279284, 2024-09-10T08:20:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 199593, 2024-09-10T08:20:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 28.534602755, 2024-09-10T08:20:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000142963 2024-09-10T08:20:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 284727, 2024-09-10T08:20:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.059353506, 2024-09-10T08:20:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000208 2024-09-10T08:20:15.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 77746768, 2024-09-10T08:20:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 78586224 2024-09-10T08:20:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:20:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 3669, 2024-09-10T08:20:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 3471, 2024-09-10T08:20:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 989675, 2024-09-10T08:20:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 258827107, 2024-09-10T08:20:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 12, 2024-09-10T08:20:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 8, 2024-09-10T08:20:15.050 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 1.129865467, 2024-09-10T08:20:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.750497323, 2024-09-10T08:20:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.124402196, 2024-09-10T08:20:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.255928090, 2024-09-10T08:20:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3464, 2024-09-10T08:20:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.943482027, 2024-09-10T08:20:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000272367 2024-09-10T08:20:15.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1747, 2024-09-10T08:20:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000386517, 2024-09-10T08:20:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000221 2024-09-10T08:20:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.052 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T08:20:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 338256 2024-09-10T08:20:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-10T08:20:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-09-10T08:20:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-10T08:20:15.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-09-10T08:20:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T08:20:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T08:20:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3494, 2024-09-10T08:20:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 73.323691573, 2024-09-10T08:20:15.054 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.020985601 2024-09-10T08:20:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-09-10T08:20:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T08:20:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T08:20:15.055 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2465, 2024-09-10T08:20:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.074311586, 2024-09-10T08:20:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000030146 2024-09-10T08:20:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.056 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-10T08:20:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 227, 2024-09-10T08:20:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 226, 2024-09-10T08:20:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-09-10T08:20:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 226, 2024-09-10T08:20:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 3.714501937, 2024-09-10T08:20:15.057 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.016435849 2024-09-10T08:20:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-09-10T08:20:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 1, 2024-09-10T08:20:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-09-10T08:20:15.058 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-09-10T08:20:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 22, 2024-09-10T08:20:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-09-10T08:20:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-09-10T08:20:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 129, 2024-09-10T08:20:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 37, 2024-09-10T08:20:15.059 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 81, 2024-09-10T08:20:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 11, 2024-09-10T08:20:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 76, 2024-09-10T08:20:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 6, 2024-09-10T08:20:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 3, 2024-09-10T08:20:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 3, 2024-09-10T08:20:15.060 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 3, 2024-09-10T08:20:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 276, 2024-09-10T08:20:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 264, 2024-09-10T08:20:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-09-10T08:20:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 0, 2024-09-10T08:20:15.061 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:20:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-09-10T08:20:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-09-10T08:20:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 485, 2024-09-10T08:20:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-09-10T08:20:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 2, 2024-09-10T08:20:15.062 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 5, 2024-09-10T08:20:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 1, 2024-09-10T08:20:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 6, 2024-09-10T08:20:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-09-10T08:20:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-09-10T08:20:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-09-10T08:20:15.063 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 4, 2024-09-10T08:20:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 234, 2024-09-10T08:20:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 6, 2024-09-10T08:20:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T08:20:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-09-10T08:20:15.064 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:20:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:20:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-09-10T08:20:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T08:20:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T08:20:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-09-10T08:20:15.065 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 2, 2024-09-10T08:20:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 40, 2024-09-10T08:20:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 2474, 2024-09-10T08:20:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:20:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:20:15.066 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:20:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 193521, 2024-09-10T08:20:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 193468, 2024-09-10T08:20:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 2, 2024-09-10T08:20:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 46 2024-09-10T08:20:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.067 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-09-10T08:20:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-09-10T08:20:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-09-10T08:20:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-09-10T08:20:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 0, 2024-09-10T08:20:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 8, 2024-09-10T08:20:15.068 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 4, 2024-09-10T08:20:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-09-10T08:20:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:20:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 20, 2024-09-10T08:20:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 16, 2024-09-10T08:20:15.069 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-09-10T08:20:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-09-10T08:20:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-09-10T08:20:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:20:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:20:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-09-10T08:20:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-09-10T08:20:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:20:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:20:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T08:20:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 2, 2024-09-10T08:20:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-09-10T08:20:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:20:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-09-10T08:20:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-09-10T08:20:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-09-10T08:20:15.072 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-09-10T08:20:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 194103, 2024-09-10T08:20:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 98321, 2024-09-10T08:20:15.073 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 98321, 2024-09-10T08:20:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 95782, 2024-09-10T08:20:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-09-10T08:20:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 12290, 2024-09-10T08:20:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 276, 2024-09-10T08:20:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 148, 2024-09-10T08:20:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 148, 2024-09-10T08:20:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 128, 2024-09-10T08:20:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 8, 2024-09-10T08:20:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-09-10T08:20:15.074 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 22, 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 298597490, 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 713100033, 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4354, 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 538.029147227, 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.123571232 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 102, 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 123, 2024-09-10T08:20:15.075 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 21, 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 21, 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 22, 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 1, 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 129, 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 151, 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 22, 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 3, 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 38, 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 35, 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 68532, 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 231712 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.076 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 304, 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 4, 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 227, 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 29, 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 10, 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 22, 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.023576719, 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001071669 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 125, 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.028042613, 2024-09-10T08:20:15.077 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000224340 2024-09-10T08:20:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-09-10T08:20:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-09-10T08:20:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.078 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000742304, 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000247434 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.079 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000118346, 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000118346 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.080 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 12, 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002133584, 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000177798 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 10, 2024-09-10T08:20:15.081 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.011869580, 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001186958 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 12, 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 2.873872160, 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.239489346 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-09-10T08:20:15.082 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000193846, 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000193846 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4, 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.011134002, 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002783500 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001890774, 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000945387 2024-09-10T08:20:15.083 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4, 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.612893358, 2024-09-10T08:20:15.084 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.153223339 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 6, 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.097203030, 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.016200505 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-09-10T08:20:15.085 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000808867, 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000808867 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.086 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 7, 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.020049444, 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002864206 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.087 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-09-10T08:20:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 16, 2024-09-10T08:20:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.029973310, 2024-09-10T08:20:15.088 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001873331 2024-09-10T08:20:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:20:15.089 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:20:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-09-10T08:20:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.090 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-09-10T08:20:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 2, 2024-09-10T08:20:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 4, 2024-09-10T08:20:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 2, 2024-09-10T08:20:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 2, 2024-09-10T08:20:15.091 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-09-10T08:20:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 51, 2024-09-10T08:20:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 25, 2024-09-10T08:20:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 680, 2024-09-10T08:20:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-09-10T08:20:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-10T08:20:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 120, 2024-09-10T08:20:15.092 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 120, 2024-09-10T08:20:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:20:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:20:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:20:15.093 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:20:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:20:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:20:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:20:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:20:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:20:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:20:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:20:15.094 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:20:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:20:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-10T08:20:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:20:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-10T08:20:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:20:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:20:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:20:15.095 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:20:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:20:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:20:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:20:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-10T08:20:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:20:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:20:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:20:15.096 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-10T08:20:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-10T08:20:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-10T08:20:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:20:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:20:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:20:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:20:15.097 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 383981, 2024-09-10T08:20:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 175, 2024-09-10T08:20:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 528, 2024-09-10T08:20:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 6, 2024-09-10T08:20:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-10T08:20:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-10T08:20:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:20:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-10T08:20:15.098 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:20:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-10T08:20:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 8344, 2024-09-10T08:20:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 184, 2024-09-10T08:20:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:20:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:20:15.099 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-10T08:20:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-10T08:20:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 399566, 2024-09-10T08:20:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 3081, 2024-09-10T08:20:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-10T08:20:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-10T08:20:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-10T08:20:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-10T08:20:15.100 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-09-10T08:20:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T08:20:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T08:20:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 8110, 2024-09-10T08:20:15.101 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 709104100, 2024-09-10T08:20:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 32, 2024-09-10T08:20:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 8110, 2024-09-10T08:20:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T08:20:15.102 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 8110, 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 456.017070754, 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.056228985 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 8110, 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 8238 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 8110, 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 1, 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 8109, 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T08:20:15.103 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T08:20:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 1, 2024-09-10T08:20:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 42, 2024-09-10T08:20:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 1, 2024-09-10T08:20:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 4355, 2024-09-10T08:20:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 47, 2024-09-10T08:20:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T08:20:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T08:20:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T08:20:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T08:20:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 3327, 2024-09-10T08:20:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T08:20:15.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 84, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:20:15.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T08:20:15.106 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 95, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 14, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 12, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 12, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 364, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 17 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.107 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 518, 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 6, 2024-09-10T08:20:15.108 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 2576, 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 16, 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 206023, 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 54471978, 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 206023, 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T08:20:15.109 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 206023, 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 54471978, 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T08:20:15.110 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 8110, 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 709106484, 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 8110, 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 709106484, 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.111 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 8110, 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 8110, 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 8110, 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 8110, 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:15.112 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 16, 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 2384, 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 16, 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T08:20:15.113 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1, 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 2384, 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x55a4d5e60960": { 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 194103, 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 708905729, 2024-09-10T08:20:15.114 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 194103, 2024-09-10T08:20:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T08:20:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T08:20:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 4354, 2024-09-10T08:20:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 708905729, 2024-09-10T08:20:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:15.115 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:15.115 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T08:20:15.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:15 smithi100 ceph-mon[35102]: pgmap v357: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2024-09-10T08:20:15.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:15 smithi153 ceph-mon[35609]: pgmap v357: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2024-09-10T08:20:15.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:15 smithi022 ceph-mon[30854]: pgmap v357: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2024-09-10T08:20:16.177 INFO:tasks.check_counter:Daemon mds.b mds.exported=2 2024-09-10T08:20:16.177 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-10T08:20:16.177 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-10T08:20:16.177 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=12 2024-09-10T08:20:16.178 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=6 2024-09-10T08:20:16.178 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T08:20:16.178 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T08:20:16.442 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T08:20:17.124 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T08:20:17.124 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:20:17.124 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 763, 2024-09-10T08:20:17.124 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 894, 2024-09-10T08:20:17.124 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1750879, 2024-09-10T08:20:17.124 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 389031, 2024-09-10T08:20:17.124 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 9, 2024-09-10T08:20:17.124 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 3, 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.108437563, 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.043390225, 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.073958714, 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.004800186, 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 895, 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.070332017, 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000078583 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1026, 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000281509, 2024-09-10T08:20:17.125 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000274 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1543120, 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 145408 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 80, 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 251, 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 60511, 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 548387, 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 13, 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 7, 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.018979721, 2024-09-10T08:20:17.126 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.009176738, 2024-09-10T08:20:17.127 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.008012865, 2024-09-10T08:20:17.127 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000266057, 2024-09-10T08:20:17.127 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:17.127 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 248, 2024-09-10T08:20:17.127 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.032882520, 2024-09-10T08:20:17.127 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000132590 2024-09-10T08:20:17.127 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.127 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:17.127 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 122, 2024-09-10T08:20:17.127 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000029275, 2024-09-10T08:20:17.127 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000239 2024-09-10T08:20:17.127 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.128 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1248, 2024-09-10T08:20:17.128 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 462336 2024-09-10T08:20:17.128 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.128 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:20:17.128 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 91, 2024-09-10T08:20:17.128 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 97, 2024-09-10T08:20:17.128 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 65852, 2024-09-10T08:20:17.128 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 97282, 2024-09-10T08:20:17.128 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 12, 2024-09-10T08:20:17.128 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-09-10T08:20:17.128 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.013492149, 2024-09-10T08:20:17.128 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.003522117, 2024-09-10T08:20:17.129 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.010197068, 2024-09-10T08:20:17.129 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000439880, 2024-09-10T08:20:17.129 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:17.129 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 94, 2024-09-10T08:20:17.129 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.018486035, 2024-09-10T08:20:17.129 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000196659 2024-09-10T08:20:17.129 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.129 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:17.129 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 127, 2024-09-10T08:20:17.129 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000025720, 2024-09-10T08:20:17.129 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000202 2024-09-10T08:20:17.129 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 5760, 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 4544 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 54, 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002106721, 2024-09-10T08:20:17.130 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000039013 2024-09-10T08:20:17.131 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:17.131 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.131 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-09-10T08:20:17.131 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T08:20:17.131 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T08:20:17.131 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-10T08:20:17.131 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000020808, 2024-09-10T08:20:17.131 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000010404 2024-09-10T08:20:17.131 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:17.131 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.131 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-10T08:20:17.131 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 3, 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 3, 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002193279, 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000731093 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 0, 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 11, 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-09-10T08:20:17.132 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 11, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 0, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 11, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 0, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 10, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 1, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 0, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 0, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 2, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 8, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 4, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 2, 2024-09-10T08:20:17.133 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 0, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 0, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 0, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 0, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 22, 2024-09-10T08:20:17.134 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 10738141007, 2024-09-10T08:20:17.135 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 3, 2024-09-10T08:20:17.135 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T08:20:17.135 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-09-10T08:20:17.135 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:20:17.135 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:20:17.135 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-09-10T08:20:17.135 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T08:20:17.135 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T08:20:17.135 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-09-10T08:20:17.135 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:20:17.135 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T08:20:17.135 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 0, 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 0, 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 0, 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 0, 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 0 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-09-10T08:20:17.136 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 3, 2024-09-10T08:20:17.137 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 0, 2024-09-10T08:20:17.137 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 0, 2024-09-10T08:20:17.137 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-09-10T08:20:17.137 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:20:17.137 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 0, 2024-09-10T08:20:17.137 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 0, 2024-09-10T08:20:17.137 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-09-10T08:20:17.137 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-09-10T08:20:17.137 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-09-10T08:20:17.137 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:20:17.137 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:20:17.137 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 0, 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-09-10T08:20:17.138 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 8, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 8, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 2, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 2, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 2, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-09-10T08:20:17.139 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 4196494, 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 7, 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.031108452, 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.004444064 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 14, 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 14, 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 0, 2024-09-10T08:20:17.140 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 13, 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 14, 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 1, 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 11, 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 12, 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 1, 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 0, 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 2, 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 2, 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 50208, 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 223520 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-09-10T08:20:17.141 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 8, 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 0, 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 3, 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 12, 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 1, 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001392425, 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001392425 2024-09-10T08:20:17.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000800854, 2024-09-10T08:20:17.143 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000400427 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-09-10T08:20:17.144 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.145 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.146 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-09-10T08:20:17.147 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.148 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.149 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.150 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.151 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-09-10T08:20:17.152 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.152 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.152 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.152 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-09-10T08:20:17.152 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.152 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.152 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.152 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.152 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-09-10T08:20:17.152 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-09-10T08:20:17.153 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 0, 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 3, 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 3, 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 0, 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 2, 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 1, 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 87, 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:20:17.154 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-10T08:20:17.155 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:20:17.156 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 239001, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 81, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-10T08:20:17.157 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 8344, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 184, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 56568, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 227, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-10T08:20:17.158 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-10T08:20:17.159 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-10T08:20:17.159 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-10T08:20:17.159 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.159 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-09-10T08:20:17.159 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T08:20:17.159 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T08:20:17.159 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 46, 2024-09-10T08:20:17.159 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 12727, 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 33, 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 46, 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 46, 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.586984368, 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.012760529 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 46, 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 70 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 46, 2024-09-10T08:20:17.160 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 0, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 46, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 10, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 0, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 7, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 8, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 6, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T08:20:17.161 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 20, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T08:20:17.162 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T08:20:17.163 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 95, 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 12, 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 8, 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 8, 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 17, 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 2 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-09-10T08:20:17.164 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 0, 2024-09-10T08:20:17.165 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 0, 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 0, 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 930, 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1775157, 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 930, 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T08:20:17.166 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 930, 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1775157, 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:17.167 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 46, 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 12727, 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 46, 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 12727, 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-10T08:20:17.168 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 46, 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 46, 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 46, 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 46, 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.169 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.170 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x558c18052960": { 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 8, 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 2190, 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 8, 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 7, 2024-09-10T08:20:17.171 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 2190, 2024-09-10T08:20:17.172 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:17.172 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:17.172 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:17.172 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:17.172 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:17.172 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:17.172 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T08:20:17.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:17 smithi100 ceph-mon[35102]: pgmap v358: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2024-09-10T08:20:17.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:17 smithi153 ceph-mon[35609]: pgmap v358: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2024-09-10T08:20:17.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:17 smithi022 ceph-mon[30854]: pgmap v358: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2024-09-10T08:20:18.041 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T08:20:18.042 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T08:20:18.042 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=3 2024-09-10T08:20:18.042 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-10T08:20:18.042 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T08:20:18.042 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T08:20:18.042 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T08:20:18.297 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T08:20:18.854 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T08:20:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:20:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 377, 2024-09-10T08:20:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 488, 2024-09-10T08:20:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1615740, 2024-09-10T08:20:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 547077, 2024-09-10T08:20:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 10, 2024-09-10T08:20:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 3, 2024-09-10T08:20:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.059670126, 2024-09-10T08:20:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.022850605, 2024-09-10T08:20:18.854 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.047484279, 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000532608, 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 490, 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.043096357, 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000087951 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 107, 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000022094, 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000206 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1555168, 2024-09-10T08:20:18.855 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 482768 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 876, 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 854, 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 305196, 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 633403, 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 13, 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 8, 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.096864412, 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.042574496, 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.052593864, 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.005689841, 2024-09-10T08:20:18.856 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 849, 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.059179329, 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000069704 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1562, 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000367589, 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000235 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 6912, 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 146384 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:20:18.857 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 148, 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 152, 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 118265, 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 177477, 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 14, 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 6, 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.015580881, 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.004510893, 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.011633908, 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000522496, 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 150, 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.035274432, 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000235162 2024-09-10T08:20:18.858 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 220, 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000048118, 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000218 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 1216 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.859 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 79, 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.005524538, 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000069930 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 17, 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000395703, 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000023276 2024-09-10T08:20:18.860 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 5, 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 4, 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4, 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.003778047, 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000944511 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 1, 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-09-10T08:20:18.861 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 11, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 17, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 2, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 5, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 10, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 14, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 13, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 0, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 0, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 4, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 12, 2024-09-10T08:20:18.862 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 6, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 2, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 39, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 1, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 6, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 2, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 5, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-09-10T08:20:18.863 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 1, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 22, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 10738141007, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 3, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:20:18.864 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 1, 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 3, 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 1, 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 0, 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 2, 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 4 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-09-10T08:20:18.865 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 3, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 0, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 0, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 2, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 2, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-09-10T08:20:18.866 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 1, 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 24, 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-09-10T08:20:18.867 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-09-10T08:20:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 24, 2024-09-10T08:20:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-09-10T08:20:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-09-10T08:20:18.868 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 2, 2024-09-10T08:20:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-09-10T08:20:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-09-10T08:20:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 2, 2024-09-10T08:20:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 2, 2024-09-10T08:20:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-09-10T08:20:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-09-10T08:20:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-09-10T08:20:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 4242439, 2024-09-10T08:20:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-09-10T08:20:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-09-10T08:20:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 19, 2024-09-10T08:20:18.873 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.049058769, 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002582040 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 21, 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 32, 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 11, 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 19, 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 25, 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 6, 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 20, 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 35, 2024-09-10T08:20:18.874 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 15, 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 0, 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 5, 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 5, 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 51652, 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 223520 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 9, 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 1, 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 5, 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 26, 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 5, 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-09-10T08:20:18.875 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-09-10T08:20:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.876 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-09-10T08:20:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-09-10T08:20:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-09-10T08:20:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-10T08:20:18.877 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000259320, 2024-09-10T08:20:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000259320 2024-09-10T08:20:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-09-10T08:20:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-09-10T08:20:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.878 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.879 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-09-10T08:20:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-09-10T08:20:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.880 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-09-10T08:20:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.881 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-09-10T08:20:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-09-10T08:20:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-09-10T08:20:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.882 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000337394, 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000337394 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.883 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-09-10T08:20:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-09-10T08:20:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.884 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.885 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-09-10T08:20:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-09-10T08:20:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.886 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-09-10T08:20:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-09-10T08:20:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.887 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-09-10T08:20:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-09-10T08:20:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.888 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-09-10T08:20:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-10T08:20:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.003181333, 2024-09-10T08:20:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001590666 2024-09-10T08:20:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:20:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:20:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-09-10T08:20:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.889 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-09-10T08:20:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 2, 2024-09-10T08:20:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 4, 2024-09-10T08:20:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 2, 2024-09-10T08:20:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 2, 2024-09-10T08:20:18.890 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-09-10T08:20:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 3, 2024-09-10T08:20:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 1, 2024-09-10T08:20:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 682, 2024-09-10T08:20:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-09-10T08:20:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-10T08:20:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:20:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-10T08:20:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:20:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:20:18.891 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:20:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:20:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:20:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:20:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:20:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:20:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:20:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:20:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:20:18.892 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:20:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:20:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-10T08:20:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:20:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-10T08:20:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:20:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:20:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:20:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:20:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:20:18.893 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 288017, 2024-09-10T08:20:18.894 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 108, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 8344, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 184, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:20:18.895 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-10T08:20:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-10T08:20:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 93207, 2024-09-10T08:20:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 443, 2024-09-10T08:20:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-10T08:20:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-10T08:20:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-10T08:20:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-10T08:20:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-09-10T08:20:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T08:20:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T08:20:18.896 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 74, 2024-09-10T08:20:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 60512, 2024-09-10T08:20:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 33, 2024-09-10T08:20:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 74, 2024-09-10T08:20:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T08:20:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 74, 2024-09-10T08:20:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.454987866, 2024-09-10T08:20:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.006148484 2024-09-10T08:20:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.897 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 74, 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 100 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 74, 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 1, 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 73, 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 10, 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 1, 2024-09-10T08:20:18.898 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 20, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 12, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 14, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 0, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 20, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:20:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T08:20:18.900 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T08:20:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T08:20:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T08:20:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T08:20:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T08:20:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T08:20:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-10T08:20:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T08:20:18.901 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T08:20:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T08:20:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T08:20:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 95, 2024-09-10T08:20:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T08:20:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 12, 2024-09-10T08:20:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 10, 2024-09-10T08:20:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 10, 2024-09-10T08:20:18.902 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T08:20:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T08:20:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 20, 2024-09-10T08:20:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-10T08:20:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 3 2024-09-10T08:20:18.903 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.904 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-09-10T08:20:18.904 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-09-10T08:20:18.904 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:20:18.904 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-09-10T08:20:18.904 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-09-10T08:20:18.904 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.904 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-09-10T08:20:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-09-10T08:20:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-09-10T08:20:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-09-10T08:20:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 2, 2024-09-10T08:20:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-09-10T08:20:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 2, 2024-09-10T08:20:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 2, 2024-09-10T08:20:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 2, 2024-09-10T08:20:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-09-10T08:20:18.905 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:20:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T08:20:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 1397, 2024-09-10T08:20:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1894118, 2024-09-10T08:20:18.906 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 1397, 2024-09-10T08:20:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T08:20:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T08:20:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1397, 2024-09-10T08:20:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1894118, 2024-09-10T08:20:18.907 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:18.908 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 74, 2024-09-10T08:20:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 60810, 2024-09-10T08:20:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 74, 2024-09-10T08:20:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 60810, 2024-09-10T08:20:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-09-10T08:20:18.909 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 74, 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 74, 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 74, 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 74, 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.910 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 2, 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 298, 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 2, 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 1, 2024-09-10T08:20:18.911 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 298, 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x562e7bbdc960": { 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 24, 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 48135, 2024-09-10T08:20:18.912 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 24, 2024-09-10T08:20:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T08:20:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T08:20:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 19, 2024-09-10T08:20:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 48135, 2024-09-10T08:20:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:18.913 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:18.913 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T08:20:19.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:19 smithi100 ceph-mon[35102]: pgmap v359: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2024-09-10T08:20:19.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:19 smithi153 ceph-mon[35609]: pgmap v359: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2024-09-10T08:20:19.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:19 smithi022 ceph-mon[30854]: pgmap v359: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 KiB/s wr, 12 op/s 2024-09-10T08:20:19.532 INFO:tasks.check_counter:Daemon mds.h mds.exported=1 2024-09-10T08:20:19.533 INFO:tasks.check_counter:Daemon mds.h mds.imported=2 2024-09-10T08:20:19.533 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=3 2024-09-10T08:20:19.533 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-10T08:20:19.533 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T08:20:19.533 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T08:20:19.533 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T08:20:19.781 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T08:20:20.287 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-10T08:20:20.287 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:20:20.288 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 768, 2024-09-10T08:20:20.288 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 770, 2024-09-10T08:20:20.288 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 202719, 2024-09-10T08:20:20.288 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 244288, 2024-09-10T08:20:20.288 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 6, 2024-09-10T08:20:20.288 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-10T08:20:20.288 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.073454026, 2024-09-10T08:20:20.289 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.028787784, 2024-09-10T08:20:20.289 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.017168766, 2024-09-10T08:20:20.289 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.019677083, 2024-09-10T08:20:20.289 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:20.289 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 768, 2024-09-10T08:20:20.290 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.035468714, 2024-09-10T08:20:20.290 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000046183 2024-09-10T08:20:20.290 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.290 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:20.290 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.290 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.290 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.290 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.290 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T08:20:20.290 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T08:20:20.290 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 665, 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 835, 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 165448, 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 673279, 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 7, 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 5, 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.076838981, 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.023894113, 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.018896229, 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.026459457, 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 833, 2024-09-10T08:20:20.291 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.042712021, 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000051274 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 463712 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 1028, 2024-09-10T08:20:20.292 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 1008, 2024-09-10T08:20:20.293 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1792768, 2024-09-10T08:20:20.293 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 385338, 2024-09-10T08:20:20.293 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 3, 2024-09-10T08:20:20.293 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 2, 2024-09-10T08:20:20.293 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.137299147, 2024-09-10T08:20:20.293 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.043123530, 2024-09-10T08:20:20.293 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.067570043, 2024-09-10T08:20:20.293 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.031748112, 2024-09-10T08:20:20.293 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:20.293 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1007, 2024-09-10T08:20:20.293 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.056225211, 2024-09-10T08:20:20.293 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000055834 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1536400, 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 142704 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.294 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3650, 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.116168167, 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000031826 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.295 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 0, 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 0, 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 0, 2024-09-10T08:20:20.296 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-09-10T08:20:20.297 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-09-10T08:20:20.297 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 0, 2024-09-10T08:20:20.297 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 0, 2024-09-10T08:20:20.297 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 0, 2024-09-10T08:20:20.297 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 0, 2024-09-10T08:20:20.297 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 0, 2024-09-10T08:20:20.297 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 0, 2024-09-10T08:20:20.297 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 0, 2024-09-10T08:20:20.297 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 0, 2024-09-10T08:20:20.297 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 0, 2024-09-10T08:20:20.297 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 1, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 0, 2024-09-10T08:20:20.298 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 0, 2024-09-10T08:20:20.299 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T08:20:20.300 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T08:20:20.300 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 0, 2024-09-10T08:20:20.300 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:20:20.300 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T08:20:20.300 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 0, 2024-09-10T08:20:20.300 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:20:20.300 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:20:20.300 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:20:20.300 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 0, 2024-09-10T08:20:20.301 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 0, 2024-09-10T08:20:20.301 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 0, 2024-09-10T08:20:20.301 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 0 2024-09-10T08:20:20.301 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.301 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-09-10T08:20:20.301 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-09-10T08:20:20.301 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-09-10T08:20:20.301 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-09-10T08:20:20.301 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 0, 2024-09-10T08:20:20.301 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 0, 2024-09-10T08:20:20.301 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 0, 2024-09-10T08:20:20.301 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-09-10T08:20:20.302 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:20:20.302 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 0, 2024-09-10T08:20:20.302 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 0, 2024-09-10T08:20:20.302 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-09-10T08:20:20.302 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-09-10T08:20:20.302 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-09-10T08:20:20.302 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:20:20.302 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:20:20.302 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-09-10T08:20:20.302 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 0, 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 0, 2024-09-10T08:20:20.303 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-09-10T08:20:20.304 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-09-10T08:20:20.304 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 3, 2024-09-10T08:20:20.304 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-09-10T08:20:20.304 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-09-10T08:20:20.304 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 0, 2024-09-10T08:20:20.304 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-09-10T08:20:20.304 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-09-10T08:20:20.304 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 2, 2024-09-10T08:20:20.304 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 2, 2024-09-10T08:20:20.304 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-09-10T08:20:20.304 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 4195200, 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 4194892, 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 3 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 3, 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 3, 2024-09-10T08:20:20.305 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 0, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 1, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 1, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 0, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 0, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 0, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 0, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 0, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 0, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 0, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 49056, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 215328 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 0, 2024-09-10T08:20:20.306 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 0, 2024-09-10T08:20:20.307 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 0, 2024-09-10T08:20:20.307 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 0, 2024-09-10T08:20:20.307 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 0, 2024-09-10T08:20:20.307 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-09-10T08:20:20.307 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.307 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.307 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.307 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.307 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-09-10T08:20:20.307 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.307 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.308 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.308 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.308 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-09-10T08:20:20.308 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.308 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.308 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.308 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.308 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-09-10T08:20:20.308 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.308 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-09-10T08:20:20.309 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.310 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-09-10T08:20:20.311 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.311 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.311 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.311 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-09-10T08:20:20.311 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.311 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.311 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.311 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.311 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-09-10T08:20:20.311 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.312 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.312 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.312 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.312 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-09-10T08:20:20.312 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.312 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-09-10T08:20:20.313 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.314 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.315 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-09-10T08:20:20.316 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.317 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.317 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.317 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-09-10T08:20:20.317 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.317 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.317 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.317 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.317 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-09-10T08:20:20.317 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.317 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.318 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.318 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-09-10T08:20:20.318 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.318 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.318 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.318 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.318 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.319 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 1, 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 1, 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 0, 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 1, 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 0, 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 0, 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 1957, 2024-09-10T08:20:20.320 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:20:20.321 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:20:20.322 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 189433, 2024-09-10T08:20:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 52, 2024-09-10T08:20:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-10T08:20:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-10T08:20:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-10T08:20:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-10T08:20:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:20:20.324 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-10T08:20:20.325 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:20:20.325 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-10T08:20:20.325 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 8344, 2024-09-10T08:20:20.325 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 184, 2024-09-10T08:20:20.325 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:20:20.325 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:20:20.326 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-10T08:20:20.326 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-10T08:20:20.326 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 8512, 2024-09-10T08:20:20.326 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 13, 2024-09-10T08:20:20.326 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-10T08:20:20.326 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-10T08:20:20.326 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-10T08:20:20.326 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 2190, 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 21, 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 3, 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 2190, 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2190, 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 33.826116926, 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.015445715 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.327 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-10T08:20:20.328 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-10T08:20:20.328 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2190, 2024-09-10T08:20:20.328 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 2191 2024-09-10T08:20:20.328 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.328 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 2190, 2024-09-10T08:20:20.328 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 2190, 2024-09-10T08:20:20.328 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 0, 2024-09-10T08:20:20.328 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-10T08:20:20.328 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-10T08:20:20.328 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 1420, 2024-09-10T08:20:20.328 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 0, 2024-09-10T08:20:20.329 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 768, 2024-09-10T08:20:20.329 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 0, 2024-09-10T08:20:20.329 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 0, 2024-09-10T08:20:20.329 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-10T08:20:20.329 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-10T08:20:20.329 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-10T08:20:20.329 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 0, 2024-09-10T08:20:20.329 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 0, 2024-09-10T08:20:20.329 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-10T08:20:20.329 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 1, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 0, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:20:20.330 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-10T08:20:20.331 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 96, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 13, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 5, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 5, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 0, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 2, 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 0 2024-09-10T08:20:20.332 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-09-10T08:20:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 0, 2024-09-10T08:20:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:20:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-09-10T08:20:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-09-10T08:20:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-09-10T08:20:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 0 2024-09-10T08:20:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-09-10T08:20:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-09-10T08:20:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 0, 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 0, 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 0, 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 2457, 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1923276, 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:20.334 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 2457, 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 2457, 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1923276, 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-10T08:20:20.335 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:20.336 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T08:20:20.336 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T08:20:20.336 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:20.336 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:20.336 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 2190, 2024-09-10T08:20:20.336 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 901, 2024-09-10T08:20:20.336 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 2190, 2024-09-10T08:20:20.336 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 901, 2024-09-10T08:20:20.336 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:20.336 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.336 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.336 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.337 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:20.337 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.337 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-09-10T08:20:20.337 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:20.337 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-10T08:20:20.337 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:20.337 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T08:20:20.337 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T08:20:20.337 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:20.337 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:20.337 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 2190, 2024-09-10T08:20:20.338 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 2190, 2024-09-10T08:20:20.338 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 2190, 2024-09-10T08:20:20.338 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 2190, 2024-09-10T08:20:20.338 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:20.338 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.338 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.338 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.338 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:20.339 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.339 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:20:20.339 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:20.339 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-10T08:20:20.339 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:20.339 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T08:20:20.339 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T08:20:20.339 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:20.339 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:20.340 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T08:20:20.340 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T08:20:20.340 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T08:20:20.340 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T08:20:20.340 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:20.340 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.340 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.340 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.340 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:20.340 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-10T08:20:20.341 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x561881cd0b40": { 2024-09-10T08:20:20.341 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-10T08:20:20.341 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-10T08:20:20.341 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-10T08:20:20.341 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-10T08:20:20.341 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-10T08:20:20.341 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:20.341 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:20.341 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-10T08:20:20.341 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-10T08:20:20.342 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 0, 2024-09-10T08:20:20.342 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 0, 2024-09-10T08:20:20.342 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-10T08:20:20.342 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-10T08:20:20.342 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-10T08:20:20.342 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-10T08:20:20.342 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:20.342 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-10T08:20:20.342 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-10T08:20:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:20 smithi100 ceph-mon[35102]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T08:20:21.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:20 smithi100 ceph-mon[35102]: pgmap v361: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:21.160 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-10T08:20:21.160 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-10T08:20:21.160 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=0 2024-09-10T08:20:21.160 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-09-10T08:20:21.160 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T08:20:21.160 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T08:20:21.161 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T08:20:21.189 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:20 smithi153 ceph-mon[35609]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T08:20:21.190 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:20 smithi153 ceph-mon[35609]: pgmap v361: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:21.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:20 smithi022 ceph-mon[30854]: osdmap e96: 12 total, 12 up, 12 in 2024-09-10T08:20:21.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:20 smithi022 ceph-mon[30854]: pgmap v361: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:21.420 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:20:21.944 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-10T08:20:21.944 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:20:21.944 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 2171, 2024-09-10T08:20:21.944 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 2171, 2024-09-10T08:20:21.944 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 311136233, 2024-09-10T08:20:21.944 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 689564, 2024-09-10T08:20:21.944 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 8, 2024-09-10T08:20:21.944 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.388943268, 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.062841093, 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.235277374, 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.071676596, 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2170, 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.104978779, 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000048377 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.945 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.946 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T08:20:21.946 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T08:20:21.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.946 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:20:21.946 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 1001, 2024-09-10T08:20:21.946 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 1170, 2024-09-10T08:20:21.946 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 226832092, 2024-09-10T08:20:21.946 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 780484, 2024-09-10T08:20:21.946 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 9, 2024-09-10T08:20:21.946 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 7, 2024-09-10T08:20:21.946 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.249416815, 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.033107077, 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.177720950, 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.027644543, 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1167, 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.061520898, 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000052717 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.948 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T08:20:21.948 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 462736 2024-09-10T08:20:21.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.948 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:20:21.948 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 887, 2024-09-10T08:20:21.948 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 867, 2024-09-10T08:20:21.948 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 173705205, 2024-09-10T08:20:21.948 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 339055, 2024-09-10T08:20:21.948 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2024-09-10T08:20:21.948 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2024-09-10T08:20:21.948 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.197992787, 2024-09-10T08:20:21.948 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.033050066, 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.151945474, 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.020074631, 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 866, 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.869937038, 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001004546 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.949 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1535472, 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 140304 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 5542, 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.159367521, 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000028756 2024-09-10T08:20:21.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 0, 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 0, 2024-09-10T08:20:21.951 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 0, 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 0, 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 134, 2024-09-10T08:20:21.952 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 18, 2024-09-10T08:20:21.953 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 116, 2024-09-10T08:20:21.953 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2024-09-10T08:20:21.953 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 105, 2024-09-10T08:20:21.953 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 0, 2024-09-10T08:20:21.953 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 0, 2024-09-10T08:20:21.953 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 0, 2024-09-10T08:20:21.953 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 3, 2024-09-10T08:20:21.953 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 0, 2024-09-10T08:20:21.953 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 0, 2024-09-10T08:20:21.953 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2024-09-10T08:20:21.953 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2024-09-10T08:20:21.953 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 0, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 0, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 4, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 234, 2024-09-10T08:20:21.954 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 6, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 0, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 0, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 0, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:20:21.955 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 0, 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 0, 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 0, 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 0 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 0, 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 0, 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 0, 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 0, 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 0, 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2024-09-10T08:20:21.956 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2024-09-10T08:20:21.957 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-09-10T08:20:21.958 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:20:21.958 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-09-10T08:20:21.958 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2024-09-10T08:20:21.958 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.958 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-09-10T08:20:21.958 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 0, 2024-09-10T08:20:21.958 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 0, 2024-09-10T08:20:21.958 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2024-09-10T08:20:21.958 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2024-09-10T08:20:21.958 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 194103, 2024-09-10T08:20:21.958 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-09-10T08:20:21.958 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 0, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 150, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 17, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 298597490, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 713100033, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 713090444, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.959 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 194103 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 94, 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 114, 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 20, 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 12, 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 13, 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 1, 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 134, 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 139, 2024-09-10T08:20:21.960 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 5, 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 0, 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 0, 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 0, 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 52564, 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 215328 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 0, 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 0, 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 0, 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2024-09-10T08:20:21.961 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.962 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.963 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.964 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-09-10T08:20:21.965 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.966 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.967 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.968 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.969 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.969 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-09-10T08:20:21.969 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.969 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.969 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.969 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-09-10T08:20:21.969 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.969 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.969 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.970 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-09-10T08:20:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-09-10T08:20:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.971 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:20:21.972 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 2, 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 4, 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 2, 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 3, 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 0, 2024-09-10T08:20:21.973 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 0, 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 2586, 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:20:21.974 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:20:21.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:20:21.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:20:21.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:20:21.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:20:21.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:20:21.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:20:21.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-09-10T08:20:21.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:20:21.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-09-10T08:20:21.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:20:21.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:20:21.975 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:20:21.976 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:20:21.977 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:20:21.977 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:20:21.977 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 242468, 2024-09-10T08:20:21.977 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 180, 2024-09-10T08:20:21.977 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-09-10T08:20:21.977 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-09-10T08:20:21.977 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-09-10T08:20:21.977 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-09-10T08:20:21.977 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:20:21.977 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-09-10T08:20:21.977 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:20:21.977 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 8224, 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 181, 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 381949, 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 3489, 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-09-10T08:20:21.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.979 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-09-10T08:20:21.979 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-09-10T08:20:21.979 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-09-10T08:20:21.979 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 3791, 2024-09-10T08:20:21.979 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 26, 2024-09-10T08:20:21.979 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 4, 2024-09-10T08:20:21.979 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 3791, 2024-09-10T08:20:21.979 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-09-10T08:20:21.979 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 3791, 2024-09-10T08:20:21.979 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 20.444633179, 2024-09-10T08:20:21.979 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.005392939 2024-09-10T08:20:21.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 3791, 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 3792 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 3791, 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 3791, 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 0, 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 2567, 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 0, 2024-09-10T08:20:21.980 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 1221, 2024-09-10T08:20:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 0, 2024-09-10T08:20:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 0, 2024-09-10T08:20:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-09-10T08:20:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-09-10T08:20:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-09-10T08:20:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2024-09-10T08:20:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 0, 2024-09-10T08:20:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-09-10T08:20:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-09-10T08:20:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-09-10T08:20:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 2, 2024-09-10T08:20:21.981 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-09-10T08:20:21.982 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 96, 2024-09-10T08:20:21.983 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 13, 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 11, 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 11, 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 0, 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 2, 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 0 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 0, 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:20:21.984 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: "osd-slow-ops": { 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 0 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 0, 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed_ops": 0, 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 0, 2024-09-10T08:20:21.985 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 4055, 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 711292213, 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 4055, 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 4055, 2024-09-10T08:20:21.986 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 711292213, 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:21.987 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 3791, 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 709100466, 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 3791, 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 709100466, 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:21.988 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 3791, 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 3791, 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 3791, 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 3791, 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.989 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-09-10T08:20:21.990 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x56346f924b40": { 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:21.991 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:21.992 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-09-10T08:20:21.992 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-09-10T08:20:21.992 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-09-10T08:20:21.992 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-09-10T08:20:21.992 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:21.992 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:21.992 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:21.992 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:21.992 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:21.992 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:21.992 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-10T08:20:22.928 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-10T08:20:22.929 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-10T08:20:22.929 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-10T08:20:22.929 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-10T08:20:22.929 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T08:20:22.929 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T08:20:22.929 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T08:20:23.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:22 smithi153 ceph-mon[35609]: pgmap v362: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:23.219 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:20:23.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:22 smithi022 ceph-mon[30854]: pgmap v362: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:23.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:22 smithi100 ceph-mon[35102]: pgmap v362: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:23.751 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-10T08:20:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:20:23.751 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 1061, 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 1041, 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1803984, 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 395188, 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 1, 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.134492370, 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.042473499, 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.066781841, 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.030129936, 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1040, 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.052204006, 2024-09-10T08:20:23.752 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000050196 2024-09-10T08:20:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1535856, 2024-09-10T08:20:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 141424 2024-09-10T08:20:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:20:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 8, 2024-09-10T08:20:23.753 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 176, 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 3868, 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 464058, 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 6, 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.012820622, 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.007044952, 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.003918381, 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000061610, 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 174, 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.020266232, 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000116472 2024-09-10T08:20:23.754 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-10T08:20:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 463360 2024-09-10T08:20:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:20:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 1509, 2024-09-10T08:20:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 1511, 2024-09-10T08:20:23.755 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 432762, 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 479869, 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 4, 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 3, 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.112033149, 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.033467886, 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.031764934, 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.039583353, 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1509, 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.066936739, 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000044358 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.756 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T08:20:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T08:20:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-09-10T08:20:23.757 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-09-10T08:20:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-09-10T08:20:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-09-10T08:20:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-09-10T08:20:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-09-10T08:20:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 3891, 2024-09-10T08:20:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.107041561, 2024-09-10T08:20:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000027510 2024-09-10T08:20:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-09-10T08:20:23.758 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-09-10T08:20:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-09-10T08:20:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-09-10T08:20:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 0, 2024-09-10T08:20:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 0, 2024-09-10T08:20:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-09-10T08:20:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.759 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-09-10T08:20:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2024-09-10T08:20:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 0, 2024-09-10T08:20:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-09-10T08:20:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 0, 2024-09-10T08:20:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2024-09-10T08:20:23.760 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 9, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 2, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 7, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 6, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 0, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 0, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 0, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 3, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 0, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 0, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2024-09-10T08:20:23.761 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 0, 2024-09-10T08:20:23.762 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 0, 2024-09-10T08:20:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T08:20:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-09-10T08:20:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:20:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:20:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 0, 2024-09-10T08:20:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T08:20:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T08:20:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 0, 2024-09-10T08:20:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:20:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T08:20:23.763 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 0, 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 0, 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 0, 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 0, 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 0 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 0, 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 0, 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 0, 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 0, 2024-09-10T08:20:23.764 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-09-10T08:20:23.765 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 0, 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 0, 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2024-09-10T08:20:23.766 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 24, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 0, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 2, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 2, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 4194304, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 4242439, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 4239834, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.767 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 24 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 9, 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 23, 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 14, 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 7, 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 15, 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 8, 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 9, 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 23, 2024-09-10T08:20:23.768 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 14, 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 0, 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 0, 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 0, 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 49092, 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 215328 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 0, 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 0, 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 0, 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2024-09-10T08:20:23.769 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-09-10T08:20:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-09-10T08:20:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-09-10T08:20:23.770 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.771 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-09-10T08:20:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-09-10T08:20:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-09-10T08:20:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.772 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-09-10T08:20:23.773 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-09-10T08:20:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.774 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-09-10T08:20:23.775 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.776 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.777 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-09-10T08:20:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-09-10T08:20:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.778 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.779 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-09-10T08:20:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-09-10T08:20:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-09-10T08:20:23.780 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-09-10T08:20:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:20:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:20:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-09-10T08:20:23.781 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 2, 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 4, 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 2, 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 4, 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 0, 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 0, 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 3220, 2024-09-10T08:20:23.782 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:20:23.783 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:20:23.784 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 181313, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 47, 2024-09-10T08:20:23.785 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 8224, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 181, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-09-10T08:20:23.786 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 40549, 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 136, 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 2309, 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 21, 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 3, 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 2309, 2024-09-10T08:20:23.787 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2309, 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2.533954500, 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001097425 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2309, 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2310 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 2309, 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 2309, 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 0, 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-09-10T08:20:23.788 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 1492, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 0, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 815, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 0, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 0, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 0, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-09-10T08:20:23.789 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 1, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-09-10T08:20:23.790 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-09-10T08:20:23.791 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-09-10T08:20:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-09-10T08:20:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 96, 2024-09-10T08:20:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-09-10T08:20:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 13, 2024-09-10T08:20:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 4, 2024-09-10T08:20:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 4, 2024-09-10T08:20:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2024-09-10T08:20:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-09-10T08:20:23.792 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 0, 2024-09-10T08:20:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 2, 2024-09-10T08:20:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 0 2024-09-10T08:20:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-09-10T08:20:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 0, 2024-09-10T08:20:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:20:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-09-10T08:20:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-09-10T08:20:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "osd-slow-ops": { 2024-09-10T08:20:23.793 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 0 2024-09-10T08:20:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-09-10T08:20:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-09-10T08:20:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T08:20:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-09-10T08:20:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 0, 2024-09-10T08:20:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed_ops": 0, 2024-09-10T08:20:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 0, 2024-09-10T08:20:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-09-10T08:20:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.794 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 2574, 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 1992529, 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 2574, 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2574, 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 1992529, 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.795 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 2309, 2024-09-10T08:20:23.796 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 48140, 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2309, 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 48140, 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:23.797 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 2309, 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 2309, 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2309, 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 2309, 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.798 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:23.799 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x56404d552b40": { 2024-09-10T08:20:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-09-10T08:20:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:23.800 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:23.801 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-09-10T08:20:23.801 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-09-10T08:20:23.801 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-09-10T08:20:23.801 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-09-10T08:20:23.801 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:23.801 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:23.801 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:23.801 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:23.801 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:23.801 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:23.801 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-10T08:20:25.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:24 smithi022 ceph-mon[30854]: pgmap v363: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:25.272 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:24 smithi153 ceph-mon[35609]: pgmap v363: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:25.307 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-10T08:20:25.308 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-10T08:20:25.308 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-10T08:20:25.308 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-10T08:20:25.308 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T08:20:25.308 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T08:20:25.308 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T08:20:25.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:24 smithi100 ceph-mon[35102]: pgmap v363: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:20:26.087 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-10T08:20:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:20:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 317, 2024-09-10T08:20:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 471, 2024-09-10T08:20:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1553732, 2024-09-10T08:20:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 549993, 2024-09-10T08:20:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 16, 2024-09-10T08:20:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 2, 2024-09-10T08:20:26.087 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.064980475, 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.024081459, 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.049511110, 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000290652, 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 469, 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.042135594, 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000089841 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 49, 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000011528, 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000235 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.088 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1549952, 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 494480 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 80, 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 106, 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 63300, 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 193710, 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 9, 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.011928581, 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.003062464, 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.009109285, 2024-09-10T08:20:26.089 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000388735, 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 105, 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.020655515, 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000196719 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 114, 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000029090, 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000255 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 125632 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.090 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 472, 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 663, 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 244600, 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 358051, 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 8, 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 6, 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.059976151, 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.022372489, 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.032910854, 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.005027387, 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 661, 2024-09-10T08:20:26.091 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.041170439, 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000062285 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1081, 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000288644, 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000267 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-09-10T08:20:26.092 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 43, 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.001421399, 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000033055 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2, 2024-09-10T08:20:26.093 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000012380, 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000006190 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 1, 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 1, 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000087926, 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000087926 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-09-10T08:20:26.094 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 0, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 11, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 10, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 0, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 10, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 10, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 0, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 1, 2024-09-10T08:20:26.095 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 1, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 1, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 0, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 0, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 0, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2024-09-10T08:20:26.096 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 0, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 22, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 10738141007, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 3, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 0, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T08:20:26.097 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 0, 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 0, 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 0, 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 0, 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 0, 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 0 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.098 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 0, 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 0, 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 0, 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 1, 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 0, 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 0, 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 0, 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-09-10T08:20:26.099 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2024-09-10T08:20:26.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 0, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 3, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 3, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 2, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 2, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 2, 2024-09-10T08:20:26.101 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 4194304, 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 4195200, 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 0, 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2, 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.002966864, 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001483432 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 0 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 13, 2024-09-10T08:20:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 13, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 0, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 11, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 12, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 1, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 10, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 10, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 0, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 1, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 1, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 0, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 50316, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 223520 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.103 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 1, 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 1, 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 10, 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.104 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-09-10T08:20:26.105 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000087926, 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000087926 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.106 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-09-10T08:20:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-09-10T08:20:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-09-10T08:20:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-09-10T08:20:26.109 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.111 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-09-10T08:20:26.112 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.113 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.114 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.115 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 1, 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 1, 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 0, 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 1, 2024-09-10T08:20:26.116 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 1, 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 1, 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 695, 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:20:26.117 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:20:26.118 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-09-10T08:20:26.119 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 278551, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 93, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-09-10T08:20:26.120 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 8224, 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 181, 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 51240, 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 200, 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.121 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 37, 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 11108, 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 28, 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 37, 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 37, 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.190996458, 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.005162066 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-09-10T08:20:26.122 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 37, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 59 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 37, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 0, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 37, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 0, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 10, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 0, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 2, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 6, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-09-10T08:20:26.123 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 6, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 0, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 20, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-09-10T08:20:26.124 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-09-10T08:20:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-09-10T08:20:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:20:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-09-10T08:20:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:20:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2024-09-10T08:20:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-09-10T08:20:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-09-10T08:20:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-09-10T08:20:26.125 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 96, 2024-09-10T08:20:26.126 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 13, 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 9, 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 9, 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 14, 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 0, 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 1 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 1, 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-09-10T08:20:26.127 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "osd-slow-ops": { 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 0 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 0, 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed_ops": 0, 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 0, 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-09-10T08:20:26.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 865, 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 1765707, 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 865, 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 865, 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 1765707, 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:26.129 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 37, 2024-09-10T08:20:26.130 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 11108, 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 37, 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 11108, 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:26.131 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 37, 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 37, 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 37, 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 37, 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:20:26.132 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.133 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x555f6fc04960": { 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 3, 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 896, 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 3, 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2, 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 896, 2024-09-10T08:20:26.134 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:26.135 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:26.135 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-10T08:20:26.894 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-10T08:20:26.894 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-10T08:20:26.894 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=3 2024-09-10T08:20:26.894 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-10T08:20:26.894 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T08:20:26.895 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T08:20:26.895 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T08:20:27.139 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T08:20:27.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:26 smithi022 ceph-mon[30854]: pgmap v364: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:27.259 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:26 smithi153 ceph-mon[35609]: pgmap v364: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:27.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:26 smithi100 ceph-mon[35102]: pgmap v364: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:28.354 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-10T08:20:28.354 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T08:20:28.355 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 1069, 2024-09-10T08:20:28.355 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 1049, 2024-09-10T08:20:28.355 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1806416, 2024-09-10T08:20:28.355 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 399020, 2024-09-10T08:20:28.355 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2024-09-10T08:20:28.355 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 1, 2024-09-10T08:20:28.355 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.137907147, 2024-09-10T08:20:28.355 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.043378068, 2024-09-10T08:20:28.355 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.069799861, 2024-09-10T08:20:28.355 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.031079464, 2024-09-10T08:20:28.355 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1048, 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.051130248, 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000048788 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1536944, 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 143984 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.356 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T08:20:28.357 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 720, 2024-09-10T08:20:28.357 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 893, 2024-09-10T08:20:28.357 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 177600, 2024-09-10T08:20:28.357 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 691832, 2024-09-10T08:20:28.357 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 7, 2024-09-10T08:20:28.357 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 5, 2024-09-10T08:20:28.357 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.081802514, 2024-09-10T08:20:28.357 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.030167715, 2024-09-10T08:20:28.357 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.017939739, 2024-09-10T08:20:28.357 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.026068580, 2024-09-10T08:20:28.357 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:28.357 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 890, 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.040982303, 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000046047 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 463440 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T08:20:28.358 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 813, 2024-09-10T08:20:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 813, 2024-09-10T08:20:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 217085, 2024-09-10T08:20:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 257711, 2024-09-10T08:20:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 4, 2024-09-10T08:20:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 3, 2024-09-10T08:20:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.076731244, 2024-09-10T08:20:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.029084028, 2024-09-10T08:20:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.020388956, 2024-09-10T08:20:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.020225966, 2024-09-10T08:20:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T08:20:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 812, 2024-09-10T08:20:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.042653385, 2024-09-10T08:20:28.360 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000052528 2024-09-10T08:20:28.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.360 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-09-10T08:20:28.360 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.360 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.360 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.360 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.361 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-10T08:20:28.361 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T08:20:28.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.361 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-09-10T08:20:28.361 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-09-10T08:20:28.361 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-09-10T08:20:28.361 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 3862, 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.115862700, 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000030000 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.362 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 0, 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 0, 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 0, 2024-09-10T08:20:28.363 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-09-10T08:20:28.364 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 0, 2024-09-10T08:20:28.364 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2024-09-10T08:20:28.364 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2024-09-10T08:20:28.364 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 0, 2024-09-10T08:20:28.364 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 0, 2024-09-10T08:20:28.364 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 0, 2024-09-10T08:20:28.364 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2024-09-10T08:20:28.364 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 0, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 0, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 0, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 0, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 1, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 0, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 0, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 0, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2024-09-10T08:20:28.365 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T08:20:28.366 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 0, 2024-09-10T08:20:28.367 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 0, 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 0 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 0, 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 0, 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 0, 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 0, 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 0, 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 0, 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 0, 2024-09-10T08:20:28.368 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-09-10T08:20:28.369 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-09-10T08:20:28.369 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-09-10T08:20:28.369 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-09-10T08:20:28.369 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-09-10T08:20:28.369 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-09-10T08:20:28.369 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-09-10T08:20:28.369 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_path": 0, 2024-09-10T08:20:28.369 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_inode": 0, 2024-09-10T08:20:28.369 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T08:20:28.369 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2024-09-10T08:20:28.369 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-09-10T08:20:28.370 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2024-09-10T08:20:28.370 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-09-10T08:20:28.370 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2024-09-10T08:20:28.370 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.370 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-09-10T08:20:28.370 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 0, 2024-09-10T08:20:28.370 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 0, 2024-09-10T08:20:28.370 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2024-09-10T08:20:28.370 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2024-09-10T08:20:28.370 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 8, 2024-09-10T08:20:28.370 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-09-10T08:20:28.370 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 0, 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 2, 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 2, 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 4194304, 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 4196494, 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 4196353, 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.371 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 8 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 3, 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 3, 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 0, 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 1, 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 1, 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 0, 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 0, 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 0, 2024-09-10T08:20:28.372 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 0, 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 0, 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 0, 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 0, 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 48412, 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 215328 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 0, 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 0, 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 0, 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.373 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-09-10T08:20:28.374 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.375 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-09-10T08:20:28.376 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.377 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.378 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-09-10T08:20:28.379 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.380 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.381 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-09-10T08:20:28.382 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.383 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:28.384 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 0, 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 3, 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 3, 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 2, 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 0, 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 0, 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 1347, 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-09-10T08:20:28.385 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-09-10T08:20:28.386 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-09-10T08:20:28.387 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 189410, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 52, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-09-10T08:20:28.388 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 8224, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 181, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 8512, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 13, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-09-10T08:20:28.389 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 2329, 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 21, 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 3, 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 2329, 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2329, 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2.270959207, 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000975079 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.390 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-09-10T08:20:28.391 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-09-10T08:20:28.391 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2329, 2024-09-10T08:20:28.391 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2330 2024-09-10T08:20:28.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.391 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 2329, 2024-09-10T08:20:28.391 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 2329, 2024-09-10T08:20:28.391 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 0, 2024-09-10T08:20:28.391 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-09-10T08:20:28.391 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 1517, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 0, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 810, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 0, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 0, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 0, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-09-10T08:20:28.392 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 1, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-09-10T08:20:28.393 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-09-10T08:20:28.394 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 96, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 13, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 5, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 5, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 0, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 2, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 0 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 0, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-09-10T08:20:28.395 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: "osd-slow-ops": { 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 0 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 0, 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed_ops": 0, 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 0, 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.396 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 2598, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 1950648, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 2598, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2598, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 1950648, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.397 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 2329, 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 2195, 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2329, 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 2195, 2024-09-10T08:20:28.398 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:28.399 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 2329, 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 2329, 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 2329, 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 2329, 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:28.400 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:28.401 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x5562c1444b40": { 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-09-10T08:20:28.402 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-09-10T08:20:28.403 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-09-10T08:20:28.403 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:28.403 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-10T08:20:28.403 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-10T08:20:29.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:29 smithi153 ceph-mon[35609]: pgmap v365: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:29.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:29 smithi022 ceph-mon[30854]: pgmap v365: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:29.273 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-10T08:20:29.273 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-10T08:20:29.273 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-09-10T08:20:29.273 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-09-10T08:20:29.273 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-09-10T08:20:29.273 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T08:20:29.284 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T08:20:29.284 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T08:20:29.284 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:20:29.360 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-10T08:20:29.360 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:20:29.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:29 smithi100 ceph-mon[35102]: pgmap v365: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T08:20:29.421 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T08:20:29.733 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:20:30.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.485+0000 7f0f057b8640 1 -- 172.21.15.22:0/704994718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f00106f00 msgr2=0x7f0f0010ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:30.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.485+0000 7f0f057b8640 1 --2- 172.21.15.22:0/704994718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f00106f00 0x7f0f0010ea80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009ca0 tx=0x7f0ef802a8c0 comp rx=0 tx=0).stop 2024-09-10T08:20:30.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.485+0000 7f0f057b8640 1 -- 172.21.15.22:0/704994718 shutdown_connections 2024-09-10T08:20:30.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.485+0000 7f0f057b8640 1 --2- 172.21.15.22:0/704994718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f00106f00 0x7f0f0010ea80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:30.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.485+0000 7f0f057b8640 1 --2- 172.21.15.22:0/704994718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f00102780 0x7f0f001067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:30.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.485+0000 7f0f057b8640 1 --2- 172.21.15.22:0/704994718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00101dd0 0x7f0f001021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:30.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.485+0000 7f0f057b8640 1 -- 172.21.15.22:0/704994718 >> 172.21.15.22:0/704994718 conn(0x7f0f000fd8b0 msgr2=0x7f0f000ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:30.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.486+0000 7f0f057b8640 1 -- 172.21.15.22:0/704994718 shutdown_connections 2024-09-10T08:20:30.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.486+0000 7f0f057b8640 1 -- 172.21.15.22:0/704994718 wait complete. 2024-09-10T08:20:30.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.486+0000 7f0f057b8640 1 Processor -- start 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.486+0000 7f0f057b8640 1 -- start start 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0f057b8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f00101dd0 0x7f0f000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0f057b8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00102780 0x7f0f00074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0f057b8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f00106f00 0x7f0f00074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0f057b8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00111fb0 con 0x7f0f00106f00 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0f057b8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00111e30 con 0x7f0f00101dd0 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0f057b8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0f00112130 con 0x7f0f00102780 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0eff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f00106f00 0x7f0f00074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0efeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f00101dd0 0x7f0f000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0efeffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f00101dd0 0x7f0f000744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.22:35470/0 (socket says 172.21.15.22:35470) 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0eff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f00106f00 0x7f0f00074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50152/0 (socket says 172.21.15.22:50152) 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0efeffd640 1 -- 172.21.15.22:0/2662318582 learned_addr learned my addr 172.21.15.22:0/2662318582 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:20:30.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0efe7fc640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00102780 0x7f0f00074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0efeffd640 1 -- 172.21.15.22:0/2662318582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00102780 msgr2=0x7f0f00074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0efeffd640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00102780 0x7f0f00074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0efeffd640 1 -- 172.21.15.22:0/2662318582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f00106f00 msgr2=0x7f0f00074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0efeffd640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f00106f00 0x7f0f00074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0efeffd640 1 -- 172.21.15.22:0/2662318582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f001a6890 con 0x7f0f00101dd0 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0efe7fc640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00102780 0x7f0f00074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0eff7fe640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f00106f00 0x7f0f00074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0efeffd640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f00101dd0 0x7f0f000744f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000e9f0 tx=0x7f0ef000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.487+0000 7f0ee7fff640 1 -- 172.21.15.22:0/2662318582 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef000cd80 con 0x7f0f00101dd0 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.488+0000 7f0f057b8640 1 -- 172.21.15.22:0/2662318582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f001a6b80 con 0x7f0f00101dd0 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.488+0000 7f0f057b8640 1 -- 172.21.15.22:0/2662318582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f001a70c0 con 0x7f0f00101dd0 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.488+0000 7f0ee7fff640 1 -- 172.21.15.22:0/2662318582 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ef0005500 con 0x7f0f00101dd0 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.488+0000 7f0ee7fff640 1 -- 172.21.15.22:0/2662318582 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0010690 con 0x7f0f00101dd0 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.489+0000 7f0f057b8640 1 -- 172.21.15.22:0/2662318582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f001021b0 con 0x7f0f00101dd0 2024-09-10T08:20:30.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.490+0000 7f0ee7fff640 1 -- 172.21.15.22:0/2662318582 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f0ef00046c0 con 0x7f0f00101dd0 2024-09-10T08:20:30.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.491+0000 7f0ee7fff640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f0ee80a2cf0 0x7f0ee80a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:30.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.491+0000 7f0efe7fc640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f0ee80a2cf0 0x7f0ee80a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:30.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.491+0000 7f0ee7fff640 1 -- 172.21.15.22:0/2662318582 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8542+0+0 (secure 0 0 0) 0x7f0ef00cfb00 con 0x7f0f00101dd0 2024-09-10T08:20:30.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.491+0000 7f0efe7fc640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f0ee80a2cf0 0x7f0ee80a51b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4005fd0 tx=0x7f0ef4005850 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:30.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.494+0000 7f0ee7fff640 1 -- 172.21.15.22:0/2662318582 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0ef00541b0 con 0x7f0f00101dd0 2024-09-10T08:20:30.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.681+0000 7f0f057b8640 1 -- 172.21.15.22:0/2662318582 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0f0010a170 con 0x7f0f00101dd0 2024-09-10T08:20:30.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.681+0000 7f0ee7fff640 1 -- 172.21.15.22:0/2662318582 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v96) ==== 81+0+940 (secure 0 0 0) 0x7f0ef009c710 con 0x7f0f00101dd0 2024-09-10T08:20:30.681 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/3248665282 2024-09-11T08:08:47.387046+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1730890938 2024-09-11T08:08:47.387046+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/278091300 2024-09-11T07:59:36.505631+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1708436544 2024-09-11T07:59:36.505631+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/3970835433 2024-09-11T07:59:36.505631+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/3337107310 2024-09-11T07:59:36.505631+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/3970835433 2024-09-11T07:59:36.505631+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/2108462626 2024-09-11T08:00:00.858281+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/17773609 2024-09-11T08:00:00.858281+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1519904928 2024-09-11T08:00:00.858281+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/17773609 2024-09-11T08:00:00.858281+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/1767260330 2024-09-11T08:08:47.387046+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/467191986 2024-09-11T08:08:47.387046+0000 2024-09-10T08:20:30.682 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/3072001022 2024-09-11T08:00:00.858281+0000 2024-09-10T08:20:30.683 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/3164953486 2024-09-11T08:08:47.387046+0000 2024-09-10T08:20:30.683 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/1767260330 2024-09-11T08:08:47.387046+0000 2024-09-10T08:20:30.683 INFO:teuthology.orchestra.run.smithi022.stderr:listed 16 entries 2024-09-10T08:20:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.684+0000 7f0f057b8640 1 -- 172.21.15.22:0/2662318582 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f0ee80a2cf0 msgr2=0x7f0ee80a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.684+0000 7f0f057b8640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f0ee80a2cf0 0x7f0ee80a51b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4005fd0 tx=0x7f0ef4005850 comp rx=0 tx=0).stop 2024-09-10T08:20:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.684+0000 7f0f057b8640 1 -- 172.21.15.22:0/2662318582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f00101dd0 msgr2=0x7f0f000744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.684+0000 7f0f057b8640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f00101dd0 0x7f0f000744f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000e9f0 tx=0x7f0ef000edf0 comp rx=0 tx=0).stop 2024-09-10T08:20:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.684+0000 7f0f057b8640 1 -- 172.21.15.22:0/2662318582 shutdown_connections 2024-09-10T08:20:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.684+0000 7f0f057b8640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0f00106f00 0x7f0f00074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.684+0000 7f0f057b8640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f00102780 0x7f0f00074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.684+0000 7f0f057b8640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f0ee80a2cf0 0x7f0ee80a51b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.684+0000 7f0f057b8640 1 --2- 172.21.15.22:0/2662318582 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0f00101dd0 0x7f0f000744f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:30.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.684+0000 7f0f057b8640 1 -- 172.21.15.22:0/2662318582 >> 172.21.15.22:0/2662318582 conn(0x7f0f000fd8b0 msgr2=0x7f0f000fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:30.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.684+0000 7f0f057b8640 1 -- 172.21.15.22:0/2662318582 shutdown_connections 2024-09-10T08:20:30.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:30.684+0000 7f0f057b8640 1 -- 172.21.15.22:0/2662318582 wait complete. 2024-09-10T08:20:31.253 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:31 smithi022 ceph-mon[30854]: pgmap v366: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-10T08:20:31.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:31 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2662318582' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T08:20:31.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:31 smithi100 ceph-mon[35102]: pgmap v366: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-10T08:20:31.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:31 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2662318582' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T08:20:31.380 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:20:31.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:20:31.380 DEBUG:teuthology.orchestra.run.smithi022:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:20:31.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:31 smithi153 ceph-mon[35609]: pgmap v366: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-10T08:20:31.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:31 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2662318582' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-10T08:20:31.562 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2024-09-10T08:20:31.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:20:31.562 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:20:31.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:20:31.618 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-10T08:20:31.680 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:20:31.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:20:31.681 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:20:31.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:20:31.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-09-10T08:20:31.799 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T08:20:31.810 INFO:tasks.cephadm:Teardown begin 2024-09-10T08:20:31.810 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:20:31.810 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:20:32.069 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:20:32.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.536+0000 7fccdf7d2640 1 -- 172.21.15.22:0/1501395223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccd8100a60 msgr2=0x7fccd8100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.536+0000 7fccdf7d2640 1 --2- 172.21.15.22:0/1501395223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccd8100a60 0x7fccd8100ec0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009930 tx=0x7fccc802a420 comp rx=0 tx=0).stop 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.536+0000 7fccdf7d2640 1 -- 172.21.15.22:0/1501395223 shutdown_connections 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.536+0000 7fccdf7d2640 1 --2- 172.21.15.22:0/1501395223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd8101400 0x7fccd810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.536+0000 7fccdf7d2640 1 --2- 172.21.15.22:0/1501395223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccd8100a60 0x7fccd8100ec0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.536+0000 7fccdf7d2640 1 --2- 172.21.15.22:0/1501395223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd8106a60 0x7fccd8106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.536+0000 7fccdf7d2640 1 -- 172.21.15.22:0/1501395223 >> 172.21.15.22:0/1501395223 conn(0x7fccd80fc780 msgr2=0x7fccd80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.536+0000 7fccdf7d2640 1 -- 172.21.15.22:0/1501395223 shutdown_connections 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.536+0000 7fccdf7d2640 1 -- 172.21.15.22:0/1501395223 wait complete. 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccdf7d2640 1 Processor -- start 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccdf7d2640 1 -- start start 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccdf7d2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd8100a60 0x7fccd8102630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccdf7d2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd8101400 0x7fccd8102b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccdf7d2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccd8106a60 0x7fccd81030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:32.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccdf7d2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fccd8110e60 con 0x7fccd8106a60 2024-09-10T08:20:32.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccdf7d2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fccd8110ce0 con 0x7fccd8100a60 2024-09-10T08:20:32.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccdf7d2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fccd8110fe0 con 0x7fccd8101400 2024-09-10T08:20:32.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccddd6f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccd8106a60 0x7fccd81030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:32.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccddd6f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccd8106a60 0x7fccd81030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50164/0 (socket says 172.21.15.22:50164) 2024-09-10T08:20:32.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccddd6f640 1 -- 172.21.15.22:0/3566853399 learned_addr learned my addr 172.21.15.22:0/3566853399 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:20:32.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccdcd6d640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd8101400 0x7fccd8102b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:32.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.537+0000 7fccdd56e640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd8100a60 0x7fccd8102630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:32.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.538+0000 7fccddd6f640 1 -- 172.21.15.22:0/3566853399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd8101400 msgr2=0x7fccd8102b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:32.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.538+0000 7fccddd6f640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd8101400 0x7fccd8102b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:32.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.538+0000 7fccddd6f640 1 -- 172.21.15.22:0/3566853399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd8100a60 msgr2=0x7fccd8102630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:32.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.538+0000 7fccddd6f640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd8100a60 0x7fccd8102630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:32.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.538+0000 7fccddd6f640 1 -- 172.21.15.22:0/3566853399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd81a6870 con 0x7fccd8106a60 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.538+0000 7fccddd6f640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccd8106a60 0x7fccd81030b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fccd000eaa0 tx=0x7fccd000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.538+0000 7fccce7fc640 1 -- 172.21.15.22:0/3566853399 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0004d20 con 0x7fccd8106a60 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.538+0000 7fccdf7d2640 1 -- 172.21.15.22:0/3566853399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd81a6b60 con 0x7fccd8106a60 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.538+0000 7fccce7fc640 1 -- 172.21.15.22:0/3566853399 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fccd0005020 con 0x7fccd8106a60 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.538+0000 7fccce7fc640 1 -- 172.21.15.22:0/3566853399 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd00116d0 con 0x7fccd8106a60 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.538+0000 7fccdf7d2640 1 -- 172.21.15.22:0/3566853399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd81a7070 con 0x7fccd8106a60 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.539+0000 7fccdf7d2640 1 -- 172.21.15.22:0/3566853399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccd8100ec0 con 0x7fccd8106a60 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.540+0000 7fccce7fc640 1 -- 172.21.15.22:0/3566853399 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fccd00051d0 con 0x7fccd8106a60 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.541+0000 7fccce7fc640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fccc40a2cf0 0x7fccc40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.541+0000 7fccdd56e640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fccc40a2cf0 0x7fccc40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.541+0000 7fccce7fc640 1 -- 172.21.15.22:0/3566853399 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8542+0+0 (secure 0 0 0) 0x7fccd00cf600 con 0x7fccd8106a60 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.542+0000 7fccdd56e640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fccc40a2cf0 0x7fccc40a51b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fccd400ab60 tx=0x7fccd400a2d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:32.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.545+0000 7fccce7fc640 1 -- 172.21.15.22:0/3566853399 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fccd0016030 con 0x7fccd8106a60 2024-09-10T08:20:32.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.758+0000 7fccdf7d2640 1 -- 172.21.15.22:0/3566853399 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fccd81a7300 con 0x7fccd8106a60 2024-09-10T08:20:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.759+0000 7fccce7fc640 1 -- 172.21.15.22:0/3566853399 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11964 (secure 0 0 0) 0x7fccd009c1b0 con 0x7fccd8106a60 2024-09-10T08:20:32.760 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:20:32.760 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":34,"btime":"2024-09-10T08:19:58:010990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:06:54.609910+0000","modified":"2024-09-10T08:19:57.779763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24512,"mds_1":24479,"mds_2":24469,"mds_3":24455,"mds_4":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/896927555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":896927555},{"type":"v1","addr":"172.21.15.22:6839","nonce":896927555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14622":{"gid":14622,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.22:6841/969125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":969125},{"type":"v1","addr":"172.21.15.22:6841","nonce":969125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/2417436521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2417436521},{"type":"v1","addr":"172.21.15.153:6837","nonce":2417436521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/1766856743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1766856743},{"type":"v1","addr":"172.21.15.153:6839","nonce":1766856743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/1987693702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1987693702},{"type":"v1","addr":"172.21.15.100:6837","nonce":1987693702}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/2512683674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":2512683674},{"type":"v1","addr":"172.21.15.100:6839","nonce":2512683674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24512,"qdb_cluster":[14622,24455,24469,24479,24512]},"id":1}]} 2024-09-10T08:20:32.760 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 34 2024-09-10T08:20:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.761+0000 7fccdf7d2640 1 -- 172.21.15.22:0/3566853399 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fccc40a2cf0 msgr2=0x7fccc40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.761+0000 7fccdf7d2640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fccc40a2cf0 0x7fccc40a51b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fccd400ab60 tx=0x7fccd400a2d0 comp rx=0 tx=0).stop 2024-09-10T08:20:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.761+0000 7fccdf7d2640 1 -- 172.21.15.22:0/3566853399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccd8106a60 msgr2=0x7fccd81030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.761+0000 7fccdf7d2640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccd8106a60 0x7fccd81030b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fccd000eaa0 tx=0x7fccd000eea0 comp rx=0 tx=0).stop 2024-09-10T08:20:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.761+0000 7fccdf7d2640 1 -- 172.21.15.22:0/3566853399 shutdown_connections 2024-09-10T08:20:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.761+0000 7fccdf7d2640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccd8106a60 0x7fccd81030b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.761+0000 7fccdf7d2640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd8101400 0x7fccd8102b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.761+0000 7fccdf7d2640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fccc40a2cf0 0x7fccc40a51b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.761+0000 7fccdf7d2640 1 --2- 172.21.15.22:0/3566853399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccd8100a60 0x7fccd8102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.761+0000 7fccdf7d2640 1 -- 172.21.15.22:0/3566853399 >> 172.21.15.22:0/3566853399 conn(0x7fccd80fc780 msgr2=0x7fccd81047d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.762+0000 7fccdf7d2640 1 -- 172.21.15.22:0/3566853399 shutdown_connections 2024-09-10T08:20:32.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:32.762+0000 7fccdf7d2640 1 -- 172.21.15.22:0/3566853399 wait complete. 2024-09-10T08:20:33.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:33 smithi100 ceph-mon[35102]: pgmap v367: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:20:33.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:33 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3566853399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:20:33.383 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:33 smithi022 ceph-mon[30854]: pgmap v367: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:20:33.383 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:33 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3566853399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:20:33.416 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T08:20:33.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:33 smithi153 ceph-mon[35609]: pgmap v367: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-10T08:20:33.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:33 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3566853399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:20:33.686 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:20:34.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.256+0000 7fa6fa81d640 1 -- 172.21.15.22:0/4137238918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6f4102d30 msgr2=0x7fa6f4103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:34.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.256+0000 7fa6fa81d640 1 --2- 172.21.15.22:0/4137238918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6f4102d30 0x7fa6f4103110 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009930 tx=0x7fa6e402a420 comp rx=0 tx=0).stop 2024-09-10T08:20:34.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.256+0000 7fa6fa81d640 1 -- 172.21.15.22:0/4137238918 shutdown_connections 2024-09-10T08:20:34.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.256+0000 7fa6fa81d640 1 --2- 172.21.15.22:0/4137238918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f41082a0 0x7fa6f410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:34.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.256+0000 7fa6fa81d640 1 --2- 172.21.15.22:0/4137238918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f41036e0 0x7fa6f4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.256+0000 7fa6fa81d640 1 --2- 172.21.15.22:0/4137238918 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6f4102d30 0x7fa6f4103110 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.256+0000 7fa6fa81d640 1 -- 172.21.15.22:0/4137238918 >> 172.21.15.22:0/4137238918 conn(0x7fa6f40fc7d0 msgr2=0x7fa6f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.256+0000 7fa6fa81d640 1 -- 172.21.15.22:0/4137238918 shutdown_connections 2024-09-10T08:20:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.256+0000 7fa6fa81d640 1 -- 172.21.15.22:0/4137238918 wait complete. 2024-09-10T08:20:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.256+0000 7fa6fa81d640 1 Processor -- start 2024-09-10T08:20:34.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.256+0000 7fa6fa81d640 1 -- start start 2024-09-10T08:20:34.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6fa81d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f4102d30 0x7fa6f4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:34.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6fa81d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6f41036e0 0x7fa6f4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:34.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6fa81d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f41082a0 0x7fa6f4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:34.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6fa81d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f41120a0 con 0x7fa6f41036e0 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6fa81d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4111f20 con 0x7fa6f4102d30 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6fa81d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4112220 con 0x7fa6f41082a0 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6f37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6f41036e0 0x7fa6f4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6f37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6f41036e0 0x7fa6f4100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60492/0 (socket says 172.21.15.22:60492) 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6f8dba640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f41082a0 0x7fa6f4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6f37fe640 1 -- 172.21.15.22:0/3362866600 learned_addr learned my addr 172.21.15.22:0/3362866600 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6f3fff640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f4102d30 0x7fa6f4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6f37fe640 1 -- 172.21.15.22:0/3362866600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f41082a0 msgr2=0x7fa6f4101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.257+0000 7fa6f37fe640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f41082a0 0x7fa6f4101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.258+0000 7fa6f37fe640 1 -- 172.21.15.22:0/3362866600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f4102d30 msgr2=0x7fa6f4100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.258+0000 7fa6f37fe640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f4102d30 0x7fa6f4100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.258+0000 7fa6f37fe640 1 -- 172.21.15.22:0/3362866600 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f41a6a20 con 0x7fa6f41036e0 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.258+0000 7fa6f8dba640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f41082a0 0x7fa6f4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:20:34.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.258+0000 7fa6f37fe640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6f41036e0 0x7fa6f4100ed0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800d740 tx=0x7fa6e800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:34.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.258+0000 7fa6f17fa640 1 -- 172.21.15.22:0/3362866600 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8017070 con 0x7fa6f41036e0 2024-09-10T08:20:34.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.258+0000 7fa6fa81d640 1 -- 172.21.15.22:0/3362866600 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f41a6d10 con 0x7fa6f41036e0 2024-09-10T08:20:34.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.258+0000 7fa6f17fa640 1 -- 172.21.15.22:0/3362866600 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6e800de50 con 0x7fa6f41036e0 2024-09-10T08:20:34.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.258+0000 7fa6f17fa640 1 -- 172.21.15.22:0/3362866600 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800f6b0 con 0x7fa6f41036e0 2024-09-10T08:20:34.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.258+0000 7fa6fa81d640 1 -- 172.21.15.22:0/3362866600 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f41a7240 con 0x7fa6f41036e0 2024-09-10T08:20:34.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.259+0000 7fa6fa81d640 1 -- 172.21.15.22:0/3362866600 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f406a850 con 0x7fa6f41036e0 2024-09-10T08:20:34.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.261+0000 7fa6f17fa640 1 -- 172.21.15.22:0/3362866600 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa6e801a070 con 0x7fa6f41036e0 2024-09-10T08:20:34.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.261+0000 7fa6f17fa640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fa6dc0a2cf0 0x7fa6dc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:34.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.261+0000 7fa6f3fff640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fa6dc0a2cf0 0x7fa6dc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:34.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.261+0000 7fa6f17fa640 1 -- 172.21.15.22:0/3362866600 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8542+0+0 (secure 0 0 0) 0x7fa6e80cedb0 con 0x7fa6f41036e0 2024-09-10T08:20:34.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.262+0000 7fa6f3fff640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fa6dc0a2cf0 0x7fa6dc0a51b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009900 tx=0x7fa6e40058d0 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:34.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.265+0000 7fa6f17fa640 1 -- 172.21.15.22:0/3362866600 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa6e809b370 con 0x7fa6f41036e0 2024-09-10T08:20:34.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.478+0000 7fa6fa81d640 1 -- 172.21.15.22:0/3362866600 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa6f410a2b0 con 0x7fa6f41036e0 2024-09-10T08:20:34.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.479+0000 7fa6f17fa640 1 -- 172.21.15.22:0/3362866600 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11964 (secure 0 0 0) 0x7fa6e809f670 con 0x7fa6f41036e0 2024-09-10T08:20:34.480 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:20:34.480 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":34,"btime":"2024-09-10T08:19:58:010990+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/343815013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":343815013},{"type":"v1","addr":"172.21.15.22:6835","nonce":343815013}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/959719178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":959719178},{"type":"v1","addr":"172.21.15.22:6837","nonce":959719178}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T08:06:54.609910+0000","modified":"2024-09-10T08:19:57.779763+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24512,"mds_1":24479,"mds_2":24469,"mds_3":24455,"mds_4":14622},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/896927555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":896927555},{"type":"v1","addr":"172.21.15.22:6839","nonce":896927555}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14622":{"gid":14622,"name":"a","rank":4,"incarnation":25,"state":"up:active","state_seq":7,"addr":"172.21.15.22:6841/969125","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":969125},{"type":"v1","addr":"172.21.15.22:6841","nonce":969125}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6833/3705787109","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3705787109},{"type":"v1","addr":"172.21.15.153:6833","nonce":3705787109}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6833/1178134620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1178134620},{"type":"v1","addr":"172.21.15.100:6833","nonce":1178134620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/3505190925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3505190925},{"type":"v1","addr":"172.21.15.153:6835","nonce":3505190925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/2417436521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":2417436521},{"type":"v1","addr":"172.21.15.153:6837","nonce":2417436521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6835/800491506","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":800491506},{"type":"v1","addr":"172.21.15.100:6835","nonce":800491506}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6839/1766856743","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1766856743},{"type":"v1","addr":"172.21.15.153:6839","nonce":1766856743}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24479":{"gid":24479,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6837/1987693702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1987693702},{"type":"v1","addr":"172.21.15.100:6837","nonce":1987693702}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24512":{"gid":24512,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/2512683674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":2512683674},{"type":"v1","addr":"172.21.15.100:6839","nonce":2512683674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24512,"qdb_cluster":[14622,24455,24469,24479,24512]},"id":1}]} 2024-09-10T08:20:34.481 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 34 2024-09-10T08:20:34.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.481+0000 7fa6fa81d640 1 -- 172.21.15.22:0/3362866600 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fa6dc0a2cf0 msgr2=0x7fa6dc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:34.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.481+0000 7fa6fa81d640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fa6dc0a2cf0 0x7fa6dc0a51b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009900 tx=0x7fa6e40058d0 comp rx=0 tx=0).stop 2024-09-10T08:20:34.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.481+0000 7fa6fa81d640 1 -- 172.21.15.22:0/3362866600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6f41036e0 msgr2=0x7fa6f4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:34.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.481+0000 7fa6fa81d640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6f41036e0 0x7fa6f4100ed0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800d740 tx=0x7fa6e800dc00 comp rx=0 tx=0).stop 2024-09-10T08:20:34.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.481+0000 7fa6fa81d640 1 -- 172.21.15.22:0/3362866600 shutdown_connections 2024-09-10T08:20:34.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.481+0000 7fa6fa81d640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f41082a0 0x7fa6f4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.481+0000 7fa6fa81d640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6f41036e0 0x7fa6f4100ed0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.481+0000 7fa6fa81d640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fa6dc0a2cf0 0x7fa6dc0a51b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.481+0000 7fa6fa81d640 1 --2- 172.21.15.22:0/3362866600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6f4102d30 0x7fa6f4100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.481+0000 7fa6fa81d640 1 -- 172.21.15.22:0/3362866600 >> 172.21.15.22:0/3362866600 conn(0x7fa6f40fc7d0 msgr2=0x7fa6f4105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.481+0000 7fa6fa81d640 1 -- 172.21.15.22:0/3362866600 shutdown_connections 2024-09-10T08:20:34.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:34.481+0000 7fa6fa81d640 1 -- 172.21.15.22:0/3362866600 wait complete. 2024-09-10T08:20:35.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:35 smithi100 ceph-mon[35102]: pgmap v368: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-10T08:20:35.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:35 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3362866600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:20:35.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:35 smithi153 ceph-mon[35609]: pgmap v368: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-10T08:20:35.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:35 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3362866600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:20:35.503 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:35 smithi022 ceph-mon[30854]: pgmap v368: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-10T08:20:35.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:35 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3362866600' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-10T08:20:36.354 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T08:20:36.618 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:20:37.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.098+0000 7f8803aa8640 1 -- 172.21.15.22:0/2198716353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87fc101de0 msgr2=0x7f87fc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:37.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.098+0000 7f8803aa8640 1 --2- 172.21.15.22:0/2198716353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87fc101de0 0x7f87fc1021c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009900 tx=0x7f87f802a410 comp rx=0 tx=0).stop 2024-09-10T08:20:37.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.098+0000 7f8803aa8640 1 -- 172.21.15.22:0/2198716353 shutdown_connections 2024-09-10T08:20:37.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.098+0000 7f8803aa8640 1 --2- 172.21.15.22:0/2198716353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87fc106f10 0x7f87fc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:37.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.098+0000 7f8803aa8640 1 --2- 172.21.15.22:0/2198716353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87fc102790 0x7f87fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:37.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.098+0000 7f8803aa8640 1 --2- 172.21.15.22:0/2198716353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87fc101de0 0x7f87fc1021c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:37.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.098+0000 7f8803aa8640 1 -- 172.21.15.22:0/2198716353 >> 172.21.15.22:0/2198716353 conn(0x7f87fc0fd8c0 msgr2=0x7f87fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:37.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.098+0000 7f8803aa8640 1 -- 172.21.15.22:0/2198716353 shutdown_connections 2024-09-10T08:20:37.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.098+0000 7f8803aa8640 1 -- 172.21.15.22:0/2198716353 wait complete. 2024-09-10T08:20:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.099+0000 7f8803aa8640 1 Processor -- start 2024-09-10T08:20:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.099+0000 7f8803aa8640 1 -- start start 2024-09-10T08:20:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.099+0000 7f8803aa8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87fc101de0 0x7f87fc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.099+0000 7f8803aa8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87fc102790 0x7f87fc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.099+0000 7f8803aa8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87fc106f10 0x7f87fc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8803aa8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc112010 con 0x7f87fc101de0 2024-09-10T08:20:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8803aa8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc111e90 con 0x7f87fc106f10 2024-09-10T08:20:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8803aa8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc112190 con 0x7f87fc102790 2024-09-10T08:20:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8801844640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87fc101de0 0x7f87fc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8801844640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87fc101de0 0x7f87fc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60502/0 (socket says 172.21.15.22:60502) 2024-09-10T08:20:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8801844640 1 -- 172.21.15.22:0/122916491 learned_addr learned my addr 172.21.15.22:0/122916491 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:20:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8801043640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87fc102790 0x7f87fc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8802045640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87fc106f10 0x7f87fc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8801844640 1 -- 172.21.15.22:0/122916491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87fc102790 msgr2=0x7f87fc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8801844640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87fc102790 0x7f87fc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8801844640 1 -- 172.21.15.22:0/122916491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87fc106f10 msgr2=0x7f87fc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8801844640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87fc106f10 0x7f87fc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8801844640 1 -- 172.21.15.22:0/122916491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc1a6a70 con 0x7f87fc101de0 2024-09-10T08:20:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8801043640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87fc102790 0x7f87fc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:20:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8802045640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87fc106f10 0x7f87fc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:20:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8801844640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87fc101de0 0x7f87fc0744f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f87f8005ab0 tx=0x7f87f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f87f2ffd640 1 -- 172.21.15.22:0/122916491 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f803f030 con 0x7f87fc101de0 2024-09-10T08:20:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f87f2ffd640 1 -- 172.21.15.22:0/122916491 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87f8003ce0 con 0x7f87fc101de0 2024-09-10T08:20:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f8803aa8640 1 -- 172.21.15.22:0/122916491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87fc1a6d00 con 0x7f87fc101de0 2024-09-10T08:20:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.100+0000 7f87f2ffd640 1 -- 172.21.15.22:0/122916491 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f8035070 con 0x7f87fc101de0 2024-09-10T08:20:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.101+0000 7f8803aa8640 1 -- 172.21.15.22:0/122916491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87fc1a71d0 con 0x7f87fc101de0 2024-09-10T08:20:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.102+0000 7f8803aa8640 1 -- 172.21.15.22:0/122916491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87fc102240 con 0x7f87fc101de0 2024-09-10T08:20:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.103+0000 7f87f2ffd640 1 -- 172.21.15.22:0/122916491 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f87f8042030 con 0x7f87fc101de0 2024-09-10T08:20:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.104+0000 7f87f2ffd640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f87e80a2d70 0x7f87e80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.104+0000 7f8801043640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f87e80a2d70 0x7f87e80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.104+0000 7f87f2ffd640 1 -- 172.21.15.22:0/122916491 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8542+0+0 (secure 0 0 0) 0x7f87f80efda0 con 0x7f87fc101de0 2024-09-10T08:20:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.104+0000 7f8801043640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f87e80a2d70 0x7f87e80a5230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87fc075f80 tx=0x7f87ec008040 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:37.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.108+0000 7f87f2ffd640 1 -- 172.21.15.22:0/122916491 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f87f80bc9b0 con 0x7f87fc101de0 2024-09-10T08:20:37.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.288+0000 7f8803aa8640 1 -- 172.21.15.22:0/122916491 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87fc109b60 con 0x7f87fc101de0 2024-09-10T08:20:37.289 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:37 smithi022 ceph-mon[30854]: pgmap v369: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-10T08:20:37.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.291+0000 7f87f2ffd640 1 -- 172.21.15.22:0/122916491 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+23258 (secure 0 0 0) 0x7f87f80b6e20 con 0x7f87fc101de0 2024-09-10T08:20:37.291 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-10T08:20:37.291 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":96,"fsid":"71bf679e-6f4a-11ef-bcea-c7b262605968","created":"2024-09-10T07:59:04.704048+0000","modified":"2024-09-10T08:20:19.787008+0000","last_up_change":"2024-09-10T08:06:02.535944+0000","last_in_change":"2024-09-10T08:05:39.070554+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:02:15.371265+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:06:50.358155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:06:52.896201+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":95,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8d296bd3-28a7-418c-ad73-343a5e806cfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6803","nonce":4248555152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6805","nonce":4248555152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6809","nonce":4248555152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":4248555152},{"type":"v1","addr":"172.21.15.22:6807","nonce":4248555152}]},"public_addr":"172.21.15.22:6803/4248555152","cluster_addr":"172.21.15.22:6805/4248555152","heartbeat_back_addr":"172.21.15.22:6809/4248555152","heartbeat_front_addr":"172.21.15.22:6807/4248555152","state":["exists","up"]},{"osd":1,"uuid":"c1e2b40e-b4ab-475a-8a9e-c67409f46b6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6801","nonce":2078646052}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6803","nonce":2078646052}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6807","nonce":2078646052}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2078646052},{"type":"v1","addr":"172.21.15.100:6805","nonce":2078646052}]},"public_addr":"172.21.15.100:6801/2078646052","cluster_addr":"172.21.15.100:6803/2078646052","heartbeat_back_addr":"172.21.15.100:6807/2078646052","heartbeat_front_addr":"172.21.15.100:6805/2078646052","state":["exists","up"]},{"osd":2,"uuid":"be6ca6ce-921c-46b5-93e9-c8f9d79b5cb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6801","nonce":2492419476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6803","nonce":2492419476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6807","nonce":2492419476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2492419476},{"type":"v1","addr":"172.21.15.153:6805","nonce":2492419476}]},"public_addr":"172.21.15.153:6801/2492419476","cluster_addr":"172.21.15.153:6803/2492419476","heartbeat_back_addr":"172.21.15.153:6807/2492419476","heartbeat_front_addr":"172.21.15.153:6805/2492419476","state":["exists","up"]},{"osd":3,"uuid":"e980a3ba-c659-4473-9633-9cbe88296d70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6811","nonce":3674495276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6813","nonce":3674495276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6817","nonce":3674495276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":3674495276},{"type":"v1","addr":"172.21.15.22:6815","nonce":3674495276}]},"public_addr":"172.21.15.22:6811/3674495276","cluster_addr":"172.21.15.22:6813/3674495276","heartbeat_back_addr":"172.21.15.22:6817/3674495276","heartbeat_front_addr":"172.21.15.22:6815/3674495276","state":["exists","up"]},{"osd":4,"uuid":"b37d0590-99b1-4566-96b4-9936890d4308","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6809","nonce":3886932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6811","nonce":3886932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6815","nonce":3886932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3886932513},{"type":"v1","addr":"172.21.15.100:6813","nonce":3886932513}]},"public_addr":"172.21.15.100:6809/3886932513","cluster_addr":"172.21.15.100:6811/3886932513","heartbeat_back_addr":"172.21.15.100:6815/3886932513","heartbeat_front_addr":"172.21.15.100:6813/3886932513","state":["exists","up"]},{"osd":5,"uuid":"6cb989a0-80a1-4a9a-8b45-51b47772b203","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6809","nonce":120732073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6811","nonce":120732073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6815","nonce":120732073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":120732073},{"type":"v1","addr":"172.21.15.153:6813","nonce":120732073}]},"public_addr":"172.21.15.153:6809/120732073","cluster_addr":"172.21.15.153:6811/120732073","heartbeat_back_addr":"172.21.15.153:6815/120732073","heartbeat_front_addr":"172.21.15.153:6813/120732073","state":["exists","up"]},{"osd":6,"uuid":"294887f3-3e58-4b02-884d-4e0a70a86d16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6819","nonce":3692536487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6821","nonce":3692536487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6825","nonce":3692536487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":3692536487},{"type":"v1","addr":"172.21.15.22:6823","nonce":3692536487}]},"public_addr":"172.21.15.22:6819/3692536487","cluster_addr":"172.21.15.22:6821/3692536487","heartbeat_back_addr":"172.21.15.22:6825/3692536487","heartbeat_front_addr":"172.21.15.22:6823/3692536487","state":["exists","up"]},{"osd":7,"uuid":"d0c0ec61-4055-46f3-a4b0-39f04c735452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6817","nonce":1221175921}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6819","nonce":1221175921}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6823","nonce":1221175921}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1221175921},{"type":"v1","addr":"172.21.15.100:6821","nonce":1221175921}]},"public_addr":"172.21.15.100:6817/1221175921","cluster_addr":"172.21.15.100:6819/1221175921","heartbeat_back_addr":"172.21.15.100:6823/1221175921","heartbeat_front_addr":"172.21.15.100:6821/1221175921","state":["exists","up"]},{"osd":8,"uuid":"bda45a16-742e-4eda-b4d4-e01d6f3dc92e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6817","nonce":1153053941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6819","nonce":1153053941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6823","nonce":1153053941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":1153053941},{"type":"v1","addr":"172.21.15.153:6821","nonce":1153053941}]},"public_addr":"172.21.15.153:6817/1153053941","cluster_addr":"172.21.15.153:6819/1153053941","heartbeat_back_addr":"172.21.15.153:6823/1153053941","heartbeat_front_addr":"172.21.15.153:6821/1153053941","state":["exists","up"]},{"osd":9,"uuid":"48bd3544-9028-4535-801b-3d39ecadf48e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6827","nonce":3423218876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6829","nonce":3423218876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6833","nonce":3423218876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":3423218876},{"type":"v1","addr":"172.21.15.22:6831","nonce":3423218876}]},"public_addr":"172.21.15.22:6827/3423218876","cluster_addr":"172.21.15.22:6829/3423218876","heartbeat_back_addr":"172.21.15.22:6833/3423218876","heartbeat_front_addr":"172.21.15.22:6831/3423218876","state":["exists","up"]},{"osd":10,"uuid":"c8716aa0-eb93-435d-a9d0-dd4c3dce1954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6825","nonce":2024112643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6827","nonce":2024112643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6831","nonce":2024112643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":2024112643},{"type":"v1","addr":"172.21.15.100:6829","nonce":2024112643}]},"public_addr":"172.21.15.100:6825/2024112643","cluster_addr":"172.21.15.100:6827/2024112643","heartbeat_back_addr":"172.21.15.100:6831/2024112643","heartbeat_front_addr":"172.21.15.100:6829/2024112643","state":["exists","up"]},{"osd":11,"uuid":"3c427cfe-8d7c-431e-9eb4-b03cfac3068d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6825","nonce":2245781783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6827","nonce":2245781783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6831","nonce":2245781783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2245781783},{"type":"v1","addr":"172.21.15.153:6829","nonce":2245781783}]},"public_addr":"172.21.15.153:6825/2245781783","cluster_addr":"172.21.15.153:6827/2245781783","heartbeat_back_addr":"172.21.15.153:6831/2245781783","heartbeat_front_addr":"172.21.15.153:6829/2245781783","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:23.001057+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:01:46.353182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:11.469840+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:02:37.557521+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:02.630783+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:27.374057+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:03:53.758498+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:19.507846+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:04:45.080789+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:10.286820+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:05:35.565950+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:06:00.633384+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/3248665282":"2024-09-11T08:08:47.387046+0000","172.21.15.22:0/1730890938":"2024-09-11T08:08:47.387046+0000","172.21.15.22:0/278091300":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/1708436544":"2024-09-11T07:59:36.505631+0000","172.21.15.22:6801/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/3337107310":"2024-09-11T07:59:36.505631+0000","172.21.15.22:6800/3970835433":"2024-09-11T07:59:36.505631+0000","172.21.15.22:0/2108462626":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6800/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/1519904928":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6801/17773609":"2024-09-11T08:00:00.858281+0000","172.21.15.22:6801/1767260330":"2024-09-11T08:08:47.387046+0000","172.21.15.22:0/467191986":"2024-09-11T08:08:47.387046+0000","172.21.15.22:0/3072001022":"2024-09-11T08:00:00.858281+0000","172.21.15.22:0/3164953486":"2024-09-11T08:08:47.387046+0000","172.21.15.22:6800/1767260330":"2024-09-11T08:08:47.387046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:20:37.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.294+0000 7f8803aa8640 1 -- 172.21.15.22:0/122916491 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f87e80a2d70 msgr2=0x7f87e80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.294+0000 7f8803aa8640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f87e80a2d70 0x7f87e80a5230 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87fc075f80 tx=0x7f87ec008040 comp rx=0 tx=0).stop 2024-09-10T08:20:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.294+0000 7f8803aa8640 1 -- 172.21.15.22:0/122916491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87fc101de0 msgr2=0x7f87fc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.294+0000 7f8803aa8640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87fc101de0 0x7f87fc0744f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f87f8005ab0 tx=0x7f87f80042f0 comp rx=0 tx=0).stop 2024-09-10T08:20:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.294+0000 7f8803aa8640 1 -- 172.21.15.22:0/122916491 shutdown_connections 2024-09-10T08:20:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.294+0000 7f8803aa8640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f87e80a2d70 0x7f87e80a5230 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.294+0000 7f8803aa8640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87fc106f10 0x7f87fc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.294+0000 7f8803aa8640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87fc102790 0x7f87fc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.294+0000 7f8803aa8640 1 --2- 172.21.15.22:0/122916491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87fc101de0 0x7f87fc0744f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.294+0000 7f8803aa8640 1 -- 172.21.15.22:0/122916491 >> 172.21.15.22:0/122916491 conn(0x7f87fc0fd8c0 msgr2=0x7f87fc0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.294+0000 7f8803aa8640 1 -- 172.21.15.22:0/122916491 shutdown_connections 2024-09-10T08:20:37.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:37.294+0000 7f8803aa8640 1 -- 172.21.15.22:0/122916491 wait complete. 2024-09-10T08:20:37.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:37 smithi100 ceph-mon[35102]: pgmap v369: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-10T08:20:37.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:37 smithi153 ceph-mon[35609]: pgmap v369: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-10T08:20:37.993 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T08:20:38.258 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:20:38.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:38 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/122916491' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:20:38.379 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:38 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/122916491' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:20:38.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:38 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/122916491' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-10T08:20:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.832+0000 7f7d5e73a640 1 -- 172.21.15.22:0/25045027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d58101df0 msgr2=0x7f7d58105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.832+0000 7f7d5e73a640 1 --2- 172.21.15.22:0/25045027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d58101df0 0x7f7d58105920 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009900 tx=0x7f7d4c02a410 comp rx=0 tx=0).stop 2024-09-10T08:20:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.832+0000 7f7d5e73a640 1 -- 172.21.15.22:0/25045027 shutdown_connections 2024-09-10T08:20:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.832+0000 7f7d5e73a640 1 --2- 172.21.15.22:0/25045027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58106050 0x7f7d5810dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.832+0000 7f7d5e73a640 1 --2- 172.21.15.22:0/25045027 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d58101df0 0x7f7d58105920 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.832+0000 7f7d5e73a640 1 --2- 172.21.15.22:0/25045027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d58101440 0x7f7d58101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.832+0000 7f7d5e73a640 1 -- 172.21.15.22:0/25045027 >> 172.21.15.22:0/25045027 conn(0x7f7d58077210 msgr2=0x7f7d580fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:38.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.832+0000 7f7d5e73a640 1 -- 172.21.15.22:0/25045027 shutdown_connections 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.832+0000 7f7d5e73a640 1 -- 172.21.15.22:0/25045027 wait complete. 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.832+0000 7f7d5e73a640 1 Processor -- start 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.832+0000 7f7d5e73a640 1 -- start start 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d5e73a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d58101440 0x7f7d58198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d5e73a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d58101df0 0x7f7d58198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d5e73a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58106050 0x7f7d5819cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d5e73a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58111070 con 0x7f7d58101440 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d5e73a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58110ef0 con 0x7f7d58101df0 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d5e73a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581111f0 con 0x7f7d58106050 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d57fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d58101440 0x7f7d58198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d57fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d58101440 0x7f7d58198690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60516/0 (socket says 172.21.15.22:60516) 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d57fff640 1 -- 172.21.15.22:0/2256571646 learned_addr learned my addr 172.21.15.22:0/2256571646 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:20:38.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d577fe640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d58101df0 0x7f7d58198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d5ccd7640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58106050 0x7f7d5819cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d57fff640 1 -- 172.21.15.22:0/2256571646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58106050 msgr2=0x7f7d5819cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d57fff640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58106050 0x7f7d5819cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d57fff640 1 -- 172.21.15.22:0/2256571646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d58101df0 msgr2=0x7f7d58198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d57fff640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d58101df0 0x7f7d58198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d57fff640 1 -- 172.21.15.22:0/2256571646 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5819d640 con 0x7f7d58101440 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d5ccd7640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58106050 0x7f7d5819cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d577fe640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d58101df0 0x7f7d58198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d57fff640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d58101440 0x7f7d58198690 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800c890 tx=0x7f7d4800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d557fa640 1 -- 172.21.15.22:0/2256571646 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d48004220 con 0x7f7d58101440 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d5e73a640 1 -- 172.21.15.22:0/2256571646 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d5819d930 con 0x7f7d58101440 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.833+0000 7f7d557fa640 1 -- 172.21.15.22:0/2256571646 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d480043c0 con 0x7f7d58101440 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.834+0000 7f7d557fa640 1 -- 172.21.15.22:0/2256571646 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d480049e0 con 0x7f7d58101440 2024-09-10T08:20:38.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.834+0000 7f7d5e73a640 1 -- 172.21.15.22:0/2256571646 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d581a5210 con 0x7f7d58101440 2024-09-10T08:20:38.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.835+0000 7f7d5e73a640 1 -- 172.21.15.22:0/2256571646 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d58101820 con 0x7f7d58101440 2024-09-10T08:20:38.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.836+0000 7f7d557fa640 1 -- 172.21.15.22:0/2256571646 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f7d480079b0 con 0x7f7d58101440 2024-09-10T08:20:38.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.836+0000 7f7d557fa640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f7d400a2cf0 0x7f7d400a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:38.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.836+0000 7f7d577fe640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f7d400a2cf0 0x7f7d400a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:38.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.836+0000 7f7d557fa640 1 -- 172.21.15.22:0/2256571646 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8542+0+0 (secure 0 0 0) 0x7f7d480cf570 con 0x7f7d58101440 2024-09-10T08:20:38.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.837+0000 7f7d577fe640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f7d400a2cf0 0x7f7d400a51b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7d58105a10 tx=0x7f7d4c005a20 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:38.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:38.841+0000 7f7d557fa640 1 -- 172.21.15.22:0/2256571646 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d48014030 con 0x7f7d58101440 2024-09-10T08:20:39.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.055+0000 7f7d5e73a640 1 -- 172.21.15.22:0/2256571646 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7d5806a570 con 0x7f7d58101440 2024-09-10T08:20:39.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.058+0000 7f7d557fa640 1 -- 172.21.15.22:0/2256571646 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7f7d4809c180 con 0x7f7d58101440 2024-09-10T08:20:39.057 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:20:39.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.061+0000 7f7d5e73a640 1 -- 172.21.15.22:0/2256571646 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f7d400a2cf0 msgr2=0x7f7d400a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:39.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.061+0000 7f7d5e73a640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f7d400a2cf0 0x7f7d400a51b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7d58105a10 tx=0x7f7d4c005a20 comp rx=0 tx=0).stop 2024-09-10T08:20:39.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.061+0000 7f7d5e73a640 1 -- 172.21.15.22:0/2256571646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d58101440 msgr2=0x7f7d58198690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:39.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.061+0000 7f7d5e73a640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d58101440 0x7f7d58198690 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800c890 tx=0x7f7d4800cd50 comp rx=0 tx=0).stop 2024-09-10T08:20:39.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.061+0000 7f7d5e73a640 1 -- 172.21.15.22:0/2256571646 shutdown_connections 2024-09-10T08:20:39.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.061+0000 7f7d5e73a640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d58106050 0x7f7d5819cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:39.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.061+0000 7f7d5e73a640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f7d400a2cf0 0x7f7d400a51b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:39.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.061+0000 7f7d5e73a640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d58101df0 0x7f7d58198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:39.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.061+0000 7f7d5e73a640 1 --2- 172.21.15.22:0/2256571646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d58101440 0x7f7d58198690 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:39.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.061+0000 7f7d5e73a640 1 -- 172.21.15.22:0/2256571646 >> 172.21.15.22:0/2256571646 conn(0x7f7d58077210 msgr2=0x7f7d58100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:39.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.062+0000 7f7d5e73a640 1 -- 172.21.15.22:0/2256571646 shutdown_connections 2024-09-10T08:20:39.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:39.062+0000 7f7d5e73a640 1 -- 172.21.15.22:0/2256571646 wait complete. 2024-09-10T08:20:39.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-mon[35102]: pgmap v370: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T08:20:39.369 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-e[64086]: ignoring --setuser ceph since I am not root 2024-09-10T08:20:39.369 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-e[64086]: ignoring --setgroup ceph since I am not root 2024-09-10T08:20:39.369 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-mds[64090]: -- 172.21.15.100:0/1825106891 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5561dc2b7860 con 0x5561dc295400 2024-09-10T08:20:39.369 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-e[64086]: starting mds.e at 2024-09-10T08:20:39.369 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b[64699]: ignoring --setuser ceph since I am not root 2024-09-10T08:20:39.370 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b[64699]: ignoring --setgroup ceph since I am not root 2024-09-10T08:20:39.370 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-mds[64703]: -- 172.21.15.100:0/3172798271 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5620c94a7860 con 0x5620c9485400 2024-09-10T08:20:39.370 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b[64699]: starting mds.b at 2024-09-10T08:20:39.370 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-k[63770]: ignoring --setuser ceph since I am not root 2024-09-10T08:20:39.370 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-k[63770]: ignoring --setgroup ceph since I am not root 2024-09-10T08:20:39.370 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-mds[63774]: -- 172.21.15.100:0/577946451 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ff96123c20 con 0x55ff96100800 2024-09-10T08:20:39.370 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-k[63770]: starting mds.k at 2024-09-10T08:20:39.370 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-h[64385]: ignoring --setuser ceph since I am not root 2024-09-10T08:20:39.371 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-h[64385]: ignoring --setgroup ceph since I am not root 2024-09-10T08:20:39.371 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-mds[64389]: -- 172.21.15.100:0/3591501483 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562606969860 con 0x562606946800 2024-09-10T08:20:39.371 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:20:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-h[64385]: starting mds.h at 2024-09-10T08:20:39.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:39 smithi022 ceph-mon[30854]: pgmap v370: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T08:20:39.428 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a[30850]: 2024-09-10T08:20:39.056+0000 7fcb8821e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:20:39.429 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:20:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-a[69755]: ignoring --setuser ceph since I am not root 2024-09-10T08:20:39.429 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:20:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-a[69755]: ignoring --setgroup ceph since I am not root 2024-09-10T08:20:39.429 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:20:39 smithi022 ceph-mds[69759]: -- 172.21.15.22:0/3374802561 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55848b3a1860 con 0x55848b37e800 2024-09-10T08:20:39.429 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:20:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-a[69755]: starting mds.a at 2024-09-10T08:20:39.429 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:20:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-g[69420]: ignoring --setuser ceph since I am not root 2024-09-10T08:20:39.429 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:20:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-g[69420]: ignoring --setgroup ceph since I am not root 2024-09-10T08:20:39.429 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:20:39 smithi022 ceph-mds[69428]: -- 172.21.15.22:0/3519769967 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5612aff57860 con 0x5612aff34800 2024-09-10T08:20:39.429 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:20:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-g[69420]: starting mds.g at 2024-09-10T08:20:39.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-mon[35609]: pgmap v370: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-10T08:20:39.444 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-i[65865]: ignoring --setuser ceph since I am not root 2024-09-10T08:20:39.444 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-i[65865]: ignoring --setgroup ceph since I am not root 2024-09-10T08:20:39.444 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-mds[65870]: -- 172.21.15.153:0/1838675590 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56292dad9860 con 0x56292dab6800 2024-09-10T08:20:39.444 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-i[65865]: starting mds.i at 2024-09-10T08:20:39.445 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-f[65258]: ignoring --setuser ceph since I am not root 2024-09-10T08:20:39.445 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-f[65258]: ignoring --setgroup ceph since I am not root 2024-09-10T08:20:39.445 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-mds[65262]: -- 172.21.15.153:0/3494714341 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56332b1af860 con 0x56332b18d000 2024-09-10T08:20:39.445 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-f[65258]: starting mds.f at 2024-09-10T08:20:39.445 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-l[64954]: ignoring --setuser ceph since I am not root 2024-09-10T08:20:39.445 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-l[64954]: ignoring --setgroup ceph since I am not root 2024-09-10T08:20:39.445 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-mds[64958]: -- 172.21.15.153:0/3872855117 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b361959860 con 0x55b361936800 2024-09-10T08:20:39.445 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-l[64954]: starting mds.l at 2024-09-10T08:20:39.446 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-c[65564]: ignoring --setuser ceph since I am not root 2024-09-10T08:20:39.446 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-c[65564]: ignoring --setgroup ceph since I am not root 2024-09-10T08:20:39.446 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-mds[65568]: -- 172.21.15.153:0/3539408714 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5615b8437860 con 0x5615b8415000 2024-09-10T08:20:39.446 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:20:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-c[65564]: starting mds.c at 2024-09-10T08:20:39.776 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:20:40.035 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:20:40.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:40 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2256571646' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T08:20:40.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:40 smithi022 ceph-mon[30854]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T08:20:40.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:40 smithi022 ceph-mon[30854]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:20:40.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:40 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/2256571646' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T08:20:40.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:40 smithi022 ceph-mon[30854]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T08:20:40.317 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:40 smithi022 ceph-mon[30854]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T08:20:40.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:40 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2256571646' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T08:20:40.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:40 smithi100 ceph-mon[35102]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T08:20:40.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:40 smithi100 ceph-mon[35102]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:20:40.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:40 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/2256571646' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T08:20:40.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:40 smithi100 ceph-mon[35102]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T08:20:40.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:40 smithi100 ceph-mon[35102]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T08:20:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:40 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2256571646' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-10T08:20:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:40 smithi153 ceph-mon[35609]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T08:20:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:40 smithi153 ceph-mon[35609]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:20:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:40 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/2256571646' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T08:20:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:40 smithi153 ceph-mon[35609]: osdmap e97: 12 total, 12 up, 12 in 2024-09-10T08:20:40.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:40 smithi153 ceph-mon[35609]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-10T08:20:40.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.560+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/988239405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f8101e10 msgr2=0x7fa3f81021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:40.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.560+0000 7fa3fe0d0640 1 --2- 172.21.15.22:0/988239405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f8101e10 0x7fa3f81021f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8009900 tx=0x7fa3e802a410 comp rx=0 tx=0).stop 2024-09-10T08:20:40.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.560+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/988239405 shutdown_connections 2024-09-10T08:20:40.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.560+0000 7fa3fe0d0640 1 --2- 172.21.15.22:0/988239405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f8106f40 0x7fa3f810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.560+0000 7fa3fe0d0640 1 --2- 172.21.15.22:0/988239405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f81027c0 0x7fa3f8106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.560+0000 7fa3fe0d0640 1 --2- 172.21.15.22:0/988239405 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f8101e10 0x7fa3f81021f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.560+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/988239405 >> 172.21.15.22:0/988239405 conn(0x7fa3f80fd8d0 msgr2=0x7fa3f80ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.560+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/988239405 shutdown_connections 2024-09-10T08:20:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.560+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/988239405 wait complete. 2024-09-10T08:20:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.560+0000 7fa3fe0d0640 1 Processor -- start 2024-09-10T08:20:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3fe0d0640 1 -- start start 2024-09-10T08:20:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3fe0d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f8101e10 0x7fa3f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3fe0d0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f81027c0 0x7fa3f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3fe0d0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f8106f40 0x7fa3f8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3fe0d0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8111fc0 con 0x7fa3f8101e10 2024-09-10T08:20:40.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3fe0d0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8111e40 con 0x7fa3f81027c0 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3fe0d0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8112140 con 0x7fa3f8106f40 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3f77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f8101e10 0x7fa3f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3f77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f8101e10 0x7fa3f80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60564/0 (socket says 172.21.15.22:60564) 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3f77fe640 1 -- 172.21.15.22:0/3097484080 learned_addr learned my addr 172.21.15.22:0/3097484080 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3f7fff640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f8106f40 0x7fa3f8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3f6ffd640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f81027c0 0x7fa3f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3f77fe640 1 -- 172.21.15.22:0/3097484080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f8106f40 msgr2=0x7fa3f8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3f77fe640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f8106f40 0x7fa3f8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3f77fe640 1 -- 172.21.15.22:0/3097484080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f81027c0 msgr2=0x7fa3f8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3f77fe640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f81027c0 0x7fa3f8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3f77fe640 1 -- 172.21.15.22:0/3097484080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f81a6980 con 0x7fa3f8101e10 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3f7fff640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f8106f40 0x7fa3f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.561+0000 7fa3f6ffd640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f81027c0 0x7fa3f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:20:40.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.562+0000 7fa3f77fe640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f8101e10 0x7fa3f80744f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8005ab0 tx=0x7fa3e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.562+0000 7fa3f4ff9640 1 -- 172.21.15.22:0/3097484080 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e803f030 con 0x7fa3f8101e10 2024-09-10T08:20:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.562+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/3097484080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f81a6c10 con 0x7fa3f8101e10 2024-09-10T08:20:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.562+0000 7fa3f4ff9640 1 -- 172.21.15.22:0/3097484080 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3e8003ce0 con 0x7fa3f8101e10 2024-09-10T08:20:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.562+0000 7fa3f4ff9640 1 -- 172.21.15.22:0/3097484080 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8035070 con 0x7fa3f8101e10 2024-09-10T08:20:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.562+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/3097484080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f81a7140 con 0x7fa3f8101e10 2024-09-10T08:20:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.563+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/3097484080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f81021f0 con 0x7fa3f8101e10 2024-09-10T08:20:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.564+0000 7fa3f4ff9640 1 -- 172.21.15.22:0/3097484080 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fa3e8042030 con 0x7fa3f8101e10 2024-09-10T08:20:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.565+0000 7fa3f4ff9640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fa3e00a2cf0 0x7fa3e00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.565+0000 7fa3f4ff9640 1 -- 172.21.15.22:0/3097484080 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8928+0+0 (secure 0 0 0) 0x7fa3e80f01d0 con 0x7fa3f8101e10 2024-09-10T08:20:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.565+0000 7fa3f6ffd640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fa3e00a2cf0 0x7fa3e00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.565+0000 7fa3f6ffd640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fa3e00a2cf0 0x7fa3e00a51b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8075f80 tx=0x7fa3ec005d30 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:40.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.568+0000 7fa3f4ff9640 1 -- 172.21.15.22:0/3097484080 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3e80bcc60 con 0x7fa3f8101e10 2024-09-10T08:20:40.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:40.781+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/3097484080 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa3f802d7c0 con 0x7fa3f8101e10 2024-09-10T08:20:41.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.066+0000 7fa3f4ff9640 1 -- 172.21.15.22:0/3097484080 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7fa3e80bc560 con 0x7fa3f8101e10 2024-09-10T08:20:41.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.068+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/3097484080 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fa3e00a2cf0 msgr2=0x7fa3e00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:41.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.068+0000 7fa3fe0d0640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fa3e00a2cf0 0x7fa3e00a51b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8075f80 tx=0x7fa3ec005d30 comp rx=0 tx=0).stop 2024-09-10T08:20:41.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.068+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/3097484080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f8101e10 msgr2=0x7fa3f80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:41.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.068+0000 7fa3fe0d0640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f8101e10 0x7fa3f80744f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8005ab0 tx=0x7fa3e80042f0 comp rx=0 tx=0).stop 2024-09-10T08:20:41.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.068+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/3097484080 shutdown_connections 2024-09-10T08:20:41.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.068+0000 7fa3fe0d0640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3f8106f40 0x7fa3f8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:41.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.068+0000 7fa3fe0d0640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fa3e00a2cf0 0x7fa3e00a51b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:41.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.068+0000 7fa3fe0d0640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f81027c0 0x7fa3f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:41.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.068+0000 7fa3fe0d0640 1 --2- 172.21.15.22:0/3097484080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f8101e10 0x7fa3f80744f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:41.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.068+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/3097484080 >> 172.21.15.22:0/3097484080 conn(0x7fa3f80fd8d0 msgr2=0x7fa3f80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:41.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.068+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/3097484080 shutdown_connections 2024-09-10T08:20:41.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:41.068+0000 7fa3fe0d0640 1 -- 172.21.15.22:0/3097484080 wait complete. 2024-09-10T08:20:41.346 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: pgmap v372: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-10T08:20:41.346 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.153:6832/3448971823,v1:172.21.15.153:6833/3448971823] up:boot 2024-09-10T08:20:41.346 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.100:6832/1915716097,v1:172.21.15.100:6834/1915716097] up:boot 2024-09-10T08:20:41.346 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.100:6833/4038983939,v1:172.21.15.100:6835/4038983939] up:boot 2024-09-10T08:20:41.346 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.153:6834/3800829029,v1:172.21.15.153:6835/3800829029] up:boot 2024-09-10T08:20:41.346 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.100:6836/1114292948,v1:172.21.15.100:6837/1114292948] up:boot 2024-09-10T08:20:41.347 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.153:6836/2277322406,v1:172.21.15.153:6837/2277322406] up:boot 2024-09-10T08:20:41.347 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.100:6838/3761393815,v1:172.21.15.100:6839/3761393815] up:boot 2024-09-10T08:20:41.347 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.153:6838/2590361033,v1:172.21.15.153:6839/2590361033] up:boot 2024-09-10T08:20:41.347 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.22:6838/3674790992,v1:172.21.15.22:6840/3674790992] up:boot 2024-09-10T08:20:41.347 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: mds.? [v2:172.21.15.22:6839/1933105958,v1:172.21.15.22:6841/1933105958] up:boot 2024-09-10T08:20:41.347 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T08:20:41.347 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T08:20:41.347 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T08:20:41.347 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T08:20:41.347 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T08:20:41.347 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T08:20:41.347 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T08:20:41.348 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T08:20:41.348 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T08:20:41.348 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T08:20:41.348 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T08:20:41.348 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:41 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3097484080' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T08:20:41.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: pgmap v372: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-10T08:20:41.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.153:6832/3448971823,v1:172.21.15.153:6833/3448971823] up:boot 2024-09-10T08:20:41.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.100:6832/1915716097,v1:172.21.15.100:6834/1915716097] up:boot 2024-09-10T08:20:41.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.100:6833/4038983939,v1:172.21.15.100:6835/4038983939] up:boot 2024-09-10T08:20:41.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.153:6834/3800829029,v1:172.21.15.153:6835/3800829029] up:boot 2024-09-10T08:20:41.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.100:6836/1114292948,v1:172.21.15.100:6837/1114292948] up:boot 2024-09-10T08:20:41.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.153:6836/2277322406,v1:172.21.15.153:6837/2277322406] up:boot 2024-09-10T08:20:41.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.100:6838/3761393815,v1:172.21.15.100:6839/3761393815] up:boot 2024-09-10T08:20:41.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.153:6838/2590361033,v1:172.21.15.153:6839/2590361033] up:boot 2024-09-10T08:20:41.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.22:6838/3674790992,v1:172.21.15.22:6840/3674790992] up:boot 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: mds.? [v2:172.21.15.22:6839/1933105958,v1:172.21.15.22:6841/1933105958] up:boot 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T08:20:41.370 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:41 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3097484080' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T08:20:41.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: pgmap v372: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 716 B/s wr, 11 op/s 2024-09-10T08:20:41.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.153:6832/3448971823,v1:172.21.15.153:6833/3448971823] up:boot 2024-09-10T08:20:41.430 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.100:6832/1915716097,v1:172.21.15.100:6834/1915716097] up:boot 2024-09-10T08:20:41.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.100:6833/4038983939,v1:172.21.15.100:6835/4038983939] up:boot 2024-09-10T08:20:41.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.153:6834/3800829029,v1:172.21.15.153:6835/3800829029] up:boot 2024-09-10T08:20:41.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.100:6836/1114292948,v1:172.21.15.100:6837/1114292948] up:boot 2024-09-10T08:20:41.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.153:6836/2277322406,v1:172.21.15.153:6837/2277322406] up:boot 2024-09-10T08:20:41.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.100:6838/3761393815,v1:172.21.15.100:6839/3761393815] up:boot 2024-09-10T08:20:41.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.153:6838/2590361033,v1:172.21.15.153:6839/2590361033] up:boot 2024-09-10T08:20:41.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.22:6838/3674790992,v1:172.21.15.22:6840/3674790992] up:boot 2024-09-10T08:20:41.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: mds.? [v2:172.21.15.22:6839/1933105958,v1:172.21.15.22:6841/1933105958] up:boot 2024-09-10T08:20:41.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-10T08:20:41.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-10T08:20:41.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-10T08:20:41.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-10T08:20:41.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-10T08:20:41.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-10T08:20:41.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-10T08:20:41.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-10T08:20:41.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-10T08:20:41.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-10T08:20:41.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: from='mgr.15234 172.21.15.22:0/2768079361' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-10T08:20:41.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:41 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3097484080' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-10T08:20:41.755 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:20:42.018 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:20:42.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:42 smithi022 ceph-mon[30854]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T08:20:42.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:42 smithi022 ceph-mon[30854]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T08:20:42.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:42 smithi022 ceph-mon[30854]: Cluster is now healthy 2024-09-10T08:20:42.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:42 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/3097484080' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T08:20:42.254 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:42 smithi022 ceph-mon[30854]: fsmap 12 up:standby 2024-09-10T08:20:42.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:42 smithi100 ceph-mon[35102]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T08:20:42.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:42 smithi100 ceph-mon[35102]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T08:20:42.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:42 smithi100 ceph-mon[35102]: Cluster is now healthy 2024-09-10T08:20:42.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:42 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/3097484080' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T08:20:42.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:42 smithi100 ceph-mon[35102]: fsmap 12 up:standby 2024-09-10T08:20:42.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:42 smithi153 ceph-mon[35609]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T08:20:42.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:42 smithi153 ceph-mon[35609]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T08:20:42.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:42 smithi153 ceph-mon[35609]: Cluster is now healthy 2024-09-10T08:20:42.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:42 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/3097484080' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T08:20:42.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:42 smithi153 ceph-mon[35609]: fsmap 12 up:standby 2024-09-10T08:20:42.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.538+0000 7f5d93663640 1 -- 172.21.15.22:0/2397524973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d8c102570 msgr2=0x7f5d8c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.538+0000 7f5d93663640 1 --2- 172.21.15.22:0/2397524973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d8c102570 0x7f5d8c1029b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009930 tx=0x7f5d7c02a4d0 comp rx=0 tx=0).stop 2024-09-10T08:20:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.538+0000 7f5d93663640 1 -- 172.21.15.22:0/2397524973 shutdown_connections 2024-09-10T08:20:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.538+0000 7f5d93663640 1 --2- 172.21.15.22:0/2397524973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c102ef0 0x7f5d8c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.538+0000 7f5d93663640 1 --2- 172.21.15.22:0/2397524973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d8c102570 0x7f5d8c1029b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.538+0000 7f5d93663640 1 --2- 172.21.15.22:0/2397524973 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d8c100e20 0x7f5d8c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.538+0000 7f5d93663640 1 -- 172.21.15.22:0/2397524973 >> 172.21.15.22:0/2397524973 conn(0x7f5d8c0fc7d0 msgr2=0x7f5d8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.539+0000 7f5d93663640 1 -- 172.21.15.22:0/2397524973 shutdown_connections 2024-09-10T08:20:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.539+0000 7f5d93663640 1 -- 172.21.15.22:0/2397524973 wait complete. 2024-09-10T08:20:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.539+0000 7f5d93663640 1 Processor -- start 2024-09-10T08:20:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.539+0000 7f5d93663640 1 -- start start 2024-09-10T08:20:42.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.539+0000 7f5d93663640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d8c100e20 0x7f5d8c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.539+0000 7f5d93663640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d8c102570 0x7f5d8c10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.539+0000 7f5d93663640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c102ef0 0x7f5d8c10ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.539+0000 7f5d93663640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c112060 con 0x7f5d8c102570 2024-09-10T08:20:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.539+0000 7f5d93663640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c111ee0 con 0x7f5d8c102ef0 2024-09-10T08:20:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.539+0000 7f5d93663640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c1121e0 con 0x7f5d8c100e20 2024-09-10T08:20:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d90bfe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d8c102570 0x7f5d8c10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d913ff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d8c100e20 0x7f5d8c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d90bfe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d8c102570 0x7f5d8c10ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60588/0 (socket says 172.21.15.22:60588) 2024-09-10T08:20:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d90bfe640 1 -- 172.21.15.22:0/1507405612 learned_addr learned my addr 172.21.15.22:0/1507405612 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:20:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d91c00640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c102ef0 0x7f5d8c10ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d90bfe640 1 -- 172.21.15.22:0/1507405612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d8c100e20 msgr2=0x7f5d8c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:42.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d90bfe640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d8c100e20 0x7f5d8c10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d90bfe640 1 -- 172.21.15.22:0/1507405612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c102ef0 msgr2=0x7f5d8c10ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d90bfe640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c102ef0 0x7f5d8c10ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d90bfe640 1 -- 172.21.15.22:0/1507405612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8c1a6a40 con 0x7f5d8c102570 2024-09-10T08:20:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d91c00640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c102ef0 0x7f5d8c10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:20:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d90bfe640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d8c102570 0x7f5d8c10ea10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009230 tx=0x7f5d7c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d827fc640 1 -- 172.21.15.22:0/1507405612 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c03f030 con 0x7f5d8c102570 2024-09-10T08:20:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d93663640 1 -- 172.21.15.22:0/1507405612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8c1a6cd0 con 0x7f5d8c102570 2024-09-10T08:20:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d827fc640 1 -- 172.21.15.22:0/1507405612 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d7c003ad0 con 0x7f5d8c102570 2024-09-10T08:20:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.540+0000 7f5d827fc640 1 -- 172.21.15.22:0/1507405612 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c035070 con 0x7f5d8c102570 2024-09-10T08:20:42.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.541+0000 7f5d93663640 1 -- 172.21.15.22:0/1507405612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8c1a71b0 con 0x7f5d8c102570 2024-09-10T08:20:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.542+0000 7f5d93663640 1 -- 172.21.15.22:0/1507405612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d8c101200 con 0x7f5d8c102570 2024-09-10T08:20:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.543+0000 7f5d827fc640 1 -- 172.21.15.22:0/1507405612 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7f5d7c042030 con 0x7f5d8c102570 2024-09-10T08:20:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.543+0000 7f5d827fc640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f5d780a2cf0 0x7f5d780a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.544+0000 7f5d913ff640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f5d780a2cf0 0x7f5d780a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.544+0000 7f5d827fc640 1 -- 172.21.15.22:0/1507405612 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8928+0+0 (secure 0 0 0) 0x7f5d7c0efa70 con 0x7f5d8c102570 2024-09-10T08:20:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.544+0000 7f5d913ff640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f5d780a2cf0 0x7f5d780a51b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d880099a0 tx=0x7f5d88009500 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:42.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.548+0000 7f5d827fc640 1 -- 172.21.15.22:0/1507405612 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5d7c0bc4c0 con 0x7f5d8c102570 2024-09-10T08:20:42.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:42.723+0000 7f5d93663640 1 -- 172.21.15.22:0/1507405612 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5d8c109090 con 0x7f5d8c102570 2024-09-10T08:20:43.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.083+0000 7f5d827fc640 1 -- 172.21.15.22:0/1507405612 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v98) ==== 181+0+0 (secure 0 0 0) 0x7f5d7c0bbdc0 con 0x7f5d8c102570 2024-09-10T08:20:43.084 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:20:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.086+0000 7f5d93663640 1 -- 172.21.15.22:0/1507405612 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f5d780a2cf0 msgr2=0x7f5d780a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.086+0000 7f5d93663640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f5d780a2cf0 0x7f5d780a51b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d880099a0 tx=0x7f5d88009500 comp rx=0 tx=0).stop 2024-09-10T08:20:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.086+0000 7f5d93663640 1 -- 172.21.15.22:0/1507405612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d8c102570 msgr2=0x7f5d8c10ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.086+0000 7f5d93663640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d8c102570 0x7f5d8c10ea10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009230 tx=0x7f5d7c004270 comp rx=0 tx=0).stop 2024-09-10T08:20:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.087+0000 7f5d93663640 1 -- 172.21.15.22:0/1507405612 shutdown_connections 2024-09-10T08:20:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.087+0000 7f5d93663640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7f5d780a2cf0 0x7f5d780a51b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.087+0000 7f5d93663640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c102ef0 0x7f5d8c10ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.087+0000 7f5d93663640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d8c102570 0x7f5d8c10ea10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.087+0000 7f5d93663640 1 --2- 172.21.15.22:0/1507405612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d8c100e20 0x7f5d8c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:43.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.087+0000 7f5d93663640 1 -- 172.21.15.22:0/1507405612 >> 172.21.15.22:0/1507405612 conn(0x7f5d8c0fc7d0 msgr2=0x7f5d8c104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.087+0000 7f5d93663640 1 -- 172.21.15.22:0/1507405612 shutdown_connections 2024-09-10T08:20:43.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:43.087+0000 7f5d93663640 1 -- 172.21.15.22:0/1507405612 wait complete. 2024-09-10T08:20:43.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:43 smithi100 ceph-mon[35102]: pgmap v373: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2024-09-10T08:20:43.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:43 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1507405612' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T08:20:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:43 smithi022 ceph-mon[30854]: pgmap v373: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2024-09-10T08:20:43.414 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:43 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1507405612' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T08:20:43.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:43 smithi153 ceph-mon[35609]: pgmap v373: 97 pgs: 97 active+clean; 11 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 716 B/s wr, 10 op/s 2024-09-10T08:20:43.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:43 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1507405612' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T08:20:43.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b shell --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:20:44.015 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T08:20:44.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:44 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/1507405612' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T08:20:44.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:44 smithi100 ceph-mon[35102]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T08:20:44.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:44 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/1507405612' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T08:20:44.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:44 smithi022 ceph-mon[30854]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T08:20:44.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:44 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/1507405612' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T08:20:44.445 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:44 smithi153 ceph-mon[35609]: osdmap e98: 12 total, 12 up, 12 in 2024-09-10T08:20:44.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.495+0000 7fe887f8d640 1 -- 172.21.15.22:0/3917263486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880112ba0 msgr2=0x7fe880114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:44.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.495+0000 7fe887f8d640 1 --2- 172.21.15.22:0/3917263486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880112ba0 0x7fe880114f90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe878009ca0 tx=0x7fe87802a950 comp rx=0 tx=0).stop 2024-09-10T08:20:44.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.495+0000 7fe887f8d640 1 -- 172.21.15.22:0/3917263486 shutdown_connections 2024-09-10T08:20:44.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.495+0000 7fe887f8d640 1 --2- 172.21.15.22:0/3917263486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880112ba0 0x7fe880114f90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:44.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.495+0000 7fe887f8d640 1 --2- 172.21.15.22:0/3917263486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe880074eb0 0x7fe880112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:44.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.495+0000 7fe887f8d640 1 --2- 172.21.15.22:0/3917263486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880074590 0x7fe880074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.495+0000 7fe887f8d640 1 -- 172.21.15.22:0/3917263486 >> 172.21.15.22:0/3917263486 conn(0x7fe8800fd8b0 msgr2=0x7fe8800ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.495+0000 7fe887f8d640 1 -- 172.21.15.22:0/3917263486 shutdown_connections 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.495+0000 7fe887f8d640 1 -- 172.21.15.22:0/3917263486 wait complete. 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.496+0000 7fe887f8d640 1 Processor -- start 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.496+0000 7fe887f8d640 1 -- start start 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.496+0000 7fe887f8d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880074590 0x7fe8801a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.496+0000 7fe887f8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880074eb0 0x7fe8801a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.496+0000 7fe887f8d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe880112ba0 0x7fe88019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.496+0000 7fe887f8d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe880118560 con 0x7fe880074590 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.496+0000 7fe887f8d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe8801183e0 con 0x7fe880074eb0 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.496+0000 7fe887f8d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe8801186e0 con 0x7fe880112ba0 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe885d29640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880074590 0x7fe8801a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:44.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe885d29640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880074590 0x7fe8801a46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44082/0 (socket says 172.21.15.22:44082) 2024-09-10T08:20:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe885d29640 1 -- 172.21.15.22:0/4253258303 learned_addr learned my addr 172.21.15.22:0/4253258303 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-10T08:20:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe88652a640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe880112ba0 0x7fe88019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe885528640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880074eb0 0x7fe8801a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe885d29640 1 -- 172.21.15.22:0/4253258303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe880112ba0 msgr2=0x7fe88019e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe885d29640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe880112ba0 0x7fe88019e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe885d29640 1 -- 172.21.15.22:0/4253258303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880074eb0 msgr2=0x7fe8801a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe885d29640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880074eb0 0x7fe8801a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe885d29640 1 -- 172.21.15.22:0/4253258303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88019efa0 con 0x7fe880074590 2024-09-10T08:20:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe88652a640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe880112ba0 0x7fe88019e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:20:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe885528640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880074eb0 0x7fe8801a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:20:44.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe885d29640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880074590 0x7fe8801a46b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00c890 tx=0x7fe87c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe876ffd640 1 -- 172.21.15.22:0/4253258303 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c004220 con 0x7fe880074590 2024-09-10T08:20:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe887f8d640 1 -- 172.21.15.22:0/4253258303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88019f290 con 0x7fe880074590 2024-09-10T08:20:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe876ffd640 1 -- 172.21.15.22:0/4253258303 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe87c0043c0 con 0x7fe880074590 2024-09-10T08:20:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe876ffd640 1 -- 172.21.15.22:0/4253258303 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c004a00 con 0x7fe880074590 2024-09-10T08:20:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.497+0000 7fe887f8d640 1 -- 172.21.15.22:0/4253258303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8801ab580 con 0x7fe880074590 2024-09-10T08:20:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.498+0000 7fe887f8d640 1 -- 172.21.15.22:0/4253258303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe880074970 con 0x7fe880074590 2024-09-10T08:20:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.499+0000 7fe876ffd640 1 -- 172.21.15.22:0/4253258303 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 25) ==== 137964+0+0 (secure 0 0 0) 0x7fe87c0079b0 con 0x7fe880074590 2024-09-10T08:20:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.500+0000 7fe876ffd640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fe86c0a2d70 0x7fe86c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:20:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.500+0000 7fe885528640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fe86c0a2d70 0x7fe86c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:20:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.500+0000 7fe876ffd640 1 -- 172.21.15.22:0/4253258303 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8374+0+0 (secure 0 0 0) 0x7fe87c0cf050 con 0x7fe880074590 2024-09-10T08:20:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.501+0000 7fe885528640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fe86c0a2d70 0x7fe86c0a5230 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe870005d90 tx=0x7fe870005d20 comp rx=0 tx=0).ready entity=mgr.15234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:20:44.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.504+0000 7fe876ffd640 1 -- 172.21.15.22:0/4253258303 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe87c014030 con 0x7fe880074590 2024-09-10T08:20:44.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:44.682+0000 7fe887f8d640 1 -- 172.21.15.22:0/4253258303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe88019fda0 con 0x7fe880074590 2024-09-10T08:20:45.092 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:45 smithi100 ceph-mon[35102]: pgmap v375: 65 pgs: 65 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:20:45.092 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:45 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/4253258303' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T08:20:45.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.094+0000 7fe876ffd640 1 -- 172.21.15.22:0/4253258303 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v99) ==== 169+0+0 (secure 0 0 0) 0x7fe87c09bda0 con 0x7fe880074590 2024-09-10T08:20:45.095 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2024-09-10T08:20:45.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.098+0000 7fe887f8d640 1 -- 172.21.15.22:0/4253258303 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fe86c0a2d70 msgr2=0x7fe86c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:45.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.098+0000 7fe887f8d640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fe86c0a2d70 0x7fe86c0a5230 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe870005d90 tx=0x7fe870005d20 comp rx=0 tx=0).stop 2024-09-10T08:20:45.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.098+0000 7fe887f8d640 1 -- 172.21.15.22:0/4253258303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880074590 msgr2=0x7fe8801a46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:20:45.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.098+0000 7fe887f8d640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880074590 0x7fe8801a46b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00c890 tx=0x7fe87c00cd50 comp rx=0 tx=0).stop 2024-09-10T08:20:45.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.099+0000 7fe887f8d640 1 -- 172.21.15.22:0/4253258303 shutdown_connections 2024-09-10T08:20:45.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.099+0000 7fe887f8d640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe880112ba0 0x7fe88019e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.099+0000 7fe887f8d640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.22:6800/1685162317,v1:172.21.15.22:6801/1685162317] conn(0x7fe86c0a2d70 0x7fe86c0a5230 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.099+0000 7fe887f8d640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe880074eb0 0x7fe8801a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:20:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.099+0000 7fe887f8d640 1 --2- 172.21.15.22:0/4253258303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe880074590 0x7fe8801a46b0 secure :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00c890 tx=0x7fe87c00cd50 comp rx=0 tx=0).stop 2024-09-10T08:20:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.099+0000 7fe887f8d640 1 -- 172.21.15.22:0/4253258303 >> 172.21.15.22:0/4253258303 conn(0x7fe8800fd8b0 msgr2=0x7fe8800fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:20:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.100+0000 7fe887f8d640 1 -- 172.21.15.22:0/4253258303 shutdown_connections 2024-09-10T08:20:45.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-10T08:20:45.100+0000 7fe887f8d640 1 -- 172.21.15.22:0/4253258303 wait complete. 2024-09-10T08:20:45.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:45 smithi022 ceph-mon[30854]: pgmap v375: 65 pgs: 65 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:20:45.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:45 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/4253258303' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T08:20:45.443 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:45 smithi153 ceph-mon[35609]: pgmap v375: 65 pgs: 65 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T08:20:45.444 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:45 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/4253258303' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-10T08:20:45.786 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T08:20:45.820 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T08:20:45.847 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T08:20:45.896 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T08:20:45.896 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T08:20:45.913 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T08:20:45.928 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T08:20:45.950 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T08:20:45.950 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T08:20:45.951 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.a 2024-09-10T08:20:46.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:45 smithi022 systemd[1]: Stopping Ceph mon.a for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:20:46.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:46 smithi153 ceph-mon[35609]: from='client.? 172.21.15.22:0/4253258303' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T08:20:46.194 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:46 smithi153 ceph-mon[35609]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T08:20:46.368 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:46 smithi100 ceph-mon[35102]: from='client.? 172.21.15.22:0/4253258303' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T08:20:46.369 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:46 smithi100 ceph-mon[35102]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T08:20:46.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:46 smithi022 ceph-mon[30854]: from='client.? 172.21.15.22:0/4253258303' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T08:20:46.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:46 smithi022 ceph-mon[30854]: osdmap e99: 12 total, 12 up, 12 in 2024-09-10T08:20:46.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a[30850]: 2024-09-10T08:20:46.287+0000 7fcb8da29640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:20:46.465 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a[30850]: 2024-09-10T08:20:46.287+0000 7fcb8da29640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T08:20:46.753 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:46 smithi022 podman[86596]: 2024-09-10 08:20:46.465677038 +0000 UTC m=+0.302679099 container died 37fd5bc61b8b22766e9916f7ff5554a0ae1369e0e052657a73fdfd409f519cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T08:20:47.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:46 smithi022 podman[86596]: 2024-09-10 08:20:46.888079536 +0000 UTC m=+0.725081585 container cleanup 37fd5bc61b8b22766e9916f7ff5554a0ae1369e0e052657a73fdfd409f519cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T08:20:47.139 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 10 08:20:46 smithi022 bash[86596]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-a 2024-09-10T08:20:47.338 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T08:20:47.391 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:20:47.392 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T08:20:47.392 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T08:20:47.392 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.b 2024-09-10T08:20:47.820 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:47 smithi100 systemd[1]: Stopping Ceph mon.b for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:20:48.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:47 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-b[35098]: 2024-09-10T08:20:47.819+0000 7fa330b6d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:20:48.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:47 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-b[35098]: 2024-09-10T08:20:47.819+0000 7fa330b6d640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T08:20:48.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:47 smithi100 podman[69932]: 2024-09-10 08:20:47.952758317 +0000 UTC m=+0.255703565 container died 38e99a0cc64300e057e6194a19e6e971263652a7c9c753b683a57c21b4079ace (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T08:20:48.618 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:48 smithi100 podman[69932]: 2024-09-10 08:20:48.370335977 +0000 UTC m=+0.673281217 container cleanup 38e99a0cc64300e057e6194a19e6e971263652a7c9c753b683a57c21b4079ace (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:20:48.619 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:48 smithi100 bash[69932]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-b 2024-09-10T08:20:48.901 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T08:20:48.924 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:48 smithi100 podman[69944]: 2024-09-10 08:20:48.672608179 +0000 UTC m=+0.717490766 container remove 38e99a0cc64300e057e6194a19e6e971263652a7c9c753b683a57c21b4079ace (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:20:48.924 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:48 smithi100 systemd[1]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-10T08:20:48.924 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:48 smithi100 systemd[1]: Stopped Ceph mon.b for 71bf679e-6f4a-11ef-bcea-c7b262605968. 2024-09-10T08:20:48.924 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 10 08:20:48 smithi100 systemd[1]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.b.service: Consumed 11.890s CPU time. 2024-09-10T08:20:48.945 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:20:48.945 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T08:20:48.945 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T08:20:48.945 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.c 2024-09-10T08:20:49.267 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:48 smithi153 systemd[1]: Stopping Ceph mon.c for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:20:49.659 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:49 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-c[35605]: 2024-09-10T08:20:49.265+0000 7f4c21db3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:20:49.659 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:49 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-c[35605]: 2024-09-10T08:20:49.265+0000 7f4c21db3640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T08:20:49.659 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:49 smithi153 podman[71502]: 2024-09-10 08:20:49.338717462 +0000 UTC m=+0.198136093 container died 9207258945e9e024b4bf3c57c8ae91385d250d70cf641e9151d365a9ea8bc157 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-c, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:20:49.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:49 smithi153 podman[71502]: 2024-09-10 08:20:49.759250108 +0000 UTC m=+0.618668740 container cleanup 9207258945e9e024b4bf3c57c8ae91385d250d70cf641e9151d365a9ea8bc157 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-c, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T08:20:49.944 INFO:journalctl@ceph.mon.c.smithi153.stdout:Sep 10 08:20:49 smithi153 bash[71502]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mon-c 2024-09-10T08:20:50.195 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T08:20:50.266 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:20:50.266 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T08:20:50.266 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T08:20:50.266 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.x 2024-09-10T08:20:50.584 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:20:50 smithi022 systemd[1]: Stopping Ceph mgr.x for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:20:50.918 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:20:50 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x[31080]: 2024-09-10T08:20:50.584+0000 7f652ca92640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:20:50.918 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:20:50 smithi022 podman[86717]: 2024-09-10 08:20:50.615786046 +0000 UTC m=+0.142117846 container died 87cb76ffedbc842d408afa4cd042e86e54dfd59f18ba09cd5044ece9f85f1356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T08:20:51.253 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:20:51 smithi022 podman[86717]: 2024-09-10 08:20:51.026784512 +0000 UTC m=+0.553116298 container cleanup 87cb76ffedbc842d408afa4cd042e86e54dfd59f18ba09cd5044ece9f85f1356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1cf819b7212a6048e92fc78c4eff963344f6d56b, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T08:20:51.253 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 10 08:20:51 smithi022 bash[86717]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-x 2024-09-10T08:20:51.439 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T08:20:51.476 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:20:51.476 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T08:20:51.476 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T08:20:51.476 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.y 2024-09-10T08:20:51.821 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:20:51 smithi100 systemd[1]: Stopping Ceph mgr.y for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:20:52.119 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:20:51 smithi100 podman[70065]: 2024-09-10 08:20:51.82181412 +0000 UTC m=+0.134011046 container died eaba2fa9f5a5a588037e2dc2a86e4c04b0b8669c8a7ae19a7b7e3fe2bc50b138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, ceph=True) 2024-09-10T08:20:52.619 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:20:52 smithi100 podman[70065]: 2024-09-10 08:20:52.235249177 +0000 UTC m=+0.547446145 container cleanup eaba2fa9f5a5a588037e2dc2a86e4c04b0b8669c8a7ae19a7b7e3fe2bc50b138 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T08:20:52.619 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 10 08:20:52 smithi100 bash[70065]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-y 2024-09-10T08:20:52.922 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T08:20:52.960 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:20:52.960 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T08:20:52.960 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T08:20:52.960 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.z 2024-09-10T08:20:53.293 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:20:53 smithi153 systemd[1]: Stopping Ceph mgr.z for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:20:53.694 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:20:53 smithi153 podman[71624]: 2024-09-10 08:20:53.293666141 +0000 UTC m=+0.144066229 container died b13d21273962cadaeca1ae662c53992336d84b35b4e767e89b3b78c5abdf0cae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T08:20:54.151 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:20:53 smithi153 podman[71624]: 2024-09-10 08:20:53.932542756 +0000 UTC m=+0.782942876 container cleanup b13d21273962cadaeca1ae662c53992336d84b35b4e767e89b3b78c5abdf0cae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-09-10T08:20:54.151 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:20:53 smithi153 bash[71624]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z 2024-09-10T08:20:54.408 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:20:54 smithi153 podman[71636]: 2024-09-10 08:20:54.152430318 +0000 UTC m=+0.849942413 container remove b13d21273962cadaeca1ae662c53992336d84b35b4e767e89b3b78c5abdf0cae (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mgr-z, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T08:20:54.408 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Sep 10 08:20:54 smithi153 systemd[1]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-10T08:20:54.412 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T08:20:54.446 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:20:54.446 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T08:20:54.446 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T08:20:54.446 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.0 2024-09-10T08:20:54.753 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:20:54 smithi022 systemd[1]: Stopping Ceph osd.0 for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:20:55.253 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:20:54 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0[42281]: 2024-09-10T08:20:54.765+0000 7f3d6a41e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:20:55.254 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:20:54 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0[42281]: 2024-09-10T08:20:54.765+0000 7f3d6a41e640 -1 osd.0 99 *** Got signal Terminated *** 2024-09-10T08:20:55.254 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:20:54 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0[42281]: 2024-09-10T08:20:54.765+0000 7f3d6a41e640 -1 osd.0 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:21:00.658 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:21:00 smithi022 podman[86840]: 2024-09-10 08:21:00.37520979 +0000 UTC m=+5.728060333 container died 33c5b4dfb6a0805e98cbf1c2c3cadfa2cb9a727e395576ffe95a0f10fa4e5c16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:21:01.004 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:21:00 smithi022 podman[86840]: 2024-09-10 08:21:00.782302633 +0000 UTC m=+6.135153176 container cleanup 33c5b4dfb6a0805e98cbf1c2c3cadfa2cb9a727e395576ffe95a0f10fa4e5c16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:21:01.004 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:21:00 smithi022 bash[86840]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0 2024-09-10T08:21:01.503 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:21:01 smithi022 podman[86856]: 2024-09-10 08:21:01.076083232 +0000 UTC m=+0.700133337 container remove 33c5b4dfb6a0805e98cbf1c2c3cadfa2cb9a727e395576ffe95a0f10fa4e5c16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T08:21:01.795 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:21:01 smithi022 podman[86946]: 2024-09-10 08:21:01.430102788 +0000 UTC m=+0.016468638 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:21:01.795 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:21:01 smithi022 podman[86946]: 2024-09-10 08:21:01.551967844 +0000 UTC m=+0.138333689 container create 199b2313e63e78fe5ead08557e0bba3d132fd9f691673224feaf2011dfea6891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T08:21:02.181 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:21:01 smithi022 podman[86946]: 2024-09-10 08:21:01.796330939 +0000 UTC m=+0.382696785 container init 199b2313e63e78fe5ead08557e0bba3d132fd9f691673224feaf2011dfea6891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T08:21:02.182 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:21:01 smithi022 podman[86946]: 2024-09-10 08:21:01.799814811 +0000 UTC m=+0.386180659 container start 199b2313e63e78fe5ead08557e0bba3d132fd9f691673224feaf2011dfea6891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:21:02.182 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:21:01 smithi022 podman[86946]: 2024-09-10 08:21:01.88822202 +0000 UTC m=+0.474587941 container attach 199b2313e63e78fe5ead08557e0bba3d132fd9f691673224feaf2011dfea6891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-10T08:21:02.473 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 10 08:21:02 smithi022 podman[86946]: 2024-09-10 08:21:02.182614309 +0000 UTC m=+0.768980154 container died 199b2313e63e78fe5ead08557e0bba3d132fd9f691673224feaf2011dfea6891 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:21:02.828 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T08:21:02.873 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:21:02.873 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T08:21:02.873 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T08:21:02.873 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.1 2024-09-10T08:21:03.173 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:02 smithi100 systemd[1]: Stopping Ceph osd.1 for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:21:03.619 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1[39568]: 2024-09-10T08:21:03.173+0000 7f2205f7b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:21:03.619 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1[39568]: 2024-09-10T08:21:03.173+0000 7f2205f7b640 -1 osd.1 99 *** Got signal Terminated *** 2024-09-10T08:21:03.619 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1[39568]: 2024-09-10T08:21:03.173+0000 7f2205f7b640 -1 osd.1 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:21:09.067 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:08 smithi100 podman[70188]: 2024-09-10 08:21:08.75123371 +0000 UTC m=+5.679450199 container died d61e66fd19c2cf8f5c553a06215da460d67625fef6f3d08daf7bb8d89a1835b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T08:21:09.369 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:09 smithi100 podman[70188]: 2024-09-10 08:21:09.165426395 +0000 UTC m=+6.093642874 container cleanup d61e66fd19c2cf8f5c553a06215da460d67625fef6f3d08daf7bb8d89a1835b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T08:21:09.369 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:09 smithi100 bash[70188]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1 2024-09-10T08:21:09.829 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:09 smithi100 podman[70203]: 2024-09-10 08:21:09.417132937 +0000 UTC m=+0.666890641 container remove d61e66fd19c2cf8f5c553a06215da460d67625fef6f3d08daf7bb8d89a1835b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T08:21:10.119 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:09 smithi100 podman[70293]: 2024-09-10 08:21:09.73221033 +0000 UTC m=+0.016241910 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:21:10.119 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:09 smithi100 podman[70293]: 2024-09-10 08:21:09.860026767 +0000 UTC m=+0.144058338 container create ecfb46171bdf97040aa18c16430877c765c87d434bb88bf7ef052f24910de05e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T08:21:10.388 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:10 smithi100 podman[70293]: 2024-09-10 08:21:10.120973221 +0000 UTC m=+0.405004804 container init ecfb46171bdf97040aa18c16430877c765c87d434bb88bf7ef052f24910de05e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:21:10.388 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:10 smithi100 podman[70293]: 2024-09-10 08:21:10.124391279 +0000 UTC m=+0.408422868 container start ecfb46171bdf97040aa18c16430877c765c87d434bb88bf7ef052f24910de05e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T08:21:10.388 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:10 smithi100 podman[70293]: 2024-09-10 08:21:10.22953511 +0000 UTC m=+0.513566686 container attach ecfb46171bdf97040aa18c16430877c765c87d434bb88bf7ef052f24910de05e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T08:21:10.388 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 10 08:21:10 smithi100 podman[70293]: 2024-09-10 08:21:10.351452503 +0000 UTC m=+0.635484088 container died ecfb46171bdf97040aa18c16430877c765c87d434bb88bf7ef052f24910de05e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T08:21:10.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T08:21:11.030 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:21:11.030 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T08:21:11.030 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T08:21:11.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.2 2024-09-10T08:21:11.345 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:11 smithi153 systemd[1]: Stopping Ceph osd.2 for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:21:11.694 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:11 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2[40606]: 2024-09-10T08:21:11.344+0000 7f27a1aaa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:21:11.694 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:11 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2[40606]: 2024-09-10T08:21:11.344+0000 7f27a1aaa640 -1 osd.2 99 *** Got signal Terminated *** 2024-09-10T08:21:11.694 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:11 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2[40606]: 2024-09-10T08:21:11.344+0000 7f27a1aaa640 -1 osd.2 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:21:17.162 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:16 smithi153 podman[71752]: 2024-09-10 08:21:16.84667273 +0000 UTC m=+5.620399490 container died 82054a018405f3a06ce065065d2b8bd0a939a3f729195dfd772c78154fe77fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:21:17.444 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:17 smithi153 podman[71752]: 2024-09-10 08:21:17.279131011 +0000 UTC m=+6.052857780 container cleanup 82054a018405f3a06ce065065d2b8bd0a939a3f729195dfd772c78154fe77fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T08:21:17.444 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:17 smithi153 bash[71752]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2 2024-09-10T08:21:17.944 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:17 smithi153 podman[71780]: 2024-09-10 08:21:17.50574687 +0000 UTC m=+0.654651892 container remove 82054a018405f3a06ce065065d2b8bd0a939a3f729195dfd772c78154fe77fea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T08:21:18.216 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:17 smithi153 podman[71870]: 2024-09-10 08:21:17.851787974 +0000 UTC m=+0.015707643 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:21:18.217 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:17 smithi153 podman[71870]: 2024-09-10 08:21:17.964897466 +0000 UTC m=+0.128817124 container create 1412fd687c7340a9cf5994fbbfef5ca7c38dd020868da916e13e48ac6f4d87eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-10T08:21:18.694 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:18 smithi153 podman[71870]: 2024-09-10 08:21:18.217857789 +0000 UTC m=+0.381777455 container init 1412fd687c7340a9cf5994fbbfef5ca7c38dd020868da916e13e48ac6f4d87eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T08:21:18.694 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:18 smithi153 podman[71870]: 2024-09-10 08:21:18.221336213 +0000 UTC m=+0.385255873 container start 1412fd687c7340a9cf5994fbbfef5ca7c38dd020868da916e13e48ac6f4d87eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T08:21:18.695 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:18 smithi153 podman[71870]: 2024-09-10 08:21:18.326412571 +0000 UTC m=+0.490332230 container attach 1412fd687c7340a9cf5994fbbfef5ca7c38dd020868da916e13e48ac6f4d87eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:21:18.695 INFO:journalctl@ceph.osd.2.smithi153.stdout:Sep 10 08:21:18 smithi153 podman[71870]: 2024-09-10 08:21:18.415748777 +0000 UTC m=+0.579668435 container died 1412fd687c7340a9cf5994fbbfef5ca7c38dd020868da916e13e48ac6f4d87eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True) 2024-09-10T08:21:19.086 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T08:21:19.125 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:21:19.125 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T08:21:19.125 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T08:21:19.126 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.3 2024-09-10T08:21:19.435 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:19 smithi022 systemd[1]: Stopping Ceph osd.3 for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:21:19.710 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:19 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3[49157]: 2024-09-10T08:21:19.435+0000 7f28041ed640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:21:19.710 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:19 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3[49157]: 2024-09-10T08:21:19.435+0000 7f28041ed640 -1 osd.3 99 *** Got signal Terminated *** 2024-09-10T08:21:19.710 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:19 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3[49157]: 2024-09-10T08:21:19.435+0000 7f28041ed640 -1 osd.3 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:21:22.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:22.116+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:23.003 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:22 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3[49157]: 2024-09-10T08:21:22.722+0000 7f27fc7fb640 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.206176+0000 front 2024-09-10T08:20:57.206110+0000 (oldest deadline 2024-09-10T08:21:22.506320+0000) 2024-09-10T08:21:23.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:23 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:23.094+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:23.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:23 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:23.069+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:24.003 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:23 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3[49157]: 2024-09-10T08:21:23.694+0000 7f27fc7fb640 -1 osd.3 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.206176+0000 front 2024-09-10T08:20:57.206110+0000 (oldest deadline 2024-09-10T08:21:22.506320+0000) 2024-09-10T08:21:24.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:24 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:24.081+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:24.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:23 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:23.940+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:24.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:24 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:24.086+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:24.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:24 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:24.297+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:24.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:24 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:24.449+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:25.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:25 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:25.125+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:25.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:24 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:24.942+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:25.365 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:25 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:25.129+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:25.365 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:25 smithi022 podman[87049]: 2024-09-10 08:21:25.061313343 +0000 UTC m=+5.727343934 container stop 43f421147512c0b2bc69a4172edfac4ed8174e4e9711ca5453b1e8a50c49fa12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T08:21:25.366 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:25 smithi022 podman[87049]: 2024-09-10 08:21:25.089030731 +0000 UTC m=+5.755061319 container died 43f421147512c0b2bc69a4172edfac4ed8174e4e9711ca5453b1e8a50c49fa12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-10T08:21:25.366 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:25 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:25.275+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:25.687 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:25 smithi022 podman[87049]: 2024-09-10 08:21:25.478029169 +0000 UTC m=+6.144059756 container cleanup 43f421147512c0b2bc69a4172edfac4ed8174e4e9711ca5453b1e8a50c49fa12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-10T08:21:25.687 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:25 smithi022 bash[87049]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3 2024-09-10T08:21:25.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:25 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:25.492+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:26.003 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:25 smithi022 podman[87078]: 2024-09-10 08:21:25.687858361 +0000 UTC m=+0.614220624 container remove 43f421147512c0b2bc69a4172edfac4ed8174e4e9711ca5453b1e8a50c49fa12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T08:21:26.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:26.127+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:26.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:25 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:25.934+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:26.357 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:26 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:26.173+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:26.358 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:26 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:26.277+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:26.358 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:26 smithi022 podman[87167]: 2024-09-10 08:21:26.003310947 +0000 UTC m=+0.016620513 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:21:26.358 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:26 smithi022 podman[87167]: 2024-09-10 08:21:26.113841995 +0000 UTC m=+0.127151548 container create 5f654ddf7cd8366264f7950f2b9f6e22710bb0ffc14e9eb313a52fc3f51ce585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T08:21:26.754 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:26 smithi022 podman[87167]: 2024-09-10 08:21:26.358384052 +0000 UTC m=+0.371693614 container init 5f654ddf7cd8366264f7950f2b9f6e22710bb0ffc14e9eb313a52fc3f51ce585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T08:21:26.754 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:26 smithi022 podman[87167]: 2024-09-10 08:21:26.362402968 +0000 UTC m=+0.375712521 container start 5f654ddf7cd8366264f7950f2b9f6e22710bb0ffc14e9eb313a52fc3f51ce585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-10T08:21:26.754 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:26 smithi022 podman[87167]: 2024-09-10 08:21:26.558257762 +0000 UTC m=+0.571567325 container attach 5f654ddf7cd8366264f7950f2b9f6e22710bb0ffc14e9eb313a52fc3f51ce585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:21:26.754 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 10 08:21:26 smithi022 podman[87167]: 2024-09-10 08:21:26.558686616 +0000 UTC m=+0.571996168 container died 5f654ddf7cd8366264f7950f2b9f6e22710bb0ffc14e9eb313a52fc3f51ce585 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-10T08:21:26.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:26 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:26.449+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:27.169 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T08:21:27.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:27.108+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:27.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:26.928+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:27.215 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:21:27.215 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T08:21:27.215 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T08:21:27.215 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.4 2024-09-10T08:21:27.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:27 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:27.144+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:27.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:27 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:27.322+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:27.528 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:27 smithi100 systemd[1]: Stopping Ceph osd.4 for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:21:27.528 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:27 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:27.466+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:27.869 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:27 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4[46182]: 2024-09-10T08:21:27.528+0000 7f1492f31640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:21:27.869 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:27 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4[46182]: 2024-09-10T08:21:27.528+0000 7f1492f31640 -1 osd.4 99 *** Got signal Terminated *** 2024-09-10T08:21:27.869 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:27 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4[46182]: 2024-09-10T08:21:27.528+0000 7f1492f31640 -1 osd.4 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:21:28.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:28 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:28.059+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:28.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:27.911+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:28.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:28 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:28.131+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:28.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:28 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:28.311+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:28.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:28 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:28.451+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:29.167 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:28 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:28.915+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:29.168 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:29 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:29.062+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:29.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:29 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:29.347+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:29.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:29 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:29.141+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:29.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:29 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:29.475+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:30.030 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:29 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:29.888+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:30.030 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:29 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:29.747+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:30.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:30 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:30.030+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:30.445 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:30 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4[46182]: 2024-09-10T08:21:30.188+0000 7f148f547640 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.966181+0000 front 2024-09-10T08:21:03.966198+0000 (oldest deadline 2024-09-10T08:21:29.866284+0000) 2024-09-10T08:21:30.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:30 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:30.317+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:30.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:30 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:30.112+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:30.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:30 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:30.445+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:30.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:30 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:30.445+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:31.046 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:30 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:30.879+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:31.046 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:30 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:30.764+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:31.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:31 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:31.047+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:31.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:31 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:31.275+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:31.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:31 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:31.121+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:31.619 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:31 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4[46182]: 2024-09-10T08:21:31.234+0000 7f148f547640 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.966181+0000 front 2024-09-10T08:21:03.966198+0000 (oldest deadline 2024-09-10T08:21:29.866284+0000) 2024-09-10T08:21:31.663 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:31 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:31.398+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:31.663 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:31 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:31.398+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:32.037 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:31 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:31.888+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:32.037 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:31 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:31.749+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:32.416 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:32 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4[46182]: 2024-09-10T08:21:32.198+0000 7f148f547640 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.966181+0000 front 2024-09-10T08:21:03.966198+0000 (oldest deadline 2024-09-10T08:21:29.866284+0000) 2024-09-10T08:21:32.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:32 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:32.038+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:32.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:32 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:32.038+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:32.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:32 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:32.156+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:32.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:32 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:32.236+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:32.708 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:32 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:32.416+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:32.708 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:32 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:32.416+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:33.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:32 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:32.795+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:33.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:32 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:32.991+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:33.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:32 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:32.991+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:33.195 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:32 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:32.929+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:33.195 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:32 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:32.929+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.925057+0000 front 2024-09-10T08:21:07.924984+0000 (oldest deadline 2024-09-10T08:21:32.024751+0000) 2024-09-10T08:21:33.362 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:33 smithi100 podman[70419]: 2024-09-10 08:21:33.067061413 +0000 UTC m=+5.652278810 container died 0c88344bfae13360049758be9b16099886a43ce10314c2ad243db86c9d6bbfa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T08:21:33.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:33 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:33.133+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:33.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:33 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:33.195+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:33.618 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:33 smithi100 podman[70419]: 2024-09-10 08:21:33.462234147 +0000 UTC m=+6.047451543 container cleanup 0c88344bfae13360049758be9b16099886a43ce10314c2ad243db86c9d6bbfa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:21:33.619 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:33 smithi100 bash[70419]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4 2024-09-10T08:21:33.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:33 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:33.375+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:33.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:33 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:33.375+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:34.012 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:33 smithi100 podman[70434]: 2024-09-10 08:21:33.70524399 +0000 UTC m=+0.636170854 container remove 0c88344bfae13360049758be9b16099886a43ce10314c2ad243db86c9d6bbfa7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:21:34.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:33 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:33.800+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:34.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:33 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:33.913+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:34.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:33 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:33.913+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.925057+0000 front 2024-09-10T08:21:07.924984+0000 (oldest deadline 2024-09-10T08:21:32.024751+0000) 2024-09-10T08:21:34.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:34 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:34.022+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:34.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:34 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:34.022+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:34.274 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:34 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:34.112+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:34.275 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:34 smithi100 podman[70527]: 2024-09-10 08:21:33.916373789 +0000 UTC m=+0.016021336 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:21:34.275 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:34 smithi100 podman[70527]: 2024-09-10 08:21:34.01474016 +0000 UTC m=+0.114387743 container create 99258ba668f9d3f81883ec46882cb0e3ec35dde3e8a91d51779e83a979c8460c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=) 2024-09-10T08:21:34.275 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:34 smithi100 podman[70527]: 2024-09-10 08:21:34.275462116 +0000 UTC m=+0.375109653 container init 99258ba668f9d3f81883ec46882cb0e3ec35dde3e8a91d51779e83a979c8460c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-10T08:21:34.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:34 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:34.180+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:34.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:34 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:34.180+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:34.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:34 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:34.153+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:34.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:34 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:34.343+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:34.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:34 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:34.343+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:34.619 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:34 smithi100 podman[70527]: 2024-09-10 08:21:34.279058187 +0000 UTC m=+0.378705727 container start 99258ba668f9d3f81883ec46882cb0e3ec35dde3e8a91d51779e83a979c8460c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:21:34.619 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:34 smithi100 podman[70527]: 2024-09-10 08:21:34.35887108 +0000 UTC m=+0.458518629 container attach 99258ba668f9d3f81883ec46882cb0e3ec35dde3e8a91d51779e83a979c8460c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T08:21:34.619 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 10 08:21:34 smithi100 podman[70527]: 2024-09-10 08:21:34.472389878 +0000 UTC m=+0.572037416 container died 99258ba668f9d3f81883ec46882cb0e3ec35dde3e8a91d51779e83a979c8460c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T08:21:35.071 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T08:21:35.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:21:35.109 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T08:21:35.109 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T08:21:35.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.5 2024-09-10T08:21:35.137 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:34 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:34.825+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:35.137 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:34 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:34.923+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:35.137 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:34 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:34.923+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.925057+0000 front 2024-09-10T08:21:07.924984+0000 (oldest deadline 2024-09-10T08:21:32.024751+0000) 2024-09-10T08:21:35.138 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:35 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:35.043+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:35.138 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:35 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:35.043+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:35.334 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:35 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:35.112+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:35.407 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:35 smithi153 systemd[1]: Stopping Ceph osd.5 for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:21:35.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:35.197+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:35.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:35.197+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:35.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:35.191+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:35.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:35 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:35.191+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:35.618 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:35 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:35.334+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:35.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:35 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:35.334+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:35.694 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:35 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:35.407+0000 7fa99a819640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:21:35.694 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:35 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:35.407+0000 7fa99a819640 -1 osd.5 99 *** Got signal Terminated *** 2024-09-10T08:21:35.694 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:35 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:35.407+0000 7fa99a819640 -1 osd.5 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:21:36.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:35 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:35.842+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:36.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:36 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:36.045+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:36.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:36 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:36.045+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:36.195 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:35 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:35.947+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:36.195 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:35 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:35.947+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.925057+0000 front 2024-09-10T08:21:07.924984+0000 (oldest deadline 2024-09-10T08:21:32.024751+0000) 2024-09-10T08:21:36.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:36 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:36.099+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:36.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:36 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:36.171+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:36.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:36 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:36.171+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:36.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:36 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:36.156+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:36.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:36 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:36.156+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:36.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:36 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:36.381+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:36.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:36 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:36.381+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:37.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:36 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:36.891+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:37.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:36 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:36.912+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:37.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:36 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:36.912+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.925057+0000 front 2024-09-10T08:21:07.924984+0000 (oldest deadline 2024-09-10T08:21:32.024751+0000) 2024-09-10T08:21:37.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:37 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:37.059+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:37.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:37 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:37.059+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:37.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:37 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:37.059+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:37.368 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:37 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:37.085+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:37.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:37 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:37.214+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:37.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:37 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:37.214+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:37.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:37 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:37.138+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:37.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:37 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:37.138+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:37.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:37 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:37.419+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:37.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:37 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:37.419+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:38.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:37 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:37.881+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:38.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:37 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:37.881+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:38.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:37 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:37.899+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:38.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:37 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:37.899+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.925057+0000 front 2024-09-10T08:21:07.924984+0000 (oldest deadline 2024-09-10T08:21:32.024751+0000) 2024-09-10T08:21:38.195 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:37 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:37.899+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:15.426135+0000 front 2024-09-10T08:21:15.426098+0000 (oldest deadline 2024-09-10T08:21:37.626643+0000) 2024-09-10T08:21:38.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:38 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:38.026+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:38.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:38 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:38.026+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:38.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:38 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:38.026+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:38.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:38 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:38.070+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:38.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:38 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:38.184+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:38.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:38 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:38.184+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:38.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:38 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:38.184+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:38.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:38 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:38.233+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:38.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:38 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:38.233+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:38.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:38 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:38.233+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.260228+0000 front 2024-09-10T08:21:13.260271+0000 (oldest deadline 2024-09-10T08:21:37.960422+0000) 2024-09-10T08:21:38.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:38 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:38.441+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:38.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:38 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:38.441+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:39.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:38 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:38.843+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:39.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:38 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:38.843+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:39.195 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:38 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:38.921+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:39.195 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:38 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:38.921+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.925057+0000 front 2024-09-10T08:21:07.924984+0000 (oldest deadline 2024-09-10T08:21:32.024751+0000) 2024-09-10T08:21:39.195 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:38 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:38.921+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:15.426135+0000 front 2024-09-10T08:21:15.426098+0000 (oldest deadline 2024-09-10T08:21:37.626643+0000) 2024-09-10T08:21:39.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:39.023+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:39.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:39.023+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:39.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:39.023+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:39.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:39.080+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:39.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:39.080+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:39.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:39.210+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:39.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:39.210+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:39.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:39.210+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:39.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:39.234+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:39.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:39.234+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:39.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:39.234+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.260228+0000 front 2024-09-10T08:21:13.260271+0000 (oldest deadline 2024-09-10T08:21:37.960422+0000) 2024-09-10T08:21:39.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:39.398+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:39.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:39.398+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:39.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:39 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:39.398+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:40.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:39.864+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:40.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:39.864+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:40.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:39.966+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:57.323798+0000 front 2024-09-10T08:20:57.323751+0000 (oldest deadline 2024-09-10T08:21:23.223716+0000) 2024-09-10T08:21:40.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:39.966+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.925057+0000 front 2024-09-10T08:21:07.924984+0000 (oldest deadline 2024-09-10T08:21:32.024751+0000) 2024-09-10T08:21:40.194 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5[47086]: 2024-09-10T08:21:39.966+0000 7fa992e27640 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:15.426135+0000 front 2024-09-10T08:21:15.426098+0000 (oldest deadline 2024-09-10T08:21:37.626643+0000) 2024-09-10T08:21:40.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:39.980+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:40.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:39.980+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:40.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:39 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:39.980+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:40.377 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:40 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:40.119+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:40.377 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:40 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:40.119+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:40.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:40 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:40.188+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:40.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:40 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:40.188+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:40.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:40 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:40.188+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:40.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:40 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:40.193+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:40.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:40 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:40.193+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:40.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:40 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:40.193+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.260228+0000 front 2024-09-10T08:21:13.260271+0000 (oldest deadline 2024-09-10T08:21:37.960422+0000) 2024-09-10T08:21:40.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:40 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:40.378+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:40.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:40 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:40.378+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:40.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:40 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:40.378+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:41.096 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:40 smithi153 podman[71972]: 2024-09-10 08:21:40.914452434 +0000 UTC m=+5.606420329 container died 1083a96f5b49a32118ab3b97a3c39e5f47102cdb57cdb608ab1277656db1a0d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-10T08:21:41.096 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:40 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:40.846+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:41.096 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:40 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:40.846+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:41.096 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:40 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:40.930+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:41.096 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:40 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:40.930+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:41.097 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:40 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:40.930+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:41.363 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:41 smithi153 podman[71972]: 2024-09-10 08:21:41.333650025 +0000 UTC m=+6.025617925 container cleanup 1083a96f5b49a32118ab3b97a3c39e5f47102cdb57cdb608ab1277656db1a0d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T08:21:41.364 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:41 smithi153 bash[71972]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5 2024-09-10T08:21:41.368 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:41 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:41.093+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:41.368 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:41 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:41.093+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:41.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:41.179+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:41.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:41.179+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:41.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:41.179+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:41.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:41.195+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:41.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:41.195+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:41.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:41 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:41.195+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.260228+0000 front 2024-09-10T08:21:13.260271+0000 (oldest deadline 2024-09-10T08:21:37.960422+0000) 2024-09-10T08:21:41.694 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:41 smithi153 podman[71989]: 2024-09-10 08:21:41.560320786 +0000 UTC m=+0.643189047 container remove 1083a96f5b49a32118ab3b97a3c39e5f47102cdb57cdb608ab1277656db1a0d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T08:21:41.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:41 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:41.414+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:41.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:41 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:41.414+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:41.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:41 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:41.414+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:42.094 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:41 smithi153 podman[72084]: 2024-09-10 08:21:41.821584046 +0000 UTC m=+0.015938104 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:21:42.095 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:41 smithi153 podman[72084]: 2024-09-10 08:21:41.93630856 +0000 UTC m=+0.130662605 container create b7cb32014f699b32dabcb9e5f82a2f307a2abf0236b3be8d431253c4d3d79766 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T08:21:42.095 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:41 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:41.915+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:42.095 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:41 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:41.915+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:42.095 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:41 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:41.915+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:42.095 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:41 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:41.841+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:42.095 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:41 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:41.841+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:42.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:42.069+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:42.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:42.069+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:42.444 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:42 smithi153 podman[72084]: 2024-09-10 08:21:42.189090746 +0000 UTC m=+0.383444807 container init b7cb32014f699b32dabcb9e5f82a2f307a2abf0236b3be8d431253c4d3d79766 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T08:21:42.444 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:42 smithi153 podman[72084]: 2024-09-10 08:21:42.19261113 +0000 UTC m=+0.386965182 container start b7cb32014f699b32dabcb9e5f82a2f307a2abf0236b3be8d431253c4d3d79766 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T08:21:42.444 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:42 smithi153 podman[72084]: 2024-09-10 08:21:42.264097828 +0000 UTC m=+0.458451891 container attach b7cb32014f699b32dabcb9e5f82a2f307a2abf0236b3be8d431253c4d3d79766 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T08:21:42.445 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 10 08:21:42 smithi153 podman[72084]: 2024-09-10 08:21:42.38324759 +0000 UTC m=+0.577601647 container died b7cb32014f699b32dabcb9e5f82a2f307a2abf0236b3be8d431253c4d3d79766 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:21:42.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:42.170+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:42.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:42.170+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:42.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:42.170+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:42.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:42.241+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:42.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:42.241+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:42.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:42 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:42.241+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.260228+0000 front 2024-09-10T08:21:13.260271+0000 (oldest deadline 2024-09-10T08:21:37.960422+0000) 2024-09-10T08:21:42.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:42.414+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:42.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:42.414+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:42.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:42 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:42.414+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:43.042 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:42.886+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:43.042 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:42.886+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:43.043 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:42.886+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:43.043 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:42.870+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:43.043 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:42 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:42.870+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:43.068 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T08:21:43.149 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:21:43.150 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T08:21:43.150 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T08:21:43.150 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.6 2024-09-10T08:21:43.365 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:43 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:43.085+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:43.365 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:43 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:43.085+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:43.464 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:43 smithi022 systemd[1]: Stopping Ceph osd.6 for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:21:43.465 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:43 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:43.217+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:43.465 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:43 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:43.217+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:43.465 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:43 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:43.217+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.260228+0000 front 2024-09-10T08:21:13.260271+0000 (oldest deadline 2024-09-10T08:21:37.960422+0000) 2024-09-10T08:21:43.465 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:43 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:43.182+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:43.465 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:43 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:43.182+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:43.465 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:43 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:43.182+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:43.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:43 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:43.365+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:43.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:43 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:43.365+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:43.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:43 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:43.365+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:43.753 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:43 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:43.464+0000 7fa16c92a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:21:43.753 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:43 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:43.464+0000 7fa16c92a640 -1 osd.6 99 *** Got signal Terminated *** 2024-09-10T08:21:43.753 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:43 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:43.464+0000 7fa16c92a640 -1 osd.6 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:21:44.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:43 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:43.915+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:44.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:43 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:43.915+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:44.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:43 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:43.915+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:44.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:43 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:43.837+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:44.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:43 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:43.837+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:44.368 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:44 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:44.095+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:44.368 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:44 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:44.095+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:44.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:44 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:44.262+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:44.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:44 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:44.262+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:44.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:44 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:44.262+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.260228+0000 front 2024-09-10T08:21:13.260271+0000 (oldest deadline 2024-09-10T08:21:37.960422+0000) 2024-09-10T08:21:44.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:44 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:44.194+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:44.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:44 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:44.194+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:44.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:44 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:44.194+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:44.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:44 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:44.408+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:44.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:44 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:44.408+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:44.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:44 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:44.408+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:45.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:44 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:44.874+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:45.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:44 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:44.874+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:45.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:44 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:44.938+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:45.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:44 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:44.938+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:45.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:44 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:44.938+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:45.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:45.080+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:45.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:45.080+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:45.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:45.292+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:45.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:45.292+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:45.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:45.292+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.260228+0000 front 2024-09-10T08:21:13.260271+0000 (oldest deadline 2024-09-10T08:21:37.960422+0000) 2024-09-10T08:21:45.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:45.199+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:45.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:45.199+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:45.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:45.199+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:45.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:45 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:45.199+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:45.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:45.418+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:45.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:45.418+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:45.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:45 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:45.418+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:46.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:45.958+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:46.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:45.958+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:46.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:45.958+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:46.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:45.842+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:46.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:45.842+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:46.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:45 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:45.842+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:46.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:46 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:46.045+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:46.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:46 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:46.045+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:46.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:46.294+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:46.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:46.294+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:46.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:46.294+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.260228+0000 front 2024-09-10T08:21:13.260271+0000 (oldest deadline 2024-09-10T08:21:37.960422+0000) 2024-09-10T08:21:46.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:46.294+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:20.861206+0000 front 2024-09-10T08:21:20.861238+0000 (oldest deadline 2024-09-10T08:21:46.161329+0000) 2024-09-10T08:21:46.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:46.162+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:46.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:46.162+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:46.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:46.162+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:46.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:46 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:46.162+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:46.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:46 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:46.404+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:46.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:46 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:46.404+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:46.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:46 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:46.404+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:47.197 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:47 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:47.001+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:47.197 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:47 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:47.001+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:47.197 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:47 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:47.001+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:47.197 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:46 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:46.852+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:47.197 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:46 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:46.852+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:47.197 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:46 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:46.852+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:47.368 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:47 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:47.053+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:47.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:47 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:47.053+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:47.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:47.333+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:47.503 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:47.333+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:47.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:47.333+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.260228+0000 front 2024-09-10T08:21:13.260271+0000 (oldest deadline 2024-09-10T08:21:37.960422+0000) 2024-09-10T08:21:47.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:47.333+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:20.861206+0000 front 2024-09-10T08:21:20.861238+0000 (oldest deadline 2024-09-10T08:21:46.161329+0000) 2024-09-10T08:21:47.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:47.160+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:47.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:47.160+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:47.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:47.160+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:47.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:47 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:47.160+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:47.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:47 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:47.439+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:47.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:47 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:47.439+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:47.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:47 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:47.439+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:48.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:47 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:47.840+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:48.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:47 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:47.840+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:48.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:47 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:47.840+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:48.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:47 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:47.972+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:48.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:47 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:47.972+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:48.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:47 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:47.972+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:48.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:48 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:48.057+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:48.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:48 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:48.057+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:48.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:48 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:48.057+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:23.738354+0000 front 2024-09-10T08:21:23.738389+0000 (oldest deadline 2024-09-10T08:21:47.838428+0000) 2024-09-10T08:21:48.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:48 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:48.351+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.658091+0000 front 2024-09-10T08:20:58.658041+0000 (oldest deadline 2024-09-10T08:21:22.758185+0000) 2024-09-10T08:21:48.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:48 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:48.351+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.960012+0000 front 2024-09-10T08:21:07.959830+0000 (oldest deadline 2024-09-10T08:21:33.259854+0000) 2024-09-10T08:21:48.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:48 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:48.351+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.260228+0000 front 2024-09-10T08:21:13.260271+0000 (oldest deadline 2024-09-10T08:21:37.960422+0000) 2024-09-10T08:21:48.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:48 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6[55911]: 2024-09-10T08:21:48.351+0000 7fa168f40640 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:20.861206+0000 front 2024-09-10T08:21:20.861238+0000 (oldest deadline 2024-09-10T08:21:46.161329+0000) 2024-09-10T08:21:48.505 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:48 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:48.151+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:48.505 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:48 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:48.151+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:48.505 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:48 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:48.151+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:48.505 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:48 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:48.151+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:48.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:48 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:48.460+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:48.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:48 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:48.460+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:48.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:48 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:48.460+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:49.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:48 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:48.995+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:49.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:48 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:48.995+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:49.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:48 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:48.995+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:49.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:48 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:48.885+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:49.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:48 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:48.885+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:49.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:48 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:48.885+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:49.195 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:48 smithi022 podman[87271]: 2024-09-10 08:21:48.918719648 +0000 UTC m=+5.566755359 container died 71b0766afd8b704ec836372fb1ea52bbca7b9c009f1a832fb44399164d99488b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:21:49.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:49 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:49.066+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:49.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:49 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:49.066+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:49.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:49 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:49.066+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:23.738354+0000 front 2024-09-10T08:21:23.738389+0000 (oldest deadline 2024-09-10T08:21:47.838428+0000) 2024-09-10T08:21:49.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:49 smithi022 podman[87271]: 2024-09-10 08:21:49.272750498 +0000 UTC m=+5.920786192 container cleanup 71b0766afd8b704ec836372fb1ea52bbca7b9c009f1a832fb44399164d99488b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-10T08:21:49.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:49 smithi022 bash[87271]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6 2024-09-10T08:21:49.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:49.195+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:49.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:49.195+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:49.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:49.195+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:49.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:49 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:49.195+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:49.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:49 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:49.495+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:49.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:49 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:49.495+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:49.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:49 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:49.495+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:49.885 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:49 smithi022 podman[87287]: 2024-09-10 08:21:49.565967337 +0000 UTC m=+0.647514218 container remove 71b0766afd8b704ec836372fb1ea52bbca7b9c009f1a832fb44399164d99488b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T08:21:50.160 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:49 smithi022 podman[87372]: 2024-09-10 08:21:49.789233941 +0000 UTC m=+0.016521941 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:21:50.160 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:49 smithi022 podman[87372]: 2024-09-10 08:21:49.92531987 +0000 UTC m=+0.152607898 container create 6009a6d59a37a3911284ea05015df2d0b2adaa36a00064f5b6c9697ca811b12f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T08:21:50.160 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:50 smithi022 podman[87372]: 2024-09-10 08:21:50.16117552 +0000 UTC m=+0.388463506 container init 6009a6d59a37a3911284ea05015df2d0b2adaa36a00064f5b6c9697ca811b12f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T08:21:50.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:50 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:50.026+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:50.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:50 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:50.026+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:50.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:50 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:50.026+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:50.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:49 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:49.901+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:50.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:49 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:49.901+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:50.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:49 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:49.901+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:50.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:50 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:50.076+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:50.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:50 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:50.076+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:50.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:50 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:50.076+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:23.738354+0000 front 2024-09-10T08:21:23.738389+0000 (oldest deadline 2024-09-10T08:21:47.838428+0000) 2024-09-10T08:21:50.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:50 smithi022 podman[87372]: 2024-09-10 08:21:50.164929187 +0000 UTC m=+0.392217182 container start 6009a6d59a37a3911284ea05015df2d0b2adaa36a00064f5b6c9697ca811b12f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:21:50.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:50 smithi022 podman[87372]: 2024-09-10 08:21:50.369558608 +0000 UTC m=+0.596846599 container attach 6009a6d59a37a3911284ea05015df2d0b2adaa36a00064f5b6c9697ca811b12f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-09-10T08:21:50.504 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 10 08:21:50 smithi022 podman[87372]: 2024-09-10 08:21:50.369961788 +0000 UTC m=+0.597249783 container died 6009a6d59a37a3911284ea05015df2d0b2adaa36a00064f5b6c9697ca811b12f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-10T08:21:50.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:50 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:50.206+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:50.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:50 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:50.206+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:50.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:50 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:50.206+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:50.505 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:50 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:50.206+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:50.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:50 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:50.505+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:50.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:50 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:50.505+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:50.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:50 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:50.505+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:50.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:50 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:50.505+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:21:51.019 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T08:21:51.063 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:21:51.064 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T08:21:51.064 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T08:21:51.064 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.7 2024-09-10T08:21:51.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:51 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:51.033+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:51.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:51 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:51.033+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:51.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:51 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:51.033+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:51.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:50 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:50.887+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:51.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:50 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:50.887+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:51.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:50 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:50.887+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:51.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:51 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:51.192+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:51.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:51 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:51.192+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:51.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:51 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:51.192+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:51.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:51 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:51.192+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:51.364 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:51 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:51.039+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:51.365 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:51 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:51.039+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:51.365 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:51 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:51.039+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:23.738354+0000 front 2024-09-10T08:21:23.738389+0000 (oldest deadline 2024-09-10T08:21:47.838428+0000) 2024-09-10T08:21:51.365 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:51 smithi100 systemd[1]: Stopping Ceph osd.7 for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:21:51.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:51 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:51.503+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:51.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:51 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:51.503+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:51.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:51 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:51.503+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:51.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:51 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:51.503+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:21:51.619 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:51 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:51.363+0000 7f223f4a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:21:51.619 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:51 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:51.363+0000 7f223f4a3640 -1 osd.7 99 *** Got signal Terminated *** 2024-09-10T08:21:51.619 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:51 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:51.363+0000 7f223f4a3640 -1 osd.7 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:21:52.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:52 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:52.029+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:52.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:52 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:52.029+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:52.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:52 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:52.029+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:52.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:51 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:51.917+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:52.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:51 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:51.917+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:52.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:51 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:51.917+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:52.368 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:52 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:52.081+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:52.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:52 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:52.081+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:52.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:52 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:52.081+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:23.738354+0000 front 2024-09-10T08:21:23.738389+0000 (oldest deadline 2024-09-10T08:21:47.838428+0000) 2024-09-10T08:21:52.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:52 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:52.171+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:52.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:52 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:52.171+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:52.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:52 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:52.171+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:52.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:52 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:52.171+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:52.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:52 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:52.463+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:52.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:52 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:52.463+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:52.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:52 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:52.463+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:52.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:52 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:52.463+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:21:53.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:52 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:52.886+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:53.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:52 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:52.886+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:53.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:52 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:52.886+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:53.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:53 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:53.052+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:53.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:53 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:53.052+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:53.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:53 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:53.052+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:53.368 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:53 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:53.086+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:53.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:53 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:53.086+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:53.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:53 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:53.086+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:23.738354+0000 front 2024-09-10T08:21:23.738389+0000 (oldest deadline 2024-09-10T08:21:47.838428+0000) 2024-09-10T08:21:53.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:53 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:53.133+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:53.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:53 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:53.133+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:53.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:53 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:53.133+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:53.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:53 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:53.133+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:53.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:53 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:53.499+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:53.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:53 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:53.499+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:53.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:53 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:53.499+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:53.870 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:53 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:53.499+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:21:54.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:53 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:53.893+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:54.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:53 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:53.893+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:54.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:53 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:53.893+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:54.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:54 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:54.007+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:54.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:54 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:54.007+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:54.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:54 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:54.007+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:54.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:54 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:54.057+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:54.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:54 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:54.057+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:54.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:54 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:54.057+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:23.738354+0000 front 2024-09-10T08:21:23.738389+0000 (oldest deadline 2024-09-10T08:21:47.838428+0000) 2024-09-10T08:21:54.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:54 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:54.124+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:54.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:54 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:54.124+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:54.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:54 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:54.124+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:54.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:54 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:54.124+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:54.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:54 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:54.457+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:54.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:54 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:54.457+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:54.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:54 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:54.457+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:54.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:54 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:54.457+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:21:54.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:54 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:54.457+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:21:55.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:54 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:54.892+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:55.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:54 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:54.892+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:55.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:54 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:54.892+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:55.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:55 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:55.007+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:55.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:55 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:55.007+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:55.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:55 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:55.007+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:55.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:55 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:55.089+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:55.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:55 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:55.089+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:55.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:55 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:55.089+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:23.738354+0000 front 2024-09-10T08:21:23.738389+0000 (oldest deadline 2024-09-10T08:21:47.838428+0000) 2024-09-10T08:21:55.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:55 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:55.104+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:55.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:55 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:55.104+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:55.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:55 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:55.104+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:55.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:55 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:55.104+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:55.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:55 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:55.454+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:55.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:55 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:55.454+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:55.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:55 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:55.454+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:55.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:55 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:55.454+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:21:55.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:55 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:55.454+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:21:56.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:55 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:55.918+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:56.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:55 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:55.918+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:56.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:55 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:55.918+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:56.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:55 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:55.995+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:56.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:55 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:55.995+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:56.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:55 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:55.995+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:56.491 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:56 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:56.134+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:06.335211+0000 front 2024-09-10T08:21:06.335400+0000 (oldest deadline 2024-09-10T08:21:33.336006+0000) 2024-09-10T08:21:56.491 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:56 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:56.134+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:16.237050+0000 front 2024-09-10T08:21:16.237067+0000 (oldest deadline 2024-09-10T08:21:38.536965+0000) 2024-09-10T08:21:56.491 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:56 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7[52662]: 2024-09-10T08:21:56.134+0000 7f2237ab1640 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:23.738354+0000 front 2024-09-10T08:21:23.738389+0000 (oldest deadline 2024-09-10T08:21:47.838428+0000) 2024-09-10T08:21:56.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:56 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:56.081+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:56.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:56 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:56.081+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:56.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:56 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:56.081+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:56.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:56 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:56.081+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:56.821 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:56 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:56.491+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:56.821 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:56 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:56.491+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:56.821 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:56 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:56.491+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:56.821 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:56 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:56.491+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:21:56.821 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:56 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:56.491+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:21:57.102 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:56 smithi100 podman[70629]: 2024-09-10 08:21:56.821961427 +0000 UTC m=+5.564777528 container died 6171fe2cb95360fc4b83de77ac723dda2cfb4993ed055f29e75555d197d85fb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-10T08:21:57.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:56 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:56.907+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:57.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:56 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:56.907+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:57.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:56 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:56.907+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:57.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:56 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:56.907+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.045826+0000 front 2024-09-10T08:21:32.045987+0000 (oldest deadline 2024-09-10T08:21:56.145726+0000) 2024-09-10T08:21:57.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:57 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:57.037+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:57.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:57 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:57.037+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:57.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:57 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:57.037+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:57.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:57 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:57.037+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:21:57.365 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:57 smithi100 podman[70629]: 2024-09-10 08:21:57.189818412 +0000 UTC m=+5.932634502 container cleanup 6171fe2cb95360fc4b83de77ac723dda2cfb4993ed055f29e75555d197d85fb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-10T08:21:57.365 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:57 smithi100 bash[70629]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7 2024-09-10T08:21:57.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:57 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:57.083+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:57.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:57 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:57.083+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:57.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:57 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:57.083+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:57.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:57 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:57.083+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:57.618 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:57 smithi100 podman[70658]: 2024-09-10 08:21:57.365901792 +0000 UTC m=+0.503730226 container remove 6171fe2cb95360fc4b83de77ac723dda2cfb4993ed055f29e75555d197d85fb9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:21:57.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:57 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:57.527+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:57.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:57 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:57.527+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:57.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:57 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:57.527+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:57.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:57 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:57.527+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:21:57.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:57 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:57.527+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:21:58.077 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:57 smithi100 podman[70748]: 2024-09-10 08:21:57.800076947 +0000 UTC m=+0.113431017 container create 92b9c09a08b91af035d9c5041e5e8b2958615523bd51ea47614dbcd078a31a35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-10T08:21:58.077 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:57 smithi100 podman[70748]: 2024-09-10 08:21:57.702821187 +0000 UTC m=+0.016175276 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:21:58.077 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:58 smithi100 podman[70748]: 2024-09-10 08:21:58.078023077 +0000 UTC m=+0.391377148 container init 92b9c09a08b91af035d9c5041e5e8b2958615523bd51ea47614dbcd078a31a35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T08:21:58.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:57 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:57.863+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:58.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:57 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:57.863+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:58.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:57 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:57.863+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:58.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:57 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:57.863+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.045826+0000 front 2024-09-10T08:21:32.045987+0000 (oldest deadline 2024-09-10T08:21:56.145726+0000) 2024-09-10T08:21:58.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:58 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:58.022+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:58.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:58 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:58.022+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:58.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:58 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:58.022+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:58.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:58 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:58.022+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:21:58.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:58 smithi100 podman[70748]: 2024-09-10 08:21:58.081565538 +0000 UTC m=+0.394919619 container start 92b9c09a08b91af035d9c5041e5e8b2958615523bd51ea47614dbcd078a31a35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:21:58.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:58 smithi100 podman[70748]: 2024-09-10 08:21:58.169686366 +0000 UTC m=+0.483040445 container attach 92b9c09a08b91af035d9c5041e5e8b2958615523bd51ea47614dbcd078a31a35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T08:21:58.369 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 10 08:21:58 smithi100 podman[70748]: 2024-09-10 08:21:58.281723797 +0000 UTC m=+0.595077872 container died 92b9c09a08b91af035d9c5041e5e8b2958615523bd51ea47614dbcd078a31a35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:21:58.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:58 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:58.079+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:58.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:58 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:58.079+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:58.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:58 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:58.079+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:58.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:58 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:58.079+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:58.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:58 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:58.079+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:21:58.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:58 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:58.517+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:58.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:58 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:58.517+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:58.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:58 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:58.517+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:58.870 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:58 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:58.517+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:21:58.870 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:58 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:58.517+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:21:58.932 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T08:21:58.971 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:21:58.972 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T08:21:58.972 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T08:21:58.972 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.8 2024-09-10T08:21:59.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:58 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:58.875+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:21:59.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:58 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:58.875+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:21:59.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:58 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:58.875+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:21:59.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:58 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:58.875+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.045826+0000 front 2024-09-10T08:21:32.045987+0000 (oldest deadline 2024-09-10T08:21:56.145726+0000) 2024-09-10T08:21:59.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:59 smithi153 systemd[1]: Stopping Ceph osd.8 for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:21:59.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:59.051+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:21:59.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:59.051+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:21:59.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:59.051+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:21:59.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:21:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:21:59.051+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:21:59.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:59.088+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:21:59.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:59.088+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:21:59.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:59.088+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:21:59.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:59.088+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:21:59.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:21:59 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:21:59.088+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:21:59.694 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:59.287+0000 7ffb638d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:21:59.694 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:59.287+0000 7ffb638d7640 -1 osd.8 99 *** Got signal Terminated *** 2024-09-10T08:21:59.694 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:59.287+0000 7ffb638d7640 -1 osd.8 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:21:59.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:59 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:59.473+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:21:59.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:59 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:59.473+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:21:59.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:59 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:59.473+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:21:59.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:59 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:59.473+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:21:59.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:21:59 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:21:59.473+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:00.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:59.861+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:22:00.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:59.861+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:22:00.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:59.861+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:22:00.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:21:59 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:21:59.861+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.045826+0000 front 2024-09-10T08:21:32.045987+0000 (oldest deadline 2024-09-10T08:21:56.145726+0000) 2024-09-10T08:22:00.194 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:00 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:00.089+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:00.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:00 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:00.089+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:00.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:00 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:00.089+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:00.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:00 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:00.089+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:00.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:00 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:00.072+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:00.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:00 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:00.072+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:00.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:00 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:00.072+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:00.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:00 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:00.072+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:00.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:00 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:00.072+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:00.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:00 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:00.506+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:00.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:00 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:00.506+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:00.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:00 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:00.506+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:00.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:00 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:00.506+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:00.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:00 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:00.506+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:01.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:00 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:00.894+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:22:01.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:00 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:00.894+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:22:01.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:00 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:00.894+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:22:01.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:00 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:00.894+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.045826+0000 front 2024-09-10T08:21:32.045987+0000 (oldest deadline 2024-09-10T08:21:56.145726+0000) 2024-09-10T08:22:01.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:01.097+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:01.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:01.097+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:01.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:01.097+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:01.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:01.097+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:01.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:01 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:01.063+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:01.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:01 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:01.063+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:01.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:01 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:01.063+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:01.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:01 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:01.063+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:01.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:01 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:01.063+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:01.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:01 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:01.502+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:01.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:01 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:01.502+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:01.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:01 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:01.502+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:01.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:01 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:01.502+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:01.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:01 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:01.502+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:02.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:01.874+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:22:02.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:01.874+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:22:02.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:01.874+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:22:02.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:01 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:01.874+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.045826+0000 front 2024-09-10T08:21:32.045987+0000 (oldest deadline 2024-09-10T08:21:56.145726+0000) 2024-09-10T08:22:02.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:02.074+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:02.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:02.074+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:02.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:02.074+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:02.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:02.074+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:02.374 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:02.090+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:02.374 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:02.090+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:02.374 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:02.090+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:02.374 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:02.090+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:02.375 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:02 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:02.090+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:02.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:02 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:02.455+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:02.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:02 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:02.455+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:02.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:02 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:02.455+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:02.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:02 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:02.455+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:02.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:02 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:02.455+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:03.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:02.913+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:22:03.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:02.913+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:22:03.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:02.913+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:22:03.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:02.913+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.045826+0000 front 2024-09-10T08:21:32.045987+0000 (oldest deadline 2024-09-10T08:21:56.145726+0000) 2024-09-10T08:22:03.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:02 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:02.913+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.146200+0000 front 2024-09-10T08:21:36.146231+0000 (oldest deadline 2024-09-10T08:22:02.046384+0000) 2024-09-10T08:22:03.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:03 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:03.052+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:03.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:03 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:03.052+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:03.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:03 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:03.052+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:03.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:03 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:03.052+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:03.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:03 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:03.052+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:03.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:03 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:03.063+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:03.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:03 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:03.063+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:03.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:03 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:03.063+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:03.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:03 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:03.063+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:03.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:03 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:03.063+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:03.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:03 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:03.063+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:38.921549+0000 front 2024-09-10T08:21:38.921685+0000 (oldest deadline 2024-09-10T08:22:02.421411+0000) 2024-09-10T08:22:03.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:03.482+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:03.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:03.482+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:03.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:03.482+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:03.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:03.482+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:03.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:03.482+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:03.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:03 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:03.482+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:04.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:03 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:03.899+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.940586+0000 front 2024-09-10T08:21:07.940616+0000 (oldest deadline 2024-09-10T08:21:29.541242+0000) 2024-09-10T08:22:04.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:03 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:03.899+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:11.242103+0000 front 2024-09-10T08:21:11.242159+0000 (oldest deadline 2024-09-10T08:21:37.142251+0000) 2024-09-10T08:22:04.194 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:03 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:03.899+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:22.343768+0000 front 2024-09-10T08:21:22.343678+0000 (oldest deadline 2024-09-10T08:21:45.243567+0000) 2024-09-10T08:22:04.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:03 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:03.899+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.045826+0000 front 2024-09-10T08:21:32.045987+0000 (oldest deadline 2024-09-10T08:21:56.145726+0000) 2024-09-10T08:22:04.195 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:03 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8[53754]: 2024-09-10T08:22:03.899+0000 7ffb5feed640 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.146200+0000 front 2024-09-10T08:21:36.146231+0000 (oldest deadline 2024-09-10T08:22:02.046384+0000) 2024-09-10T08:22:04.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:04 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:04.047+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:04.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:04 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:04.047+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:04.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:04 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:04.047+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:04.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:04 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:04.047+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:04.195 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:04 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:04.047+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:04.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:04 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:04.027+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:04.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:04 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:04.027+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:04.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:04 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:04.027+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:04.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:04 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:04.027+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:04.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:04 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:04.027+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:04.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:04 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:04.027+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:38.921549+0000 front 2024-09-10T08:21:38.921685+0000 (oldest deadline 2024-09-10T08:22:02.421411+0000) 2024-09-10T08:22:04.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:04.502+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:04.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:04.502+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:04.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:04.502+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:04.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:04.502+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:04.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:04.502+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:04.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:04 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:04.502+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:05.171 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:04 smithi153 podman[72190]: 2024-09-10 08:22:04.854200903 +0000 UTC m=+5.682009954 container died 894fdbe0772d692bf593cb24cd56cc24b4a0a5394a4331f5a9f81bd3728bcb09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:22:05.172 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:05 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:05.017+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:05.172 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:05 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:05.017+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:05.172 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:05 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:05.017+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:05.172 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:05 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:05.017+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:05.172 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:05 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:05.017+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:05.444 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:05 smithi153 podman[72190]: 2024-09-10 08:22:05.262952953 +0000 UTC m=+6.090762005 container cleanup 894fdbe0772d692bf593cb24cd56cc24b4a0a5394a4331f5a9f81bd3728bcb09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T08:22:05.444 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:05 smithi153 bash[72190]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8 2024-09-10T08:22:05.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:05 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:05.077+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:05.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:05 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:05.077+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:05.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:05 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:05.077+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:05.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:05 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:05.077+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:05.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:05 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:05.077+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:05.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:05 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:05.077+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:38.921549+0000 front 2024-09-10T08:21:38.921685+0000 (oldest deadline 2024-09-10T08:22:02.421411+0000) 2024-09-10T08:22:05.853 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:05 smithi153 podman[72206]: 2024-09-10 08:22:05.547733517 +0000 UTC m=+0.684922420 container remove 894fdbe0772d692bf593cb24cd56cc24b4a0a5394a4331f5a9f81bd3728bcb09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:22:05.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:05 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:05.495+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:05.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:05 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:05.495+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:05.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:05 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:05.495+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:05.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:05 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:05.495+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:05.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:05 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:05.495+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:05.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:05 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:05.495+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:06.192 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:06 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:06.028+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:06.192 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:06 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:06.028+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:06.192 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:06 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:06.028+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:06.192 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:06 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:06.028+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:06.192 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:06 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:06.028+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:06.192 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:05 smithi153 podman[72295]: 2024-09-10 08:22:05.757386778 +0000 UTC m=+0.015755035 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:22:06.192 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:05 smithi153 podman[72295]: 2024-09-10 08:22:05.85682072 +0000 UTC m=+0.115189021 container create f70eb405a1e4dffee70bfaee5e67ac27eafda9843f8c2e74584a3ddb30efe5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T08:22:06.192 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:06 smithi153 podman[72295]: 2024-09-10 08:22:06.092585407 +0000 UTC m=+0.350953664 container init f70eb405a1e4dffee70bfaee5e67ac27eafda9843f8c2e74584a3ddb30efe5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:22:06.192 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:06 smithi153 podman[72295]: 2024-09-10 08:22:06.095851381 +0000 UTC m=+0.354219644 container start f70eb405a1e4dffee70bfaee5e67ac27eafda9843f8c2e74584a3ddb30efe5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T08:22:06.193 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:06 smithi153 podman[72295]: 2024-09-10 08:22:06.192621632 +0000 UTC m=+0.450989908 container attach f70eb405a1e4dffee70bfaee5e67ac27eafda9843f8c2e74584a3ddb30efe5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T08:22:06.444 INFO:journalctl@ceph.osd.8.smithi153.stdout:Sep 10 08:22:06 smithi153 podman[72295]: 2024-09-10 08:22:06.286781199 +0000 UTC m=+0.545149455 container died f70eb405a1e4dffee70bfaee5e67ac27eafda9843f8c2e74584a3ddb30efe5cf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-10T08:22:06.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:06 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:06.035+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:06.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:06 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:06.035+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:06.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:06 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:06.035+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:06.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:06 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:06.035+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:06.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:06 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:06.035+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:06.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:06 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:06.035+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:38.921549+0000 front 2024-09-10T08:21:38.921685+0000 (oldest deadline 2024-09-10T08:22:02.421411+0000) 2024-09-10T08:22:06.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:06 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:06.482+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:06.872 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:06 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:06.482+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:06.872 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:06 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:06.482+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:06.872 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:06 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:06.482+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:06.873 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:06 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:06.482+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:06.873 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:06 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:06.482+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:06.991 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T08:22:07.032 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:22:07.033 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T08:22:07.033 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T08:22:07.033 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.9 2024-09-10T08:22:07.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:07 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:07.076+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:07.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:07 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:07.076+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:07.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:07 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:07.076+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:07.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:07 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:07.076+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:07.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:07 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:07.076+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:07.425 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.008+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:07.425 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.008+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:07.426 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.008+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:07.426 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.008+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:07.491 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.008+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:07.491 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.008+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:38.921549+0000 front 2024-09-10T08:21:38.921685+0000 (oldest deadline 2024-09-10T08:22:02.421411+0000) 2024-09-10T08:22:07.491 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 systemd[1]: Stopping Ceph osd.9 for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:22:07.491 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.425+0000 7ff5d2981640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:22:07.491 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.425+0000 7ff5d2981640 -1 osd.9 99 *** Got signal Terminated *** 2024-09-10T08:22:07.491 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.425+0000 7ff5d2981640 -1 osd.9 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:22:07.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:07 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:07.500+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:07.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:07 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:07.500+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:07.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:07 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:07.500+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:07.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:07 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:07.500+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:07.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:07 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:07.500+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:07.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:07 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:07.500+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:08.253 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.968+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:08.253 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.968+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:08.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.968+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:08.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.968+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:08.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.968+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:08.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:07 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:07.968+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:38.921549+0000 front 2024-09-10T08:21:38.921685+0000 (oldest deadline 2024-09-10T08:22:02.421411+0000) 2024-09-10T08:22:08.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:08 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:08.070+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:08.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:08 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:08.070+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:08.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:08 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:08.070+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:08.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:08 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:08.070+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:08.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:08 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:08.070+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:08.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:08 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:08.457+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:08.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:08 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:08.457+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:08.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:08 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:08.457+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:08.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:08 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:08.457+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:08.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:08 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:08.457+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:08.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:08 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:08.457+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:09.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:09 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:09.028+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:09.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:09 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:09.028+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:09.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:09 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:09.028+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:09.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:09 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:09.028+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:09.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:09 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:09.028+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:09.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:09.015+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:09.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:09.015+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:09.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:09.015+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:09.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:09.015+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:09.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:09.015+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:09.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:09.015+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:38.921549+0000 front 2024-09-10T08:21:38.921685+0000 (oldest deadline 2024-09-10T08:22:02.421411+0000) 2024-09-10T08:22:09.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:09 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:09.447+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:09.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:09 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:09.447+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:09.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:09 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:09.447+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:09.870 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:09 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:09.447+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:09.870 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:09 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:09.447+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:09.870 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:09 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:09.447+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:09.870 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:09 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:09.447+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:45.795567+0000 front 2024-09-10T08:21:45.795531+0000 (oldest deadline 2024-09-10T08:22:09.295439+0000) 2024-09-10T08:22:10.253 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:09.967+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:10.253 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:09.967+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:10.253 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:09.967+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:10.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:09.967+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:10.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:09.967+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:10.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:09 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:09.967+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:38.921549+0000 front 2024-09-10T08:21:38.921685+0000 (oldest deadline 2024-09-10T08:22:02.421411+0000) 2024-09-10T08:22:10.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:10 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:10.066+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:10.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:10 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:10.066+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:10.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:10 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:10.066+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:10.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:10 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:10.066+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:10.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:10 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:10.066+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:10.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:10 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:10.420+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:10.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:10 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:10.420+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:10.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:10 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:10.420+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:10.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:10 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:10.420+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:10.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:10 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:10.420+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:10.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:10 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:10.420+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:10.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:10 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:10.420+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:45.795567+0000 front 2024-09-10T08:21:45.795531+0000 (oldest deadline 2024-09-10T08:22:09.295439+0000) 2024-09-10T08:22:11.253 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:10 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:10.996+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:11.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:10 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:10.996+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:11.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:10 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:10.996+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:11.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:10 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:10.996+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:11.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:10 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:10.996+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:11.254 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:10 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:10.996+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:38.921549+0000 front 2024-09-10T08:21:38.921685+0000 (oldest deadline 2024-09-10T08:22:02.421411+0000) 2024-09-10T08:22:11.345 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:11 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:11.056+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:11.345 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:11 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:11.056+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:11.346 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:11 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:11.056+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:11.346 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:11 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:11.056+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:11.346 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:11 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:11.056+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:11.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:11 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:11.418+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:11.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:11 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:11.418+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:11.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:11 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:11.418+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:11.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:11 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:11.418+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:11.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:11 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:11.418+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:11.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:11 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:11.418+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:11.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:11 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:11.418+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:45.795567+0000 front 2024-09-10T08:21:45.795531+0000 (oldest deadline 2024-09-10T08:22:09.295439+0000) 2024-09-10T08:22:12.357 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:12.016+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:12.357 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:12.016+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:12.357 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:12.016+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:12.357 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:12.016+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:12.357 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:12.016+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:12.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:12 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:12.042+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:59.315073+0000 front 2024-09-10T08:20:59.315111+0000 (oldest deadline 2024-09-10T08:21:24.015272+0000) 2024-09-10T08:22:12.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:12 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:12.042+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:04.015948+0000 front 2024-09-10T08:21:04.015972+0000 (oldest deadline 2024-09-10T08:21:34.616297+0000) 2024-09-10T08:22:12.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:12 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:12.042+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.617019+0000 front 2024-09-10T08:21:14.617163+0000 (oldest deadline 2024-09-10T08:21:38.116753+0000) 2024-09-10T08:22:12.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:12 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:12.042+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:21.017605+0000 front 2024-09-10T08:21:21.017637+0000 (oldest deadline 2024-09-10T08:21:45.117864+0000) 2024-09-10T08:22:12.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:12 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:12.042+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:32.019927+0000 front 2024-09-10T08:21:32.020162+0000 (oldest deadline 2024-09-10T08:21:57.319853+0000) 2024-09-10T08:22:12.504 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:12 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9[62879]: 2024-09-10T08:22:12.042+0000 7ff5cef97640 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:38.921549+0000 front 2024-09-10T08:21:38.921685+0000 (oldest deadline 2024-09-10T08:22:02.421411+0000) 2024-09-10T08:22:12.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:12 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:12.394+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:12.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:12 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:12.394+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:12.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:12 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:12.394+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:12.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:12 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:12.394+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:12.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:12 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:12.394+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:12.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:12 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:12.394+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:12.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:12 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:12.394+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:45.795567+0000 front 2024-09-10T08:21:45.795531+0000 (oldest deadline 2024-09-10T08:22:09.295439+0000) 2024-09-10T08:22:13.209 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:12 smithi022 podman[87486]: 2024-09-10 08:22:12.816814734 +0000 UTC m=+5.580968670 container died 4825cf7074655787b129e54bfbaad8d923163c7fface9d8cdbda1d75c06c0f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T08:22:13.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:12.993+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:13.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:12.993+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:13.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:12.993+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:13.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:12.993+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:13.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:12.993+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:13.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:12.993+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:13.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:13 smithi022 podman[87486]: 2024-09-10 08:22:13.308247411 +0000 UTC m=+6.072401346 container cleanup 4825cf7074655787b129e54bfbaad8d923163c7fface9d8cdbda1d75c06c0f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:22:13.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:13 smithi022 bash[87486]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9 2024-09-10T08:22:13.859 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:13 smithi022 podman[87503]: 2024-09-10 08:22:13.551181387 +0000 UTC m=+0.730882091 container remove 4825cf7074655787b129e54bfbaad8d923163c7fface9d8cdbda1d75c06c0f59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T08:22:13.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:13 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:13.395+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:13.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:13 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:13.395+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:13.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:13 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:13.395+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:13.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:13 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:13.395+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:13.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:13 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:13.395+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:13.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:13 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:13.395+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:13.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:13 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:13.395+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:45.795567+0000 front 2024-09-10T08:21:45.795531+0000 (oldest deadline 2024-09-10T08:22:09.295439+0000) 2024-09-10T08:22:14.170 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:13 smithi022 podman[87593]: 2024-09-10 08:22:13.860228886 +0000 UTC m=+0.105120259 container create cbcb4ae9d71bc88316a573b7218305ebe5d78b8668c63e6dbed13ce9d8863a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True) 2024-09-10T08:22:14.170 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:13 smithi022 podman[87593]: 2024-09-10 08:22:13.771221927 +0000 UTC m=+0.016113310 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:22:14.170 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:14 smithi022 podman[87593]: 2024-09-10 08:22:14.062496799 +0000 UTC m=+0.307388172 container init cbcb4ae9d71bc88316a573b7218305ebe5d78b8668c63e6dbed13ce9d8863a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T08:22:14.170 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:14 smithi022 podman[87593]: 2024-09-10 08:22:14.065803799 +0000 UTC m=+0.310695173 container start cbcb4ae9d71bc88316a573b7218305ebe5d78b8668c63e6dbed13ce9d8863a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-10T08:22:14.170 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:14 smithi022 podman[87593]: 2024-09-10 08:22:14.170794506 +0000 UTC m=+0.415685900 container attach cbcb4ae9d71bc88316a573b7218305ebe5d78b8668c63e6dbed13ce9d8863a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:22:14.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:14 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:14.015+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:14.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:14 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:14.015+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:14.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:14 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:14.015+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:14.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:14 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:14.015+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:14.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:14 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:14.015+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:14.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:14 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:14.015+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:14.503 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 10 08:22:14 smithi022 podman[87593]: 2024-09-10 08:22:14.26621611 +0000 UTC m=+0.511107484 container died cbcb4ae9d71bc88316a573b7218305ebe5d78b8668c63e6dbed13ce9d8863a4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T08:22:14.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:14 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:14.357+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:14.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:14 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:14.357+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:14.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:14 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:14.357+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:14.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:14 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:14.357+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:14.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:14 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:14.357+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:14.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:14 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:14.357+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:14.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:14 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:14.357+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:45.795567+0000 front 2024-09-10T08:21:45.795531+0000 (oldest deadline 2024-09-10T08:22:09.295439+0000) 2024-09-10T08:22:15.060 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T08:22:15.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:22:15.109 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T08:22:15.109 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T08:22:15.109 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.10 2024-09-10T08:22:15.398 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:15 smithi100 systemd[1]: Stopping Ceph osd.10 for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:22:15.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:15 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:14.999+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:15.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:15 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:14.999+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:15.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:15 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:14.999+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:15.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:15 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:14.999+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:15.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:15 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:14.999+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:15.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:15 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:14.999+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:15.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:15 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:15.398+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:15.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:15 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:15.398+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:15.870 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:15 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:15.398+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:15.870 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:15 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:15.398+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:15.870 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:15 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:15.398+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:15.870 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:15 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:15.398+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:15.870 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:15 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:15.398+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:45.795567+0000 front 2024-09-10T08:21:45.795531+0000 (oldest deadline 2024-09-10T08:22:09.295439+0000) 2024-09-10T08:22:15.871 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:15 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:15.416+0000 7fd5d4eae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:22:15.871 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:15 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:15.416+0000 7fd5d4eae640 -1 osd.10 99 *** Got signal Terminated *** 2024-09-10T08:22:15.871 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:15 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:15.416+0000 7fd5d4eae640 -1 osd.10 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:22:16.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:15 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:15.972+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:16.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:15 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:15.972+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:16.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:15 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:15.972+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:16.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:15 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:15.972+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:16.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:15 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:15.972+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:16.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:15 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:15.972+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:16.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:16 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:16.361+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:16.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:16 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:16.361+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:16.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:16 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:16.361+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:16.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:16 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:16.361+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:16.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:16 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:16.361+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:16.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:16 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:16.361+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:16.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:16 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:16.361+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:45.795567+0000 front 2024-09-10T08:21:45.795531+0000 (oldest deadline 2024-09-10T08:22:09.295439+0000) 2024-09-10T08:22:17.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:16 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:16.998+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:17.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:16 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:16.998+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:17.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:16 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:16.998+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:17.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:16 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:16.998+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:17.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:16 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:16.998+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:17.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:16 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:16.998+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:17.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:17 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:17.401+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:17.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:17 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:17.401+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:17.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:17 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:17.401+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:17.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:17 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:17.401+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:17.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:17 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:17.401+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:17.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:17 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:17.401+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:17.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:17 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:17.401+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:45.795567+0000 front 2024-09-10T08:21:45.795531+0000 (oldest deadline 2024-09-10T08:22:09.295439+0000) 2024-09-10T08:22:18.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:17 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:17.959+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:18.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:17 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:17.959+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:18.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:17 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:17.959+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:18.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:17 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:17.959+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:18.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:17 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:17.959+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:18.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:17 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:17.959+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:18.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:17 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:17.959+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-10T08:21:53.248133+0000 front 2024-09-10T08:21:53.248238+0000 (oldest deadline 2024-09-10T08:22:17.948035+0000) 2024-09-10T08:22:18.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:18 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:18.425+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:18.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:18 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:18.425+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:18.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:18 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:18.425+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:18.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:18 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:18.425+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:18.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:18 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:18.425+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:18.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:18 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:18.425+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:18.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:18 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:18.425+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:45.795567+0000 front 2024-09-10T08:21:45.795531+0000 (oldest deadline 2024-09-10T08:22:09.295439+0000) 2024-09-10T08:22:19.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:18 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:18.969+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:19.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:18 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:18.969+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:19.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:18 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:18.969+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:19.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:18 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:18.969+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:19.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:18 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:18.969+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:19.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:18 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:18.969+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:19.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:18 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:18.969+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-10T08:21:53.248133+0000 front 2024-09-10T08:21:53.248238+0000 (oldest deadline 2024-09-10T08:22:17.948035+0000) 2024-09-10T08:22:19.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:19 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:19.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:19.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:19 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:19.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:19.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:19 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:19.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:19.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:19 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:19.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:19.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:19 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:19.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:19.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:19 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:19.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:19.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:19 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:19.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:45.795567+0000 front 2024-09-10T08:21:45.795531+0000 (oldest deadline 2024-09-10T08:22:09.295439+0000) 2024-09-10T08:22:20.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:19 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:19.948+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:20.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:19 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:19.948+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:20.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:19 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:19.948+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:20.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:19 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:19.948+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:20.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:19 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:19.948+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:20.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:19 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:19.948+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:20.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:19 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:19.948+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-10T08:21:53.248133+0000 front 2024-09-10T08:21:53.248238+0000 (oldest deadline 2024-09-10T08:22:17.948035+0000) 2024-09-10T08:22:20.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:20 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:20.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:58.688791+0000 front 2024-09-10T08:20:58.688816+0000 (oldest deadline 2024-09-10T08:21:23.988944+0000) 2024-09-10T08:22:20.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:20 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:20.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:03.989376+0000 front 2024-09-10T08:21:03.989456+0000 (oldest deadline 2024-09-10T08:21:29.889527+0000) 2024-09-10T08:22:20.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:20 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:20.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:14.490911+0000 front 2024-09-10T08:21:14.491033+0000 (oldest deadline 2024-09-10T08:21:38.590779+0000) 2024-09-10T08:22:20.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:20 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:20.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-10T08:21:18.591350+0000 front 2024-09-10T08:21:18.591364+0000 (oldest deadline 2024-09-10T08:21:49.692267+0000) 2024-09-10T08:22:20.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:20 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:20.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:29.692653+0000 front 2024-09-10T08:21:29.692690+0000 (oldest deadline 2024-09-10T08:21:54.392713+0000) 2024-09-10T08:22:20.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:20 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:20.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:39.994796+0000 front 2024-09-10T08:21:39.994833+0000 (oldest deadline 2024-09-10T08:22:02.894651+0000) 2024-09-10T08:22:20.869 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:20 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10[59501]: 2024-09-10T08:22:20.384+0000 7fd5d14c4640 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:45.795567+0000 front 2024-09-10T08:21:45.795531+0000 (oldest deadline 2024-09-10T08:22:09.295439+0000) 2024-09-10T08:22:21.283 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:20 smithi100 podman[70851]: 2024-09-10 08:22:20.913168372 +0000 UTC m=+5.609685470 container died 771865ff80e00977344845aafdb166c2311b9f48be0f16dcd35dc6a6005562cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2) 2024-09-10T08:22:21.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:20 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:20.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:21.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:20 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:20.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:21.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:20 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:20.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:21.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:20 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:20.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:21.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:20 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:20.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:21.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:20 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:20.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:21.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:20 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:20.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-10T08:21:53.248133+0000 front 2024-09-10T08:21:53.248238+0000 (oldest deadline 2024-09-10T08:22:17.948035+0000) 2024-09-10T08:22:21.617 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:21 smithi100 podman[70851]: 2024-09-10 08:22:21.391134581 +0000 UTC m=+6.087651668 container cleanup 771865ff80e00977344845aafdb166c2311b9f48be0f16dcd35dc6a6005562cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T08:22:21.617 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:21 smithi100 bash[70851]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10 2024-09-10T08:22:21.868 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:21 smithi100 podman[70868]: 2024-09-10 08:22:21.617515465 +0000 UTC m=+0.699552057 container remove 771865ff80e00977344845aafdb166c2311b9f48be0f16dcd35dc6a6005562cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:22:22.169 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:21 smithi100 podman[70956]: 2024-09-10 08:22:21.910026963 +0000 UTC m=+0.097756026 container create 7ee0f57f700a3d7684cf25c4d66843a02f2eec8d51267cdd708aab03e1dd95b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T08:22:22.169 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:21 smithi100 podman[70956]: 2024-09-10 08:22:21.828515312 +0000 UTC m=+0.016244387 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:22:22.170 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:22 smithi100 podman[70956]: 2024-09-10 08:22:22.112414864 +0000 UTC m=+0.300143924 container init 7ee0f57f700a3d7684cf25c4d66843a02f2eec8d51267cdd708aab03e1dd95b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-10T08:22:22.170 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:22 smithi100 podman[70956]: 2024-09-10 08:22:22.115689303 +0000 UTC m=+0.303418366 container start 7ee0f57f700a3d7684cf25c4d66843a02f2eec8d51267cdd708aab03e1dd95b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T08:22:22.170 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:22 smithi100 podman[70956]: 2024-09-10 08:22:22.170391203 +0000 UTC m=+0.358120272 container attach 7ee0f57f700a3d7684cf25c4d66843a02f2eec8d51267cdd708aab03e1dd95b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T08:22:22.399 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.020+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:22.399 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.020+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:22.399 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.020+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:22.400 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.020+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:22.400 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.020+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:22.400 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.020+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:22.400 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.020+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-10T08:21:53.248133+0000 front 2024-09-10T08:21:53.248238+0000 (oldest deadline 2024-09-10T08:22:17.948035+0000) 2024-09-10T08:22:22.619 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:22 smithi100 podman[70956]: 2024-09-10 08:22:22.317991294 +0000 UTC m=+0.505720373 container died 7ee0f57f700a3d7684cf25c4d66843a02f2eec8d51267cdd708aab03e1dd95b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-10T08:22:22.907 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 10 08:22:22 smithi100 podman[70979]: 2024-09-10 08:22:22.898831404 +0000 UTC m=+0.575580682 container remove 7ee0f57f700a3d7684cf25c4d66843a02f2eec8d51267cdd708aab03e1dd95b0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T08:22:22.912 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T08:22:22.953 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:22:22.953 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T08:22:22.953 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T08:22:22.953 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.11 2024-09-10T08:22:23.275 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:23.276 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:23.276 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:23.276 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:23.276 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:23.276 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:23.277 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:22 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:22.977+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-10T08:21:53.248133+0000 front 2024-09-10T08:21:53.248238+0000 (oldest deadline 2024-09-10T08:22:17.948035+0000) 2024-09-10T08:22:23.277 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:23 smithi153 systemd[1]: Stopping Ceph osd.11 for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:22:23.277 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:23 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:23.275+0000 7f5448b7b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:22:23.277 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:23 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:23.275+0000 7f5448b7b640 -1 osd.11 99 *** Got signal Terminated *** 2024-09-10T08:22:23.277 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:23 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:23.275+0000 7f5448b7b640 -1 osd.11 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T08:22:24.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:24 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:24.017+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:24.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:24 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:24.017+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:24.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:24 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:24.017+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:24.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:24 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:24.017+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:24.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:24 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:24.017+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:24.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:24 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:24.017+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:24.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:24 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:24.017+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-10T08:21:53.248133+0000 front 2024-09-10T08:21:53.248238+0000 (oldest deadline 2024-09-10T08:22:17.948035+0000) 2024-09-10T08:22:25.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:25 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:25.029+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:25.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:25 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:25.029+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:25.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:25 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:25.029+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:25.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:25 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:25.029+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:25.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:25 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:25.029+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:25.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:25 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:25.029+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:25.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:25 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:25.029+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-10T08:21:53.248133+0000 front 2024-09-10T08:21:53.248238+0000 (oldest deadline 2024-09-10T08:22:17.948035+0000) 2024-09-10T08:22:26.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.010+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:26.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.010+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:26.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.010+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:26.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.010+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:26.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.010+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:26.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.010+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:26.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.010+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-10T08:21:53.248133+0000 front 2024-09-10T08:21:53.248238+0000 (oldest deadline 2024-09-10T08:22:17.948035+0000) 2024-09-10T08:22:27.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.985+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:27.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.985+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:27.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.985+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:27.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.985+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:27.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.985+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:27.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.985+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:27.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.985+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-10T08:21:53.248133+0000 front 2024-09-10T08:21:53.248238+0000 (oldest deadline 2024-09-10T08:22:17.948035+0000) 2024-09-10T08:22:27.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:26 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:26.985+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6820 osd.8 since back 2024-09-10T08:22:01.349411+0000 front 2024-09-10T08:22:01.349436+0000 (oldest deadline 2024-09-10T08:22:26.049392+0000) 2024-09-10T08:22:28.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:27.956+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-10T08:20:56.541375+0000 front 2024-09-10T08:20:56.541447+0000 (oldest deadline 2024-09-10T08:21:21.841262+0000) 2024-09-10T08:22:28.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:27.956+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-10T08:21:07.142460+0000 front 2024-09-10T08:21:07.142311+0000 (oldest deadline 2024-09-10T08:21:31.242213+0000) 2024-09-10T08:22:28.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:27.956+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-09-10T08:21:13.443353+0000 front 2024-09-10T08:21:13.443376+0000 (oldest deadline 2024-09-10T08:21:36.943487+0000) 2024-09-10T08:22:28.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:27.956+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-10T08:21:30.945758+0000 front 2024-09-10T08:21:30.945716+0000 (oldest deadline 2024-09-10T08:21:56.845680+0000) 2024-09-10T08:22:28.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:27.956+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-09-10T08:21:36.846211+0000 front 2024-09-10T08:21:36.846184+0000 (oldest deadline 2024-09-10T08:22:02.746164+0000) 2024-09-10T08:22:28.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:27.956+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-10T08:21:46.247375+0000 front 2024-09-10T08:21:46.247456+0000 (oldest deadline 2024-09-10T08:22:12.147213+0000) 2024-09-10T08:22:28.444 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:27.956+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-10T08:21:53.248133+0000 front 2024-09-10T08:21:53.248238+0000 (oldest deadline 2024-09-10T08:22:17.948035+0000) 2024-09-10T08:22:28.445 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:27 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11[60277]: 2024-09-10T08:22:27.956+0000 7f5441189640 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.153:6820 osd.8 since back 2024-09-10T08:22:01.349411+0000 front 2024-09-10T08:22:01.349436+0000 (oldest deadline 2024-09-10T08:22:26.049392+0000) 2024-09-10T08:22:28.958 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:28 smithi153 podman[72410]: 2024-09-10 08:22:28.699423315 +0000 UTC m=+5.554058726 container died 9f038d20a8d523d2a73d6baed277b9f555d0d93cf4afae3c1262d7b1fa93bd6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T08:22:29.309 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:29 smithi153 podman[72410]: 2024-09-10 08:22:29.050067467 +0000 UTC m=+5.904702867 container cleanup 9f038d20a8d523d2a73d6baed277b9f555d0d93cf4afae3c1262d7b1fa93bd6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T08:22:29.309 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:29 smithi153 bash[72410]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11 2024-09-10T08:22:29.666 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:29 smithi153 podman[72427]: 2024-09-10 08:22:29.309616544 +0000 UTC m=+0.607528613 container remove 9f038d20a8d523d2a73d6baed277b9f555d0d93cf4afae3c1262d7b1fa93bd6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T08:22:29.944 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:29 smithi153 podman[72516]: 2024-09-10 08:22:29.570424847 +0000 UTC m=+0.015922650 image pull 41d67112835771c3efca60c6b8fe297c7ddaecdc26cea26fd28aa18636e49005 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559 2024-09-10T08:22:29.944 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:29 smithi153 podman[72516]: 2024-09-10 08:22:29.676985539 +0000 UTC m=+0.122483372 container create d07f9962b7627784c0791d46f0a60a19433bdf624402503898e68e971e07d275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:22:29.944 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:29 smithi153 podman[72516]: 2024-09-10 08:22:29.870803055 +0000 UTC m=+0.316300843 container init d07f9962b7627784c0791d46f0a60a19433bdf624402503898e68e971e07d275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:22:29.944 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:29 smithi153 podman[72516]: 2024-09-10 08:22:29.874196489 +0000 UTC m=+0.319694280 container start d07f9962b7627784c0791d46f0a60a19433bdf624402503898e68e971e07d275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T08:22:30.347 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:29 smithi153 podman[72516]: 2024-09-10 08:22:29.9457038 +0000 UTC m=+0.391201606 container attach d07f9962b7627784c0791d46f0a60a19433bdf624402503898e68e971e07d275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T08:22:30.347 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:30 smithi153 podman[72516]: 2024-09-10 08:22:30.06269869 +0000 UTC m=+0.508196498 container died d07f9962b7627784c0791d46f0a60a19433bdf624402503898e68e971e07d275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T08:22:30.600 INFO:journalctl@ceph.osd.11.smithi153.stdout:Sep 10 08:22:30 smithi153 podman[72539]: 2024-09-10 08:22:30.590513494 +0000 UTC m=+0.521398119 container remove d07f9962b7627784c0791d46f0a60a19433bdf624402503898e68e971e07d275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T08:22:30.605 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T08:22:30.643 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:22:30.643 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T08:22:30.643 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T08:22:30.643 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.a 2024-09-10T08:22:30.951 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:22:30 smithi022 systemd[1]: Stopping Ceph mds.a for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:22:31.256 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:22:30 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-a[69755]: 2024-09-10T08:22:30.950+0000 7f56094cb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:22:31.256 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:22:30 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-a[69755]: 2024-09-10T08:22:30.951+0000 7f56094cb640 -1 mds.a *** got signal Terminated *** 2024-09-10T08:22:35.226 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:22:34 smithi022 podman[87711]: 2024-09-10 08:22:34.965484799 +0000 UTC m=+4.111273391 container died 420e377e7aa27dcec0a25c00690bd74ed4653913539d44cea55d5d3072d967bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-a, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:22:35.503 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:22:35 smithi022 podman[87711]: 2024-09-10 08:22:35.325322277 +0000 UTC m=+4.471110867 container cleanup 420e377e7aa27dcec0a25c00690bd74ed4653913539d44cea55d5d3072d967bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=) 2024-09-10T08:22:35.503 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 10 08:22:35 smithi022 bash[87711]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-a 2024-09-10T08:22:35.734 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T08:22:35.770 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:22:35.771 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T08:22:35.771 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T08:22:35.771 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.d 2024-09-10T08:22:36.003 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:22:35 smithi022 systemd[1]: Stopping Ceph mds.d for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:22:36.503 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:22:36 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-d[68537]: 2024-09-10T08:22:36.095+0000 7f0d7abb7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:22:36.504 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:22:36 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-d[68537]: 2024-09-10T08:22:36.095+0000 7f0d7abb7640 -1 mds.d *** got signal Terminated *** 2024-09-10T08:22:38.753 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:22:38 smithi022 podman[87832]: 2024-09-10 08:22:38.44242973 +0000 UTC m=+2.446993344 container died a8eafe1139db1d98db03c999839808a597318dddc5915b49e8b7349f5db17e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:22:39.256 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:22:38 smithi022 podman[87832]: 2024-09-10 08:22:38.887823617 +0000 UTC m=+2.892387221 container cleanup a8eafe1139db1d98db03c999839808a597318dddc5915b49e8b7349f5db17e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:22:39.256 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:22:38 smithi022 bash[87832]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-d 2024-09-10T08:22:39.257 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 10 08:22:39 smithi022 podman[87844]: 2024-09-10 08:22:39.047432471 +0000 UTC m=+0.601332626 container remove a8eafe1139db1d98db03c999839808a597318dddc5915b49e8b7349f5db17e7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:22:39.271 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T08:22:39.306 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:22:39.306 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T08:22:39.306 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T08:22:39.306 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.g 2024-09-10T08:22:39.741 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:22:39 smithi022 systemd[1]: Stopping Ceph mds.g for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:22:40.003 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:22:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-g[69420]: 2024-09-10T08:22:39.740+0000 7f6380d99640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:22:40.003 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:22:39 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-g[69420]: 2024-09-10T08:22:39.740+0000 7f6380d99640 -1 mds.g *** got signal Terminated *** 2024-09-10T08:22:43.491 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:22:43 smithi022 podman[87955]: 2024-09-10 08:22:43.220237171 +0000 UTC m=+3.688939772 container died c43e4ef5bdbb0712c0d596672185c0c4bf30c96ea373c43ff81c79ee0f3db721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:22:43.753 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:22:43 smithi022 podman[87955]: 2024-09-10 08:22:43.607759787 +0000 UTC m=+4.076462386 container cleanup c43e4ef5bdbb0712c0d596672185c0c4bf30c96ea373c43ff81c79ee0f3db721 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:22:43.753 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 10 08:22:43 smithi022 bash[87955]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-g 2024-09-10T08:22:44.017 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T08:22:44.050 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:22:44.051 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T08:22:44.051 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T08:22:44.051 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.j 2024-09-10T08:22:44.253 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:22:44 smithi022 systemd[1]: Stopping Ceph mds.j for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:22:44.753 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:22:44 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-j[68125]: 2024-09-10T08:22:44.385+0000 7fed30d57640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:22:44.754 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:22:44 smithi022 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-j[68125]: 2024-09-10T08:22:44.385+0000 7fed30d57640 -1 mds.j *** got signal Terminated *** 2024-09-10T08:22:47.056 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:22:46 smithi022 podman[88075]: 2024-09-10 08:22:46.771674597 +0000 UTC m=+2.492067447 container died 561a585db1b79c882bf96956c91375621a5e0ff2cd387f4d73dd62337a0d3968 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-j, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T08:22:47.395 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:22:47 smithi022 podman[88075]: 2024-09-10 08:22:47.153554793 +0000 UTC m=+2.873947684 container cleanup 561a585db1b79c882bf96956c91375621a5e0ff2cd387f4d73dd62337a0d3968 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-j, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=) 2024-09-10T08:22:47.395 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 10 08:22:47 smithi022 bash[88075]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-j 2024-09-10T08:22:47.550 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T08:22:47.583 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:22:47.583 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T08:22:47.583 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T08:22:47.584 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.b 2024-09-10T08:22:47.869 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:22:47 smithi100 systemd[1]: Stopping Ceph mds.b for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:22:48.369 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:22:48 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b[64699]: 2024-09-10T08:22:48.007+0000 7f2d74d07640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:22:48.369 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:22:48 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b[64699]: 2024-09-10T08:22:48.007+0000 7f2d74d07640 -1 mds.b *** got signal Terminated *** 2024-09-10T08:22:51.619 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:22:51 smithi100 podman[71069]: 2024-09-10 08:22:51.13912743 +0000 UTC m=+3.359276983 container died 36c787485dc0f8c73a778943ac242099ac432eef2ba1a4f9f97767c9bcee92eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:22:51.966 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:22:51 smithi100 podman[71069]: 2024-09-10 08:22:51.749104678 +0000 UTC m=+3.969254221 container cleanup 36c787485dc0f8c73a778943ac242099ac432eef2ba1a4f9f97767c9bcee92eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T08:22:51.966 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 10 08:22:51 smithi100 bash[71069]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-b 2024-09-10T08:22:52.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T08:22:52.130 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:22:52.130 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T08:22:52.130 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T08:22:52.130 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.e 2024-09-10T08:22:52.618 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:22:52 smithi100 systemd[1]: Stopping Ceph mds.e for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:22:52.619 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:22:52 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-e[64086]: 2024-09-10T08:22:52.444+0000 7fdfcb6d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:22:52.619 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:22:52 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-e[64086]: 2024-09-10T08:22:52.444+0000 7fdfcb6d0640 -1 mds.e *** got signal Terminated *** 2024-09-10T08:22:55.453 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:22:55 smithi100 podman[71190]: 2024-09-10 08:22:55.127247804 +0000 UTC m=+2.772404760 container died 5f62ec5148936f7fa0fa1feca31e52da01835e6ac196e3714566a944ddb14eeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-e, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T08:22:55.795 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:22:55 smithi100 podman[71190]: 2024-09-10 08:22:55.536604821 +0000 UTC m=+3.181761781 container cleanup 5f62ec5148936f7fa0fa1feca31e52da01835e6ac196e3714566a944ddb14eeb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:22:55.795 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 10 08:22:55 smithi100 bash[71190]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-e 2024-09-10T08:22:55.955 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T08:22:55.990 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:22:55.990 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T08:22:55.990 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T08:22:55.990 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.h 2024-09-10T08:22:56.306 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:22:56 smithi100 systemd[1]: Stopping Ceph mds.h for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:22:56.618 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:22:56 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-h[64385]: 2024-09-10T08:22:56.306+0000 7fd36b2fd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:22:56.618 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:22:56 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-h[64385]: 2024-09-10T08:22:56.306+0000 7fd36b2fd640 -1 mds.h *** got signal Terminated *** 2024-09-10T08:22:59.399 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:22:59 smithi100 podman[71325]: 2024-09-10 08:22:59.124045132 +0000 UTC m=+2.919122053 container died eb02af8bedc7d1feb5f91a0738f32f8884fd19f78febc075a15defb247efd22f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-10T08:22:59.740 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:22:59 smithi100 podman[71325]: 2024-09-10 08:22:59.473356504 +0000 UTC m=+3.268433422 container cleanup eb02af8bedc7d1feb5f91a0738f32f8884fd19f78febc075a15defb247efd22f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T08:22:59.740 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 10 08:22:59 smithi100 bash[71325]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-h 2024-09-10T08:22:59.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T08:22:59.929 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:22:59.929 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T08:22:59.929 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T08:22:59.930 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.k 2024-09-10T08:23:00.251 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 10 08:23:00 smithi100 systemd[1]: Stopping Ceph mds.k for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:23:00.619 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 10 08:23:00 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-k[63770]: 2024-09-10T08:23:00.251+0000 7fdaf7573640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:23:00.619 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 10 08:23:00 smithi100 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-k[63770]: 2024-09-10T08:23:00.251+0000 7fdaf7573640 -1 mds.k *** got signal Terminated *** 2024-09-10T08:23:03.427 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 10 08:23:03 smithi100 podman[71447]: 2024-09-10 08:23:03.14187969 +0000 UTC m=+2.994292027 container died edd1477f23980a063e43b9e6f16211f61c2ba529b75a5bc22a37fa9a752b5101 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-k, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T08:23:03.743 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 10 08:23:03 smithi100 podman[71447]: 2024-09-10 08:23:03.501888315 +0000 UTC m=+3.354300651 container cleanup edd1477f23980a063e43b9e6f16211f61c2ba529b75a5bc22a37fa9a752b5101 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-k, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T08:23:03.743 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 10 08:23:03 smithi100 bash[71447]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-k 2024-09-10T08:23:03.865 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T08:23:03.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:23:03.899 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T08:23:03.899 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T08:23:03.899 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.c 2024-09-10T08:23:04.194 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:23:03 smithi153 systemd[1]: Stopping Ceph mds.c for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:23:04.452 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:23:04 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-c[65564]: 2024-09-10T08:23:04.224+0000 7f0588f36640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:23:04.452 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:23:04 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-c[65564]: 2024-09-10T08:23:04.224+0000 7f0588f36640 -1 mds.c *** got signal Terminated *** 2024-09-10T08:23:07.414 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:23:07 smithi153 podman[72618]: 2024-09-10 08:23:07.133685915 +0000 UTC m=+3.038027650 container died a0f9b70fa01a7f9ed980fe1b9ed40a459528ed75646ae8efd6144e515c083bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-c, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T08:23:07.694 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:23:07 smithi153 podman[72618]: 2024-09-10 08:23:07.514162185 +0000 UTC m=+3.418503917 container cleanup a0f9b70fa01a7f9ed980fe1b9ed40a459528ed75646ae8efd6144e515c083bb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T08:23:07.694 INFO:journalctl@ceph.mds.c.smithi153.stdout:Sep 10 08:23:07 smithi153 bash[72618]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-c 2024-09-10T08:23:07.907 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T08:23:07.944 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:23:07.944 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T08:23:07.944 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T08:23:07.944 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.f 2024-09-10T08:23:08.301 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:23:08 smithi153 systemd[1]: Stopping Ceph mds.f for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:23:08.694 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:23:08 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-f[65258]: 2024-09-10T08:23:08.301+0000 7f80d4748640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:23:08.694 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:23:08 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-f[65258]: 2024-09-10T08:23:08.301+0000 7f80d4748640 -1 mds.f *** got signal Terminated *** 2024-09-10T08:23:11.409 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:23:11 smithi153 podman[72750]: 2024-09-10 08:23:11.128529505 +0000 UTC m=+2.967947863 container died 21c336992fde23ca395750c1460230d766d71630e3a316440e6008308f25e45f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:23:11.694 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:23:11 smithi153 podman[72750]: 2024-09-10 08:23:11.493041682 +0000 UTC m=+3.332460039 container cleanup 21c336992fde23ca395750c1460230d766d71630e3a316440e6008308f25e45f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.license=GPLv2) 2024-09-10T08:23:11.694 INFO:journalctl@ceph.mds.f.smithi153.stdout:Sep 10 08:23:11 smithi153 bash[72750]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-f 2024-09-10T08:23:11.921 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T08:23:11.955 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:23:11.955 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T08:23:11.955 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T08:23:11.955 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.i 2024-09-10T08:23:12.271 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:23:12 smithi153 systemd[1]: Stopping Ceph mds.i for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:23:12.694 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:23:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-i[65865]: 2024-09-10T08:23:12.271+0000 7f2db6f85640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:23:12.694 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:23:12 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-i[65865]: 2024-09-10T08:23:12.271+0000 7f2db6f85640 -1 mds.i *** got signal Terminated *** 2024-09-10T08:23:15.194 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:23:15 smithi153 podman[72870]: 2024-09-10 08:23:15.130552606 +0000 UTC m=+2.951034086 container died e96d35fbf7a92a319ce51638100463bb5b41860772655eb35e43f909391cecf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T08:23:15.789 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:23:15 smithi153 podman[72870]: 2024-09-10 08:23:15.538796982 +0000 UTC m=+3.359278465 container cleanup e96d35fbf7a92a319ce51638100463bb5b41860772655eb35e43f909391cecf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-i, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b) 2024-09-10T08:23:15.789 INFO:journalctl@ceph.mds.i.smithi153.stdout:Sep 10 08:23:15 smithi153 bash[72870]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-i 2024-09-10T08:23:15.959 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T08:23:15.991 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:23:15.992 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T08:23:15.992 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T08:23:15.992 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.l 2024-09-10T08:23:16.308 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:23:16 smithi153 systemd[1]: Stopping Ceph mds.l for 71bf679e-6f4a-11ef-bcea-c7b262605968... 2024-09-10T08:23:16.694 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:23:16 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-l[64954]: 2024-09-10T08:23:16.308+0000 7f4d877cb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T08:23:16.694 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:23:16 smithi153 ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-l[64954]: 2024-09-10T08:23:16.308+0000 7f4d877cb640 -1 mds.l *** got signal Terminated *** 2024-09-10T08:23:19.409 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:23:19 smithi153 podman[72991]: 2024-09-10 08:23:19.13761305 +0000 UTC m=+2.923823538 container died 3feb709348bc0754b4360383e3e478062fd8d9dc3e5e990a4f395ebefa42a8be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-10T08:23:19.694 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:23:19 smithi153 podman[72991]: 2024-09-10 08:23:19.492411022 +0000 UTC m=+3.278621508 container cleanup 3feb709348bc0754b4360383e3e478062fd8d9dc3e5e990a4f395ebefa42a8be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:1c016bcec6a352c6df797523a67ab86655d59690b95308490e636572fc527559, name=ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-l, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240909.165402-squid-1cf819b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T08:23:19.694 INFO:journalctl@ceph.mds.l.smithi153.stdout:Sep 10 08:23:19 smithi153 bash[72991]: ceph-71bf679e-6f4a-11ef-bcea-c7b262605968-mds-l 2024-09-10T08:23:19.924 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-71bf679e-6f4a-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T08:23:19.955 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T08:23:19.955 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T08:23:19.955 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T08:23:20.167 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:23:22.755 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T08:23:22.961 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:23:25.561 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T08:23:25.765 INFO:teuthology.orchestra.run.smithi153.stdout:Deleting cluster with fsid: 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:23:28.159 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T08:23:28.195 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T08:23:28.228 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T08:23:28.255 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T08:23:28.258 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888/remote/smithi022/crash 2024-09-10T08:23:28.259 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/crash -- . 2024-09-10T08:23:28.290 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T08:23:28.290 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now 2024-09-10T08:23:28.292 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888/remote/smithi100/crash 2024-09-10T08:23:28.293 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/crash -- . 2024-09-10T08:23:28.335 INFO:teuthology.orchestra.run.smithi100.stderr:tar: /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T08:23:28.335 INFO:teuthology.orchestra.run.smithi100.stderr:tar: Error is not recoverable: exiting now 2024-09-10T08:23:28.337 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888/remote/smithi153/crash 2024-09-10T08:23:28.338 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/crash -- . 2024-09-10T08:23:28.373 INFO:teuthology.orchestra.run.smithi153.stderr:tar: /var/lib/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T08:23:28.373 INFO:teuthology.orchestra.run.smithi153.stderr:tar: Error is not recoverable: exiting now 2024-09-10T08:23:28.374 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T08:23:28.374 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-10T08:23:28.452 INFO:tasks.cephadm:Compressing logs... 2024-09-10T08:23:28.452 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T08:23:28.455 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T08:23:28.457 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T08:23:28.484 INFO:teuthology.orchestra.run.smithi153.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T08:23:28.484 INFO:teuthology.orchestra.run.smithi153.stderr:: No such file or directory 2024-09-10T08:23:28.484 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T08:23:28.484 INFO:teuthology.orchestra.run.smithi153.stderr:gzip/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-volume.log: -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T08:23:28.485 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T08:23:28.486 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T08:23:28.486 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T08:23:28.489 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T08:23:28.489 INFO:teuthology.orchestra.run.smithi153.stderr: 82.0% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T08:23:28.489 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T08:23:28.489 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.2.log: --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.log 2024-09-10T08:23:28.489 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T08:23:28.489 INFO:teuthology.orchestra.run.smithi153.stderr: 90.6% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T08:23:28.489 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T08:23:28.490 INFO:teuthology.orchestra.run.smithi022.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T08:23:28.491 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.l.log: 86.8% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T08:23:28.491 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T08:23:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T08:23:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T08:23:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T08:23:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T08:23:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T08:23:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T08:23:28.495 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T08:23:28.495 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T08:23:28.495 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T08:23:28.495 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.log 2024-09-10T08:23:28.495 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T08:23:28.495 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T08:23:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T08:23:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T08:23:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T08:23:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 86.8% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T08:23:28.497 INFO:teuthology.orchestra.run.smithi022.stderr: 94.5% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T08:23:28.498 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.8.log: 91.0% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T08:23:28.498 INFO:teuthology.orchestra.run.smithi022.stderr: 94.5% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T08:23:28.509 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T08:23:28.514 INFO:teuthology.orchestra.run.smithi100.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T08:23:28.519 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mgr.z.log: 92.0% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T08:23:28.522 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T08:23:28.523 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T08:23:28.524 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T08:23:28.524 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T08:23:28.524 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.10.log: /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T08:23:28.525 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T08:23:28.525 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T08:23:28.525 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T08:23:28.525 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T08:23:28.525 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T08:23:28.527 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T08:23:28.527 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.log 2024-09-10T08:23:28.527 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T08:23:28.527 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T08:23:28.527 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T08:23:28.527 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T08:23:28.534 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T08:23:28.548 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% 92.9% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T08:23:28.552 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T08:23:28.556 INFO:teuthology.orchestra.run.smithi153.stderr: 94.5% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T08:23:28.604 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T08:23:28.612 INFO:teuthology.orchestra.run.smithi153.stderr: 94.3% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T08:23:28.657 INFO:teuthology.orchestra.run.smithi022.stderr: 90.9% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T08:23:28.668 INFO:teuthology.orchestra.run.smithi100.stderr: 86.8% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T08:23:28.709 INFO:teuthology.orchestra.run.smithi022.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T08:23:28.732 INFO:teuthology.orchestra.run.smithi100.stderr: 82.0% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T08:23:28.751 INFO:teuthology.orchestra.run.smithi100.stderr: 90.6% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T08:23:28.764 INFO:teuthology.orchestra.run.smithi022.stderr: 90.4% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T08:23:28.766 INFO:teuthology.orchestra.run.smithi100.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T08:23:28.779 INFO:teuthology.orchestra.run.smithi153.stderr: 92.0% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T08:23:28.817 INFO:teuthology.orchestra.run.smithi100.stderr: 94.5% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T08:23:28.902 INFO:teuthology.orchestra.run.smithi022.stderr: 84.5% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T08:23:28.954 INFO:teuthology.orchestra.run.smithi022.stderr: 94.4% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T08:23:28.995 INFO:teuthology.orchestra.run.smithi022.stderr: 93.0% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T08:23:29.072 INFO:teuthology.orchestra.run.smithi100.stderr: 93.0% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T08:23:29.088 INFO:teuthology.orchestra.run.smithi100.stderr: 91.0% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T08:23:29.118 INFO:teuthology.orchestra.run.smithi100.stderr: 92.6% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T08:23:29.420 INFO:teuthology.orchestra.run.smithi100.stderr: 92.0% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T08:23:29.584 INFO:teuthology.orchestra.run.smithi022.stderr: 90.2% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T08:23:31.726 INFO:teuthology.orchestra.run.smithi022.stderr: 90.3% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T08:23:37.894 INFO:teuthology.orchestra.run.smithi153.stderr: 97.5% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T08:24:06.933 INFO:teuthology.orchestra.run.smithi153.stderr: 93.1% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T08:24:14.927 INFO:teuthology.orchestra.run.smithi153.stderr: 93.1% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T08:24:18.842 INFO:teuthology.orchestra.run.smithi153.stderr: 93.1% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T08:24:21.652 INFO:teuthology.orchestra.run.smithi153.stderr: 93.1% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T08:24:21.653 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-10T08:24:21.653 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m53.179s 2024-09-10T08:24:21.654 INFO:teuthology.orchestra.run.smithi153.stderr:user 3m11.267s 2024-09-10T08:24:21.654 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m6.667s 2024-09-10T08:24:29.700 INFO:teuthology.orchestra.run.smithi022.stderr: 93.0% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T08:24:53.612 INFO:teuthology.orchestra.run.smithi022.stderr: 93.1% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T08:25:01.013 INFO:teuthology.orchestra.run.smithi022.stderr: 93.1% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T08:25:13.054 INFO:teuthology.orchestra.run.smithi100.stderr: 94.6% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T08:25:13.054 INFO:teuthology.orchestra.run.smithi022.stderr: 93.0% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T08:25:13.056 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-09-10T08:25:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:real 1m44.587s 2024-09-10T08:25:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:user 3m8.769s 2024-09-10T08:25:13.057 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m6.605s 2024-09-10T08:25:36.047 INFO:teuthology.orchestra.run.smithi100.stderr: 93.2% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T08:26:43.154 INFO:teuthology.orchestra.run.smithi100.stderr: 93.0% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T08:26:52.161 INFO:teuthology.orchestra.run.smithi100.stderr: 93.1% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T08:26:54.696 INFO:teuthology.orchestra.run.smithi100.stderr: 93.1% -- replaced with /var/log/ceph/71bf679e-6f4a-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T08:26:54.699 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-10T08:26:54.699 INFO:teuthology.orchestra.run.smithi100.stderr:real 3m26.225s 2024-09-10T08:26:54.699 INFO:teuthology.orchestra.run.smithi100.stderr:user 4m15.602s 2024-09-10T08:26:54.699 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m10.405s 2024-09-10T08:26:54.700 INFO:tasks.cephadm:Archiving logs... 2024-09-10T08:26:54.701 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888/remote/smithi022/log 2024-09-10T08:26:54.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T08:27:24.768 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888/remote/smithi100/log 2024-09-10T08:27:24.770 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T08:28:06.113 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888/remote/smithi153/log 2024-09-10T08:28:06.114 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T08:28:35.595 INFO:tasks.cephadm:Removing cluster... 2024-09-10T08:28:35.596 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 --force 2024-09-10T08:28:35.809 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:28:36.303 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 --force 2024-09-10T08:28:36.505 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:28:37.090 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 71bf679e-6f4a-11ef-bcea-c7b262605968 --force 2024-09-10T08:28:37.292 INFO:teuthology.orchestra.run.smithi153.stdout:Deleting cluster with fsid: 71bf679e-6f4a-11ef-bcea-c7b262605968 2024-09-10T08:28:37.810 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T08:28:37.810 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T08:28:37.829 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T08:28:37.846 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T08:28:37.861 INFO:tasks.cephadm:Teardown complete 2024-09-10T08:28:37.862 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T08:28:37.875 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T08:28:37.876 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T08:28:37.878 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T08:28:37.888 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T08:28:37.975 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T08:28:38.164 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T08:28:38.165 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:28:38.167 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:28:38.170 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:28:38.182 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:28:38.183 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:28:38.184 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:28:38.188 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:28:38.188 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-09-10T08:28:38.188 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 50 +1425us[+1425us] +/- 35ms 2024-09-10T08:28:38.188 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 +2056us[+2348us] +/- 58ms 2024-09-10T08:28:38.188 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 -5308us[-5016us] +/- 67ms 2024-09-10T08:28:38.188 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:28:38.190 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:28:38.190 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-09-10T08:28:38.190 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 50 +1414us[+1414us] +/- 35ms 2024-09-10T08:28:38.190 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 6 377 50 +2055us[+2183us] +/- 58ms 2024-09-10T08:28:38.190 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -5308us[-5308us] +/- 67ms 2024-09-10T08:28:38.190 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:28:38.200 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:28:38.200 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-10T08:28:38.200 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 51 +1404us[+1346us] +/- 35ms 2024-09-10T08:28:38.200 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv02.front.sepia.ceph.com 3 6 377 46 +2022us[+1963us] +/- 58ms 2024-09-10T08:28:38.200 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -5338us[-5397us] +/- 67ms 2024-09-10T08:28:38.200 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:28:38.201 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T08:28:38.322 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T08:28:38.323 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T08:28:38.382 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T08:28:38.529 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T08:28:38.622 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T08:28:38.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:28:38.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:28:38.728 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:28:38.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:28:38.756 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:28:38.785 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:28:38.785 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T08:28:38.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T08:28:38.857 INFO:teuthology.task.internal:Duration was 2170.369337 seconds 2024-09-10T08:28:38.858 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T08:28:38.949 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T08:28:38.949 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T08:28:38.952 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T08:28:38.954 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T08:28:38.995 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:28:39.016 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:28:39.020 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:28:39.484 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T08:28:39.484 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2024-09-10T08:28:39.485 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T08:28:39.511 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-09-10T08:28:39.511 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T08:28:39.544 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-09-10T08:28:39.544 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T08:28:39.577 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T08:28:39.577 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T08:28:39.579 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T08:28:39.586 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T08:28:39.645 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T08:28:39.645 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T08:28:39.653 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T08:28:39.656 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T08:28:40.180 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T08:28:40.191 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T08:28:40.192 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T08:28:40.238 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T08:28:40.284 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T08:28:40.311 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T08:28:40.332 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:28:40.336 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:28:40.339 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:28:40.363 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-09-10T08:28:40.365 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2024-09-10T08:28:40.374 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-09-10T08:28:40.397 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:28:40.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:28:40.435 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:28:40.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:28:40.450 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:28:40.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:28:40.465 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T08:28:40.477 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T08:28:40.478 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888/remote/smithi022 2024-09-10T08:28:40.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T08:28:40.524 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888/remote/smithi100 2024-09-10T08:28:40.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T08:28:40.560 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898888/remote/smithi153 2024-09-10T08:28:40.561 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T08:28:40.598 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T08:28:40.598 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T08:28:40.601 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T08:28:40.603 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T08:28:40.647 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T08:28:40.664 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T08:28:40.665 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T08:28:40.702 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T08:28:40.703 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T08:28:40.705 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T08:28:40.707 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T08:28:40.718 INFO:teuthology.orchestra.run.smithi022.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 08:28 /home/ubuntu/cephtest 2024-09-10T08:28:40.720 INFO:teuthology.orchestra.run.smithi100.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 08:28 /home/ubuntu/cephtest 2024-09-10T08:28:40.722 INFO:teuthology.orchestra.run.smithi153.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 08:28 /home/ubuntu/cephtest 2024-09-10T08:28:40.723 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T08:28:40.743 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T08:28:40.935 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/suites/iogen}} duration: 2170.369337081909 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-10T08:28:40.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T08:28:41.040 INFO:teuthology.run:pass